appvoid commited on
Commit
6a403af
1 Parent(s): 5251a0e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -9,7 +9,7 @@ datasets:
9
  ![palmer](https://huggingface.co/appvoid/palmer-003-turbo/resolve/main/image.png)
10
  # palmer
11
  ### a better base model
12
- palmer is a series of ~1b parameters language models fine-tuned to be used as base models instead of using custom prompts for tasks. This means that it can be further fine-tuned on more data with custom prompts as usual or be used for downstream tasks as any base model you can get. The model has the best of both worlds: some "bias" to act as an assistant, but also the abillity to predict the next-word from its internet knowledge base. It's a 600m llama 2 model (since is 4bit quantized) so you can use it with your favorite tools/frameworks.
13
 
14
  ### evaluation 🧪
15
  note that this is a zero-shot setting as opposite to open llm leaderboard's few-shot evals
@@ -17,6 +17,7 @@ note that this is a zero-shot setting as opposite to open llm leaderboard's few-
17
  Model ARC_C HellaSwag PIQA Winogrande Average
18
  palmer-001 | 0.2807 | 0.5524 | 0.7106 | 0.5896 | 0.5333 |
19
  palmer-003-turbo | 0.3106 | 0.5806 | 0.7247 | 0.5951 | 0.5527 |
 
20
  palmer-002 | 0.3242 | 0.5956 | 0.7345 | 0.5888 | 0.5607 |
21
  ```
22
 
 
9
  ![palmer](https://huggingface.co/appvoid/palmer-003-turbo/resolve/main/image.png)
10
  # palmer
11
  ### a better base model
12
+ This model will continuosly be improved over time. The model is named as palmer-003-turbo-yearmonth formatting.
13
 
14
  ### evaluation 🧪
15
  note that this is a zero-shot setting as opposite to open llm leaderboard's few-shot evals
 
17
  Model ARC_C HellaSwag PIQA Winogrande Average
18
  palmer-001 | 0.2807 | 0.5524 | 0.7106 | 0.5896 | 0.5333 |
19
  palmer-003-turbo | 0.3106 | 0.5806 | 0.7247 | 0.5951 | 0.5527 |
20
+ p-003-turbo-2401 | ~~~~~~ | ~~~~~~ | ~~~~~~ | ~~~~~~ | ~~~~~~ | (this)
21
  palmer-002 | 0.3242 | 0.5956 | 0.7345 | 0.5888 | 0.5607 |
22
  ```
23