Text Generation
Transformers
PyTorch
English
gpt2a
custom_code
crumb commited on
Commit
7140f59
·
1 Parent(s): 50b5761

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -12,7 +12,7 @@ A modified GPT-2 model with only 25 million non-embedding params that outbenches
12
 
13
  | model | avg | arc | hellaswag | mmlu | truthfulqa |
14
  | --- | --- | --- | --- | --- | --- |
15
- | cramp-41m | 30.57 | 21.76 | 27.35 | 25.53 | 47.66 |
16
  | gpt2 (125m) | 30.06 | 22.1 | 31.6 | 25.86 | 40.67 |
17
  | pythia 70m deduped | 30.25 | 21.08 | 27.17 | 25.26 | 47.51 |
18
  | pythia 70m | 30.46 | 21.59 | 27.29 | 25.9 | 47.06 |
 
12
 
13
  | model | avg | arc | hellaswag | mmlu | truthfulqa |
14
  | --- | --- | --- | --- | --- | --- |
15
+ | cramp-25m | 30.57 | 21.76 | 27.35 | 25.53 | 47.66 |
16
  | gpt2 (125m) | 30.06 | 22.1 | 31.6 | 25.86 | 40.67 |
17
  | pythia 70m deduped | 30.25 | 21.08 | 27.17 | 25.26 | 47.51 |
18
  | pythia 70m | 30.46 | 21.59 | 27.29 | 25.9 | 47.06 |