Update README.md
Browse files
README.md
CHANGED
@@ -12,7 +12,7 @@ A modified GPT-2 model with only 25 million non-embedding params that outbenches
|
|
12 |
|
13 |
| model | avg | arc | hellaswag | mmlu | truthfulqa |
|
14 |
| --- | --- | --- | --- | --- | --- |
|
15 |
-
| cramp-
|
16 |
| gpt2 (125m) | 30.06 | 22.1 | 31.6 | 25.86 | 40.67 |
|
17 |
| pythia 70m deduped | 30.25 | 21.08 | 27.17 | 25.26 | 47.51 |
|
18 |
| pythia 70m | 30.46 | 21.59 | 27.29 | 25.9 | 47.06 |
|
|
|
12 |
|
13 |
| model | avg | arc | hellaswag | mmlu | truthfulqa |
|
14 |
| --- | --- | --- | --- | --- | --- |
|
15 |
+
| cramp-25m | 30.57 | 21.76 | 27.35 | 25.53 | 47.66 |
|
16 |
| gpt2 (125m) | 30.06 | 22.1 | 31.6 | 25.86 | 40.67 |
|
17 |
| pythia 70m deduped | 30.25 | 21.08 | 27.17 | 25.26 | 47.51 |
|
18 |
| pythia 70m | 30.46 | 21.59 | 27.29 | 25.9 | 47.06 |
|