Update README.md
Browse files
README.md
CHANGED
@@ -40,10 +40,10 @@ These are zero-shot evaluations performed on current state-of-the-art language m
|
|
40 |
|
41 |
| Model | MMLU | ARC-C | HellaSwag | PIQA | Winogrande | Average |
|
42 |
|--------------------------------|-------|-------|-----------|--------|------------|---------|
|
43 |
-
| smollm-360m | 0.2537
|
44 |
| tinyllama | 0.2577| 0.3029| 0.5935 | 0.7329 | 0.5959 | 0.4966 |
|
45 |
| qwen2-0.5b |**0.4413**| 0.2892| 0.4905 | 0.6931 | 0.5699 | 0.4968 |
|
46 |
-
| danube3-500m-chat (current sota)| 0.2554
|
47 |
| palmer-004-turbo |0.2736|0.3558|**0.6179**|0.7367 | 0.6117 |**0.5191**|
|
48 |
| palmer-004 | 0.2661| 0.3490| 0.6173 |**0.7481**|**0.6417** |**0.5244**|
|
49 |
|
|
|
40 |
|
41 |
| Model | MMLU | ARC-C | HellaSwag | PIQA | Winogrande | Average |
|
42 |
|--------------------------------|-------|-------|-----------|--------|------------|---------|
|
43 |
+
| smollm-360m | 0.2537|**0.3626**| 0.5350 | 0.7116 | 0.5659 | 0.4858 |
|
44 |
| tinyllama | 0.2577| 0.3029| 0.5935 | 0.7329 | 0.5959 | 0.4966 |
|
45 |
| qwen2-0.5b |**0.4413**| 0.2892| 0.4905 | 0.6931 | 0.5699 | 0.4968 |
|
46 |
+
| danube3-500m-chat (current sota)| 0.2554|**0.3626**|0.6072 | 0.7432 | 0.6140 | 0.5164 |
|
47 |
| palmer-004-turbo |0.2736|0.3558|**0.6179**|0.7367 | 0.6117 |**0.5191**|
|
48 |
| palmer-004 | 0.2661| 0.3490| 0.6173 |**0.7481**|**0.6417** |**0.5244**|
|
49 |
|