appvoid commited on
Commit
fbb3443
·
verified ·
1 Parent(s): 0c30117

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -40,10 +40,10 @@ These are zero-shot evaluations performed on current state-of-the-art language m
40
 
41
  | Model | MMLU | ARC-C | HellaSwag | PIQA | Winogrande | Average |
42
  |--------------------------------|-------|-------|-----------|--------|------------|---------|
43
- | smollm-360m | 0.2537|0.3626| 0.5350 | 0.7116 | 0.5659 | 0.4858 |
44
  | tinyllama | 0.2577| 0.3029| 0.5935 | 0.7329 | 0.5959 | 0.4966 |
45
  | qwen2-0.5b |**0.4413**| 0.2892| 0.4905 | 0.6931 | 0.5699 | 0.4968 |
46
- | danube3-500m-chat (current sota)| 0.2554|0.3626|0.6072 | 0.7432 | 0.6140 | 0.5164 |
47
  | palmer-004-turbo |0.2736|0.3558|**0.6179**|0.7367 | 0.6117 |**0.5191**|
48
  | palmer-004 | 0.2661| 0.3490| 0.6173 |**0.7481**|**0.6417** |**0.5244**|
49
 
 
40
 
41
  | Model | MMLU | ARC-C | HellaSwag | PIQA | Winogrande | Average |
42
  |--------------------------------|-------|-------|-----------|--------|------------|---------|
43
+ | smollm-360m | 0.2537|**0.3626**| 0.5350 | 0.7116 | 0.5659 | 0.4858 |
44
  | tinyllama | 0.2577| 0.3029| 0.5935 | 0.7329 | 0.5959 | 0.4966 |
45
  | qwen2-0.5b |**0.4413**| 0.2892| 0.4905 | 0.6931 | 0.5699 | 0.4968 |
46
+ | danube3-500m-chat (current sota)| 0.2554|**0.3626**|0.6072 | 0.7432 | 0.6140 | 0.5164 |
47
  | palmer-004-turbo |0.2736|0.3558|**0.6179**|0.7367 | 0.6117 |**0.5191**|
48
  | palmer-004 | 0.2661| 0.3490| 0.6173 |**0.7481**|**0.6417** |**0.5244**|
49