appvoid commited on
Commit
9a7a256
·
verified ·
1 Parent(s): d1fa68b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -9,6 +9,8 @@ tags:
9
 
10
  This is a passthrough of arco with an experimental model. As you can see, it dramatically improved on arc challenge, only missing 1.2 points to get to the level of modern 3b baseline performance.
11
 
 
 
12
  | Parameters | Model | MMLU | ARC-C | HellaSwag | PIQA | Winogrande | Average |
13
  | -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
14
  | 0.5b | qwen2 |44.13| 28.92| 49.05 | 69.31 | 56.99 | 49.68 |
 
9
 
10
  This is a passthrough of arco with an experimental model. As you can see, it dramatically improved on arc challenge, only missing 1.2 points to get to the level of modern 3b baseline performance.
11
 
12
+ If you prefer multilingual, general knowledge over simple reasoning questions, chose qwen, if you prefer solving simple english tasks, chose arco.
13
+
14
  | Parameters | Model | MMLU | ARC-C | HellaSwag | PIQA | Winogrande | Average |
15
  | -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
16
  | 0.5b | qwen2 |44.13| 28.92| 49.05 | 69.31 | 56.99 | 49.68 |