Update README.md
Browse files
README.md
CHANGED
@@ -35,6 +35,16 @@ We continual pretrain on the expanded vocabulary [homebrewltd/llama3.1-s-whisper
|
|
35 |
|
36 |

|
37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
38 |
### Hardware
|
39 |
|
40 |
**GPU Configuration**: Cluster of 10x NVIDIA A6000-48GB.
|
|
|
35 |
|
36 |

|
37 |
|
38 |
+
**MMLU**:
|
39 |
+
|
40 |
+
| Model | MMLU Score |
|
41 |
+
| --- | --- |
|
42 |
+
| llama3.5-instruct-8b | 69.40 |
|
43 |
+
| ichigo-llama3.1-s-v0.3: phase 3 | 63.79 |
|
44 |
+
| ichigo-llama3.1-s-v0.3: phase 2 | 63.08 |
|
45 |
+
| ichigo-llama3.1-s-base-v0.3 | **42.11** |
|
46 |
+
| llama3.5-instruct-v0.2 | 50.27 |
|
47 |
+
|
48 |
### Hardware
|
49 |
|
50 |
**GPU Configuration**: Cluster of 10x NVIDIA A6000-48GB.
|