Hugging Face's logo

homebrewltd
/
Ichigo-llama3.1-s-base-v0.3

Audio-Text-to-Text
Safetensors
English
llama
sound language model
Model card Files Community
1
jan-hq commited on
Commit
1729c05
·
verified ·
1 Parent(s): f0c9e0a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -35,6 +35,16 @@ We continual pretrain on the expanded vocabulary [homebrewltd/llama3.1-s-whisper
35
 
36
  ![train_log](https://cdn-uploads.huggingface.co/production/uploads/65713d70f56f9538679e5a56/iAbaP7SCoyZ8tz2hyK8k0.png)
37
 
 
 
 
 
 
 
 
 
 
 
38
  ### Hardware
39
 
40
  **GPU Configuration**: Cluster of 10x NVIDIA A6000-48GB.
 
35
 
36
  ![train_log](https://cdn-uploads.huggingface.co/production/uploads/65713d70f56f9538679e5a56/iAbaP7SCoyZ8tz2hyK8k0.png)
37
 
38
+ **MMLU**:
39
+
40
+ | Model | MMLU Score |
41
+ | --- | --- |
42
+ | llama3.5-instruct-8b | 69.40 |
43
+ | ichigo-llama3.1-s-v0.3: phase 3 | 63.79 |
44
+ | ichigo-llama3.1-s-v0.3: phase 2 | 63.08 |
45
+ | ichigo-llama3.1-s-base-v0.3 | **42.11** |
46
+ | llama3.5-instruct-v0.2 | 50.27 |
47
+
48
  ### Hardware
49
 
50
  **GPU Configuration**: Cluster of 10x NVIDIA A6000-48GB.