MaziyarPanahi commited on
Commit
ff4b5db
1 Parent(s): 7d2a0a6

Update README.md (#8)

Browse files

- Update README.md (eee178f75a46a908406a3f24fe43cd1e06aafeff)

Files changed (1) hide show
  1. README.md +11 -15
README.md CHANGED
@@ -131,10 +131,18 @@ This is a fine-tuned version of the `Qwen/Qwen2-7B` model. It aims to improve th
131
 
132
  All GGUF models are available here: [MaziyarPanahi/calme-2.7-qwen2-7b-GGUF](https://huggingface.co/MaziyarPanahi/calme-2.7-qwen2-7b-GGUF)
133
 
134
- # 🏆 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
135
-
136
- coming soon!
137
 
 
 
 
 
 
 
 
 
 
138
 
139
  # Prompt Template
140
 
@@ -174,16 +182,4 @@ from transformers import AutoTokenizer, AutoModelForCausalLM
174
  tokenizer = AutoTokenizer.from_pretrained("MaziyarPanahi/calme-2.7-qwen2-7b")
175
  model = AutoModelForCausalLM.from_pretrained("MaziyarPanahi/calme-2.7-qwen2-7b")
176
  ```
177
- # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
178
- Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_MaziyarPanahi__calme-2.7-qwen2-7b)
179
-
180
- | Metric |Value|
181
- |-------------------|----:|
182
- |Avg. |22.07|
183
- |IFEval (0-Shot) |35.92|
184
- |BBH (3-Shot) |28.91|
185
- |MATH Lvl 5 (4-Shot)|12.08|
186
- |GPQA (0-shot) | 5.48|
187
- |MuSR (0-shot) |19.94|
188
- |MMLU-PRO (5-shot) |30.06|
189
 
 
131
 
132
  All GGUF models are available here: [MaziyarPanahi/calme-2.7-qwen2-7b-GGUF](https://huggingface.co/MaziyarPanahi/calme-2.7-qwen2-7b-GGUF)
133
 
134
+ # 🏆 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
135
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_MaziyarPanahi__calme-2.7-qwen2-7b)
 
136
 
137
+ | Metric |Value|
138
+ |-------------------|----:|
139
+ |Avg. |22.07|
140
+ |IFEval (0-Shot) |35.92|
141
+ |BBH (3-Shot) |28.91|
142
+ |MATH Lvl 5 (4-Shot)|12.08|
143
+ |GPQA (0-shot) | 5.48|
144
+ |MuSR (0-shot) |19.94|
145
+ |MMLU-PRO (5-shot) |30.06|
146
 
147
  # Prompt Template
148
 
 
182
  tokenizer = AutoTokenizer.from_pretrained("MaziyarPanahi/calme-2.7-qwen2-7b")
183
  model = AutoModelForCausalLM.from_pretrained("MaziyarPanahi/calme-2.7-qwen2-7b")
184
  ```
 
 
 
 
 
 
 
 
 
 
 
 
185