abhinand leaderboard-pr-bot commited on
Commit
663842a
1 Parent(s): 1dce7b0

Adding Evaluation Results (#2)

Browse files

- Adding Evaluation Results (facdadc2acf25da5fb7583a76fab791094eacb24)


Co-authored-by: Open LLM Leaderboard PR Bot <leaderboard-pr-bot@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +18 -5
README.md CHANGED
@@ -1,12 +1,12 @@
1
  ---
 
 
 
 
2
  base_model: abhinand/dr-llama-te-instruct-v0
3
  model-index:
4
  - name: telugu-llama-instruct-v0.1
5
  results: []
6
- license: llama2
7
- language:
8
- - en
9
- - te
10
  ---
11
 
12
  # Telugu LLaMA 7B Instruct v0.1
@@ -171,4 +171,17 @@ If you use this model or any of the the Tamil-Llama related work in your researc
171
  }
172
  ```
173
 
174
- We hope this model serves as a valuable tool in your NLP toolkit and look forward to seeing the advancements it will enable in the understanding and generation of the Tamil language.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ - te
5
+ license: llama2
6
  base_model: abhinand/dr-llama-te-instruct-v0
7
  model-index:
8
  - name: telugu-llama-instruct-v0.1
9
  results: []
 
 
 
 
10
  ---
11
 
12
  # Telugu LLaMA 7B Instruct v0.1
 
171
  }
172
  ```
173
 
174
+ We hope this model serves as a valuable tool in your NLP toolkit and look forward to seeing the advancements it will enable in the understanding and generation of the Tamil language.
175
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
176
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_abhinand__telugu-llama-7b-instruct-v0.1)
177
+
178
+ | Metric |Value|
179
+ |---------------------------------|----:|
180
+ |Avg. |39.77|
181
+ |AI2 Reasoning Challenge (25-Shot)|37.12|
182
+ |HellaSwag (10-Shot) |67.92|
183
+ |MMLU (5-Shot) |23.12|
184
+ |TruthfulQA (0-shot) |49.05|
185
+ |Winogrande (5-shot) |61.40|
186
+ |GSM8k (5-shot) | 0.00|
187
+