leaderboard-pr-bot commited on
Commit
73f0750
1 Parent(s): 9425949

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +18 -5
README.md CHANGED
@@ -1,12 +1,12 @@
1
  ---
 
 
 
 
2
  base_model: abhinand/dr-llama-ta-instruct-v0
3
  model-index:
4
  - name: tamil-llama-instruct-v0.2
5
  results: []
6
- license: llama2
7
- language:
8
- - en
9
- - ta
10
  ---
11
 
12
  # Tamil LLaMA 7B Instruct v0.2
@@ -171,4 +171,17 @@ If you use this model or any of the the Tamil-Llama related work in your researc
171
  }
172
  ```
173
 
174
- We hope this model serves as a valuable tool in your NLP toolkit and look forward to seeing the advancements it will enable in the understanding and generation of the Tamil language.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ - ta
5
+ license: llama2
6
  base_model: abhinand/dr-llama-ta-instruct-v0
7
  model-index:
8
  - name: tamil-llama-instruct-v0.2
9
  results: []
 
 
 
 
10
  ---
11
 
12
  # Tamil LLaMA 7B Instruct v0.2
 
171
  }
172
  ```
173
 
174
+ We hope this model serves as a valuable tool in your NLP toolkit and look forward to seeing the advancements it will enable in the understanding and generation of the Tamil language.
175
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
176
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_abhinand__tamil-llama-7b-instruct-v0.2)
177
+
178
+ | Metric |Value|
179
+ |---------------------------------|----:|
180
+ |Avg. |42.41|
181
+ |AI2 Reasoning Challenge (25-Shot)|40.19|
182
+ |HellaSwag (10-Shot) |68.83|
183
+ |MMLU (5-Shot) |23.12|
184
+ |TruthfulQA (0-shot) |50.04|
185
+ |Winogrande (5-shot) |66.77|
186
+ |GSM8k (5-shot) | 5.53|
187
+