leaderboard-pr-bot
commited on
Commit
•
6893d14
1
Parent(s):
3bdf6f8
Adding Evaluation Results
Browse filesThis is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr
The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.
If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions
README.md
CHANGED
@@ -173,3 +173,17 @@ Please read this disclaimer carefully before using the large language model prov
|
|
173 |
- Changes to this Disclaimer: The developers of this repository reserve the right to modify or update this disclaimer at any time without prior notice. It is the user's responsibility to periodically review the disclaimer to stay informed about any changes.
|
174 |
|
175 |
By using the large language model provided in this repository, you agree to accept and comply with the terms and conditions outlined in this disclaimer. If you do not agree with any part of this disclaimer, you should refrain from using the model and any content generated by it.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
173 |
- Changes to this Disclaimer: The developers of this repository reserve the right to modify or update this disclaimer at any time without prior notice. It is the user's responsibility to periodically review the disclaimer to stay informed about any changes.
|
174 |
|
175 |
By using the large language model provided in this repository, you agree to accept and comply with the terms and conditions outlined in this disclaimer. If you do not agree with any part of this disclaimer, you should refrain from using the model and any content generated by it.
|
176 |
+
|
177 |
+
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
178 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_h2oai__h2ogpt-oasst1-512-20b)
|
179 |
+
|
180 |
+
| Metric | Value |
|
181 |
+
|-----------------------|---------------------------|
|
182 |
+
| Avg. | 37.12 |
|
183 |
+
| ARC (25-shot) | 46.93 |
|
184 |
+
| HellaSwag (10-shot) | 72.77 |
|
185 |
+
| MMLU (5-shot) | 26.25 |
|
186 |
+
| TruthfulQA (0-shot) | 37.5 |
|
187 |
+
| Winogrande (5-shot) | 68.03 |
|
188 |
+
| GSM8K (5-shot) | 3.18 |
|
189 |
+
| DROP (3-shot) | 5.18 |
|