Commit
·
59bd151
1
Parent(s):
2e83960
Adding Evaluation Results (#3)
Browse files- Adding Evaluation Results (f046338f32cd50c1a3da6d604e2a1d3f99156de7)
Co-authored-by: Open LLM Leaderboard PR Bot <leaderboard-pr-bot@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -9,4 +9,17 @@ tags:
|
|
| 9 |
- not-for-all-audiences
|
| 10 |
---
|
| 11 |
# LLaMA 2 Jannie 70B QLoRA
|
| 12 |
-
Fine tuned on moxxie proxy log.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
- not-for-all-audiences
|
| 10 |
---
|
| 11 |
# LLaMA 2 Jannie 70B QLoRA
|
| 12 |
+
Fine tuned on moxxie proxy log.
|
| 13 |
+
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
| 14 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_v2ray__LLaMA-2-Jannie-70B-QLoRA)
|
| 15 |
+
|
| 16 |
+
| Metric | Value |
|
| 17 |
+
|-----------------------|---------------------------|
|
| 18 |
+
| Avg. | 64.76 |
|
| 19 |
+
| ARC (25-shot) | 68.94 |
|
| 20 |
+
| HellaSwag (10-shot) | 86.9 |
|
| 21 |
+
| MMLU (5-shot) | 69.37 |
|
| 22 |
+
| TruthfulQA (0-shot) | 53.67 |
|
| 23 |
+
| Winogrande (5-shot) | 82.95 |
|
| 24 |
+
| GSM8K (5-shot) | 31.77 |
|
| 25 |
+
| DROP (3-shot) | 59.75 |
|