leaderboard-pr-bot commited on
Commit
2185358
1 Parent(s): ea5f088

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +15 -1
README.md CHANGED
@@ -1,8 +1,8 @@
1
  ---
2
  license: apache-2.0
3
- base_model: upstage/SOLAR-10.7B-v1.0
4
  tags:
5
  - generated_from_trainer
 
6
  model-index:
7
  - name: yanolja/EEVE-Korean-10.8B-v1.0
8
  results: []
@@ -101,3 +101,17 @@ This rigorous approach ensured a comprehensive and contextually rich Korean voca
101
  primaryClass={cs.CL}
102
  }
103
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
 
3
  tags:
4
  - generated_from_trainer
5
+ base_model: upstage/SOLAR-10.7B-v1.0
6
  model-index:
7
  - name: yanolja/EEVE-Korean-10.8B-v1.0
8
  results: []
 
101
  primaryClass={cs.CL}
102
  }
103
  ```
104
+
105
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
106
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_yanolja__KoSOLAR-10.7B-v0.3)
107
+
108
+ | Metric |Value|
109
+ |---------------------------------|----:|
110
+ |Avg. |64.76|
111
+ |AI2 Reasoning Challenge (25-Shot)|62.80|
112
+ |HellaSwag (10-Shot) |83.73|
113
+ |MMLU (5-Shot) |64.51|
114
+ |TruthfulQA (0-shot) |44.57|
115
+ |Winogrande (5-shot) |82.48|
116
+ |GSM8k (5-shot) |50.49|
117
+