Text Generation
Transformers
PyTorch
English
llama
Inference Endpoints
text-generation-inference

Adding Evaluation Results

#4
Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -103,3 +103,17 @@ USER: sally (a girl) has 3 brothers. Each brother has 2 sisters. how many sister
103
  ASSISTANT: Sally has 3 brothers, and each brother has 2 sisters. To find out how many sisters Sally has in total, we need to multiply the number of bro
104
  thers by the number of sisters per brother, then add 1 to account for Sally herself. So, 3 * 2 + 1 = 6 sisters in total
105
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
103
  ASSISTANT: Sally has 3 brothers, and each brother has 2 sisters. To find out how many sisters Sally has in total, we need to multiply the number of bro
104
  thers by the number of sisters per brother, then add 1 to account for Sally herself. So, 3 * 2 + 1 = 6 sisters in total
105
  ```
106
+
107
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
108
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_openaccess-ai-collective__hippogriff-30b-chat)
109
+
110
+ | Metric | Value |
111
+ |-----------------------|---------------------------|
112
+ | Avg. | 56.32 |
113
+ | ARC (25-shot) | 64.51 |
114
+ | HellaSwag (10-shot) | 85.2 |
115
+ | MMLU (5-shot) | 59.09 |
116
+ | TruthfulQA (0-shot) | 48.42 |
117
+ | Winogrande (5-shot) | 80.82 |
118
+ | GSM8K (5-shot) | 10.24 |
119
+ | DROP (3-shot) | 45.99 |