Text Generation
Transformers
PyTorch
Safetensors
English
llama
text-generation-inference
Inference Endpoints
lilloukas commited on
Commit
f378a4f
1 Parent(s): eacb2b2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -16,11 +16,11 @@ Platypus-70B is an instruction fine-tuned model based on the LLaMa2-70B transfor
16
 
17
  | Metric | Value |
18
  |-----------------------|-------|
19
- | MMLU (5-shot) | -- |
20
- | ARC (25-shot) | -- |
21
- | HellaSwag (10-shot) | -- |
22
- | TruthfulQA (0-shot) | -- |
23
- | Avg. | -- |
24
 
25
  We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as the HuggingFace LLM Leaderboard. Please see below for detailed instructions on reproducing benchmark results.
26
 
 
16
 
17
  | Metric | Value |
18
  |-----------------------|-------|
19
+ | MMLU (5-shot) | 70.48 |
20
+ | ARC (25-shot) | 71.84 |
21
+ | HellaSwag (10-shot) | 87.94 |
22
+ | TruthfulQA (0-shot) | 62.26 |
23
+ | Avg. | 73.13 |
24
 
25
  We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as the HuggingFace LLM Leaderboard. Please see below for detailed instructions on reproducing benchmark results.
26