upstage
/

llama-30b-instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

wonhosong commited on Jul 19, 2023

Commit

63524b6

·

1 Parent(s): fcf155c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -76,7 +76,7 @@ cd lm-evaluation-harness
 | Model                                         | Average | ARC   | HellaSwag | MMLU  | TruthfulQA |
 |-----------------------------------------------|---------|-------|-----------|-------|------------|
 | llama-65b-instruct (***Ours***, ***Local Reproduction***) | **69.4** | **67.6** | **86.5** | **64.9** | **58.8** |
-| llama-30b-instruct-2048 (***Ours***, ***Open LLM Leaderboard***) | 64.7 | 58.3 | 82.5 | 61.4 | 56.5 |
 | falcon-40b-instruct | 63.4 | 61.6 | 84.3 | 55.4 | 52.5 |
 | llama-30b-instruct (***Ours***, ***Open LLM Leaderboard***) | 63.2 | 56.7 | 84.0 | 59.0 | 53.1 |
 | llama-65b | 62.1 | 57.6 | 84.3 | 63.4 | 43.0 |

 | Model                                         | Average | ARC   | HellaSwag | MMLU  | TruthfulQA |
 |-----------------------------------------------|---------|-------|-----------|-------|------------|
 | llama-65b-instruct (***Ours***, ***Local Reproduction***) | **69.4** | **67.6** | **86.5** | **64.9** | **58.8** |
+| llama-30b-instruct-2048 (***Ours***, ***Open LLM Leaderboard***) | 67.0 | 64.9 | 84.9 | 61.9 | 56.3 |
 | falcon-40b-instruct | 63.4 | 61.6 | 84.3 | 55.4 | 52.5 |
 | llama-30b-instruct (***Ours***, ***Open LLM Leaderboard***) | 63.2 | 56.7 | 84.0 | 59.0 | 53.1 |
 | llama-65b | 62.1 | 57.6 | 84.3 | 63.4 | 43.0 |