Hugging Face's logo

upstage
/
Llama-2-70b-instruct

Text Generation
Transformers
PyTorch
English
llama
upstage
llama-2
instruct
instruction
text-generation-inference
Inference Endpoints
Model card Files Community
9
wonhosong commited on
Commit
eaa4087
•
1 Parent(s): 1e67bf4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -81,10 +81,10 @@ We used the [lm-evaluation-harness repository](https://github.com/EleutherAI/lm-
81
  ### Main Results
82
  | Model | H4(Avg) | ARC | HellaSwag | MMLU | TruthfulQA | | MT_Bench |
83
  |--------------------------------------------------------------------|----------|----------|----------|------|----------|-|-------------|
84
- | **[Llama-2-70b-instruct-v2](https://huggingface.co/upstage/Llama-2-70b-instruct-v2)**(Ours, Local Reproduction) | **72.7** | **71.6** | **87.7** | 69.7 | **61.6** | | **7.44063** |
85
- | [Llama-2-70b-instruct](https://huggingface.co/upstage/Llama-2-70b-instruct) (***Ours***, ***Open LLM Leaderboard***) | 72.3 | 70.9 | 87.5 | **69.8** | 61 | | 7.24375 |
86
  | [llama-65b-instruct](https://huggingface.co/upstage/llama-65b-instruct) (Ours, Open LLM Leaderboard) | 69.4 | 67.6 | 86.5 | 64.9 | 58.8 | | |
87
- | Llama-2-70b-hf | 67.3 | 67.3 | 87.3 | **69.8** | 44.9 | | |
88
  | [llama-30b-instruct-2048](https://huggingface.co/upstage/llama-30b-instruct-2048) (Ours, Open LLM Leaderboard) | 67.0 | 64.9 | 84.9 | 61.9 | 56.3 | | |
89
  | [llama-30b-instruct](https://huggingface.co/upstage/llama-30b-instruct) (Ours, Open LLM Leaderboard) | 65.2 | 62.5 | 86.2 | 59.4 | 52.8 | | |
90
  | llama-65b | 64.2 | 63.5 | 86.1 | 63.9 | 43.4 | | |
 
81
  ### Main Results
82
  | Model | H4(Avg) | ARC | HellaSwag | MMLU | TruthfulQA | | MT_Bench |
83
  |--------------------------------------------------------------------|----------|----------|----------|------|----------|-|-------------|
84
+ | **[Llama-2-70b-instruct-v2](https://huggingface.co/upstage/Llama-2-70b-instruct-v2)**(Ours, Open LLM Leaderboard) | **73** | **71.1** | **87.9** | **70.6** | **62.2** | | **7.44063** |
85
+ | [Llama-2-70b-instruct](https://huggingface.co/upstage/Llama-2-70b-instruct) (***Ours***, ***Open LLM Leaderboard***) | 72.3 | 70.9 | 87.5 | 69.8 | 61 | | 7.24375 |
86
  | [llama-65b-instruct](https://huggingface.co/upstage/llama-65b-instruct) (Ours, Open LLM Leaderboard) | 69.4 | 67.6 | 86.5 | 64.9 | 58.8 | | |
87
+ | Llama-2-70b-hf | 67.3 | 67.3 | 87.3 | 69.8 | 44.9 | | |
88
  | [llama-30b-instruct-2048](https://huggingface.co/upstage/llama-30b-instruct-2048) (Ours, Open LLM Leaderboard) | 67.0 | 64.9 | 84.9 | 61.9 | 56.3 | | |
89
  | [llama-30b-instruct](https://huggingface.co/upstage/llama-30b-instruct) (Ours, Open LLM Leaderboard) | 65.2 | 62.5 | 86.2 | 59.4 | 52.8 | | |
90
  | llama-65b | 64.2 | 63.5 | 86.1 | 63.9 | 43.4 | | |