|
--- |
|
license: llama3 |
|
--- |
|
[Llama 3 8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) finetuned on [mlabonne/orpo-dpo-mix-40k](https://huggingface.co/datasets/mlabonne/orpo-dpo-mix-40k) with [ORPO](https://arxiv.org/abs/2403.07691).\ |
|
Max length was reduced to 1024 tokens. LoRA (r=16) and 4bit quantization was used to increase memory efficiency. |
|
|
|
| **Benchmark** | **LLaMa 3 8B** | **LLaMa 3 8B Inst** | **LLaMa 3 8B ORPO V1** | **LLaMa 3 8B ORPO V2 (WIP)** | |
|
|--------------------|:-----------------:|:----------------:|:---------------:|----------------| |
|
| **MMLU** | 62.12 | 63.92 | 61.87 | | |
|
| **BoolQ** | 81.04 | 83.21 | 82.42 | | |
|
| **Winogrande** | 73.24 | 72.06 | 74.43 | | |
|
| **ARC-Challenge** | 53.24 | 56.91 | 52.90 | | |
|
| **TriviaQA** | 63.33 | 51.09 | 63.93 | | |
|
| **GSM-8K (flexible)** | 50.27 | 75.13 | 52.16 | | |
|
| **SQuAD V2 (f1)** | 32.48 | 29.68 | 33.68 | | |
|
| **LogiQA** | 29.23 | 32.87 | 30.26 | | |
|
All scores obtained with [lm-evaluation-harness v0.4.2](https://github.com/EleutherAI/lm-evaluation-harness) |
|
|
|
|
|
|
