metadata
license: other
datasets:
- mlabonne/orpo-dpo-mix-40k
tags:
- dpo
Exllamav2 quant (exl2 / 3.75 bpw) made with ExLlamaV2 v0.1.1
Other EXL2 quants:
Quant | Model Size | lm_head |
---|---|---|
NeuralDaredevil-8B-abliterated
This is a DPO fine-tune of mlabonne/Daredevil-8-abliterated trained on one epoch of mlabonne/orpo-dpo-mix-40k.
π Evaluation
Open LLM Leaderboard
TBD.
Nous
Evaluation performed using LLM AutoEval. See the entire leaderboard here.
Model | Average | AGIEval | GPT4All | TruthfulQA | Bigbench |
---|---|---|---|---|---|
mlabonne/NeuralDaredevil-8B-abliterated π | 55.87 | 43.73 | 73.6 | 59.36 | 46.8 |
mlabonne/Daredevil-8B π | 55.87 | 44.13 | 73.52 | 59.05 | 46.77 |
mlabonne/Daredevil-8B-abliterated π | 55.06 | 43.29 | 73.33 | 57.47 | 46.17 |
NousResearch/Hermes-2-Theta-Llama-3-8B π | 54.28 | 43.9 | 72.62 | 56.36 | 44.23 |
openchat/openchat-3.6-8b-20240522 π | 53.49 | 44.03 | 73.67 | 49.78 | 46.48 |
meta-llama/Meta-Llama-3-8B-Instruct π | 51.34 | 41.22 | 69.86 | 51.65 | 42.64 |
meta-llama/Meta-Llama-3-8B π | 45.42 | 31.1 | 69.95 | 43.91 | 36.7 |