Hugging Face's logo

Zoyd
/
mlabonne_NeuralDaredevil-8B-abliterated-6_5bpw_exl2

Text Generation
Transformers
Safetensors
llama
dpo
text-generation-inference
Inference Endpoints
exl2
Model card Files Community
mlabonne_NeuralDaredevil-8B-abliterated-6_5bpw_exl2 / README.md
Zoyd's picture
Zoyd
Upload folder using huggingface_hub
37a3de8 verified
preview code
|
raw
history blame contribute delete
4.37 kB
metadata
license: other
datasets:
  - mlabonne/orpo-dpo-mix-40k
tags:
  - dpo

Exllamav2 quant (exl2 / 6.5 bpw) made with ExLlamaV2 v0.1.1

Other EXL2 quants:

Quant Model Size lm_head
2.2
3250 MB
6
2.5
3479 MB
6
3.0
3895 MB
6
3.5
4310 MB
6
3.75
4519 MB
6
4.0
4727 MB
6
4.25
4931 MB
6
5.0
5559 MB
6
6.0
6495 MB
8
6.5
6903 MB
8
8.0
8157 MB
8

NeuralDaredevil-8B-abliterated

image/jpeg

This is a DPO fine-tune of mlabonne/Daredevil-8-abliterated trained on one epoch of mlabonne/orpo-dpo-mix-40k.

🏆 Evaluation

Open LLM Leaderboard

TBD.

Nous

Evaluation performed using LLM AutoEval. See the entire leaderboard here.

Model Average AGIEval GPT4All TruthfulQA Bigbench
mlabonne/NeuralDaredevil-8B-abliterated 📄 55.87 43.73 73.6 59.36 46.8
mlabonne/Daredevil-8B 📄 55.87 44.13 73.52 59.05 46.77
mlabonne/Daredevil-8B-abliterated 📄 55.06 43.29 73.33 57.47 46.17
NousResearch/Hermes-2-Theta-Llama-3-8B 📄 54.28 43.9 72.62 56.36 44.23
openchat/openchat-3.6-8b-20240522 📄 53.49 44.03 73.67 49.78 46.48
meta-llama/Meta-Llama-3-8B-Instruct 📄 51.34 41.22 69.86 51.65 42.64
meta-llama/Meta-Llama-3-8B 📄 45.42 31.1 69.95 43.91 36.7

🌳 Model family tree

image/png