---
library_name: transformers
license: cc-by-sa-4.0
datasets:
- mlabonne/chatml_dpo_pairs
- ResplendentAI/Synthetic_Soul_1k
language:
- en
---

# Flora DPO

![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/626dfb8786671a29c715f8a9/vwj8qDwMChPo05DcGDg0O.jpeg)

Finetuned with this DPO dataset: https://huggingface.co/datasets/mlabonne/chatml_dpo_pairs

Quants available here:

https://huggingface.co/solidrust/Flora-7B-DPO-AWQ

https://huggingface.co/Test157t/ResplendentAI-Flora_DPO_7B-5bpw-exl2