File size: 362 Bytes
feaf948 cdfa5b3 feaf948 9311a43 feaf948 1589b42 feaf948 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 |
---
license: apache-2.0
language:
- fr
- it
- de
- es
- en
tag:
- moe
- DPO
---
# Model Card for cloudyu/Mixtral-8x7B-Instruct-v0.1-DPO
* [DPO training try to improve mistralai/Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1)
* [DPO Trainer](https://huggingface.co/docs/trl/main/en/dpo_trainer)
* metrics not test
|