File size: 924 Bytes
36d527d 7d1b7da 36d527d 7d1b7da 36d527d 7d1b7da 36d527d b690bb4 7d1b7da 36d527d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |
---
library_name: transformers
tags: []
---
# Mistral 7b Self-Alignment DPO Model
The Mistral 7b Self-Alignment DPO Model is an adapter fine-tuned for self-alignment and harmlessness using the Direct Preference Optimization (DPO) technique. It has been trained utilizing the Mistral Self-Alignment Preference Dataset, accessible [here](https://huggingface.co/datasets/August4293/Preference-Dataset).
Detailed information about the DPO fine-tuning process and its application for self-alignment can be found on the corresponding [GitHub page](https://github.com/August-murr/Lab/tree/main/Mistral%20Self%20Alignment).
## Model Details:
- **Base Model:** Mistral 7b
- **Fine-Tuning Purpose:** Self-Alignment and Harmlessness
- **Fine-Tuning Method:** Direct Preference Optimization (DPO)
- **Fine-Tuning Dataset:** [Mistral Self-Alignment Preference Dataset](https://huggingface.co/datasets/August4293/Preference-Dataset)
|