File size: 286 Bytes
5331cfb 9fa099e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
---
license: apache-2.0
---
Finetune DPO viethq188/LeoScorpius-7B with ultrafeedback_binarized dataset https://huggingface.co/datasets/HuggingFaceH4/ultrafeedback_binarized
You can use alpaca template.
```
template_format = """{system}
### Instruction:
{prompt}
### Response:
"""
``` |