For both SFT and DPO
![skymizer's profile picture](https://cdn-avatars.huggingface.co/v1/production/uploads/651a3cb9f7724d9aee97a77c/zdj6l6wAAMgwCFdPnBcPp.png)
skymizer
company
AI & ML interests
None defined yet.
models
5
![](https://cdn-avatars.huggingface.co/v1/production/uploads/651a3cb9f7724d9aee97a77c/zdj6l6wAAMgwCFdPnBcPp.png)
skymizer/Llama2-7b-sft-chat-custom-template-dpo
Text Generation
•
Updated
•
45
![](https://cdn-avatars.huggingface.co/v1/production/uploads/651a3cb9f7724d9aee97a77c/zdj6l6wAAMgwCFdPnBcPp.png)
skymizer/llama2-7b-sft-chat-no-template-dpo
Text Generation
•
Updated
•
18
![](https://cdn-avatars.huggingface.co/v1/production/uploads/651a3cb9f7724d9aee97a77c/zdj6l6wAAMgwCFdPnBcPp.png)
skymizer/llama2-7b-sft-chat-no-template
Text Generation
•
Updated
•
151
![](https://cdn-avatars.huggingface.co/v1/production/uploads/651a3cb9f7724d9aee97a77c/zdj6l6wAAMgwCFdPnBcPp.png)
skymizer/llama2-7b-sft-full-dpo-bs128-1
Text Generation
•
Updated
•
8
![](https://cdn-avatars.huggingface.co/v1/production/uploads/651a3cb9f7724d9aee97a77c/zdj6l6wAAMgwCFdPnBcPp.png)
skymizer/llama2-7b-sft-full
Text Generation
•
Updated
•
50
datasets
None public yet