Released models trained by Selective DPO.
-
glorgao/SelectiveDPO-Gemma2-9B-SFT-UFBinarized
Text Generation • Updated • 45 -
glorgao/SelectiveDPO-Llama3-8B-SFT-UFBinarized
Text Generation • Updated • 54 • 1 -
glorgao/SelectiveDPO-Qwen2.5-7B-SFT-UFBinarized
Text Generation • Updated • 39 • 1 -
glorgao/SelectiveDPO-Mistral-7B-SFT-UFBinarized
Text Generation • Updated • 19