This model finetunes model cloudyu/Mixtral_7Bx2_MoE on the jondurbin/truthy-dpo-v0.1 dataset for 1 epoch
cloudyu/Mixtral_7Bx2_MoE
jondurbin/truthy-dpo-v0.1