Hugging Face's logo

eren23
/
DPOMixLLama-3-8B-lora

Text Generation
PEFT
Safetensors
English
llama
orpo
llama3
text-generation-inference
conversational
Model card Files Community
Edit model card

A finetuning experiment on llama3 8b it with selected 5k examples from argilla dpo 7k

Downloads last month
1
Inference API
Text Generation
Examples
Input a message to start chatting with eren23/DPOMixLLama-3-8B-lora.
This model can be loaded on Inference API (serverless).

Adapter for

Dataset used to train eren23/DPOMixLLama-3-8B-lora