metadata
license: apache-2.0
etri-xainlp/llama2-12.8b_lora-dpo_v1
Model Details
Model Developers ETRI xainlp team
Input text only.
Output text only.
Model Architecture
Base Model meta-llama/Llama-13b-hf
Training Dataset
sft+lora: 710k instruction-following set
dpo+lora: 90k user preference set
We use A100 GPU 80GB * 8, when training.