metadata
library_name: transformers
license: apache-2.0
base_model:
- Qwen/Qwen2.5-14B-Instruct
Qwen2.5-Gutenberg-Doppel-14B
Qwen/Qwen2.5-14B-Instruct finetuned on jondurbin/gutenberg-dpo-v0.1 and nbeerbower/gutenberg2-dpo.
Method
ORPO tuned with 4x A40 for 3 epochs.
Thank you @ParasiticRogue for sponsoring.