metadata
license: apache-2.0
library_name: transformers
base_model:
- nbeerbower/mistral-nemo-bophades-12B
datasets:
- jondurbin/gutenberg-dpo-v0.1
mistral-nemo-gutades-12B
nbeerbower/mistral-nemo-bophades-12B finetuned on jondurbin/gutenberg-dpo-v0.1.
Method
ORPO finetuned using an RTX 3090 for 3 epochs.