metadata
license: apache-2.0
Towards Efficient Exact Optimization of Language Model Alignment
model: exo-imdb-sft-model
- Finetuned from model: pythia-2.8b
dataset: imdb (original stanford version)
SFT model used in the imdb experiment of the ICML'24 paper Towards Efficient Exact Optimization of Language Model Alignment.
For details of the dataset, training and inference of this model, please refer to https://github.com/haozheji/exact-optimization/blob/main/exp/imdb_exp/README.md