Efficient Exact Optimization
Collection
SFT & Reward Models used in the experiments of the ICML 2024 paper "Towards Efficient Exact Optimization of Language Model Alignment"
•
2 items
•
Updated
Towards Efficient Exact Optimization of Language Model Alignment
model: exo-imdb-sft-model
- Finetuned from model: gpt2-large
dataset: imdb (original stanford version)
SFT model used in the imdb experiment of the ICML'24 paper Towards Efficient Exact Optimization of Language Model Alignment.
For details of the dataset, training and inference of this model, please refer to https://github.com/haozheji/exact-optimization/blob/main/exp/imdb_exp/README.md
- Downloads last month
- 219
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.