A collection of chat models to explore the differences between three alignment techniques: DPO, IPO, and KTO.
AI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
This is the organization grouping all the models and datasets used in the TRL library.
Collections
2
models
81
trl-lib/Qwen2-0.5B-Reward-Math-Sheperd
Token Classification
•
Updated
•
8
trl-lib/Qwen2-0.5B-XPO
Text Generation
•
Updated
•
14
trl-lib/Qwen2-0.5B-OnlineDPO
Text Generation
•
Updated
•
36
trl-lib/Qwen2-0.5B-KTO
Text Generation
•
Updated
•
29
trl-lib/Qwen2-0.5B-ORPO
Text Generation
•
Updated
•
27
•
1
trl-lib/Qwen2-0.5B-DPO
Text Generation
•
Updated
•
85
•
4
trl-lib/Qwen2-0.5B-Reward
Text Classification
•
Updated
•
305
trl-lib/pythia-1b-deduped-tldr-rm
Updated
•
914
trl-lib/pythia-2.8b-deduped-tldr-online-dpo
Text Generation
•
Updated
•
16
trl-lib/pythia-6.9b-deduped-tldr-offline-dpo
Text Generation
•
Updated
•
16
datasets
19
trl-lib/documentation-images
Viewer
•
Updated
•
1
•
1.46k
trl-lib/ultrafeedback-prompt
Viewer
•
Updated
•
39.8k
•
1.11k
•
3
trl-lib/math_shepherd
Viewer
•
Updated
•
445k
•
196
•
1
trl-lib/alpaca-cleaned
Viewer
•
Updated
•
51.8k
•
60
trl-lib/hh-rlhf-helpful-base
Viewer
•
Updated
•
46.2k
•
105
trl-lib/prm800k
Viewer
•
Updated
•
41.2k
•
79
•
1
trl-lib/rlaif-v
Viewer
•
Updated
•
83.1k
•
117
•
1
trl-lib/Capybara-Preferences
Viewer
•
Updated
•
15.4k
•
106
trl-lib/Capybara
Viewer
•
Updated
•
16k
•
1.02k
•
1
trl-lib/tldr
Viewer
•
Updated
•
130k
•
559