Various useful datasets with preference optimization
Nicholas Beerbower
nbeerbower
AI & ML interests
QLoRA finetuning and merging LLMs for fun
Recent Activity
liked
a dataset
3 days ago
microsoft/orca-agentinstruct-1M-v1
liked
a model
3 days ago
mistralai/Mistral-Large-Instruct-2411
New activity
3 days ago
nbeerbower/Qwen2.5-Gutenberg-Doppel-32B
Organizations
models
134
nbeerbower/Mistral-Gutenberg-Doppel-7B-FFT
Text Generation
•
Updated
•
18
•
1
nbeerbower/Qwen2.5-Gutenberg-Doppel-14B
Text Generation
•
Updated
•
99
•
11
nbeerbower/Qwen2.5-Gutenberg-Doppel-32B
Text Generation
•
Updated
•
47
•
5
nbeerbower/Mistral-Nemo-Prism-12B
Text Generation
•
Updated
•
45
•
2
nbeerbower/Mistral-Nemo-Prism-12B-v2
Text Generation
•
Updated
•
23
•
2
nbeerbower/Mistral-Nemo-Prism-12B-v3
Text Generation
•
Updated
•
16
nbeerbower/Mistral-Nemo-Prism-12B-v4
Text Generation
•
Updated
•
18
nbeerbower/Mistral-Nemo-Prism-12B-v5
Text Generation
•
Updated
•
57
nbeerbower/Mistral-Nemo-Prism-12B-v6
Text Generation
•
Updated
•
17
•
1
nbeerbower/Mistral-Nemo-Prism-12B-v7
Text Generation
•
Updated
•
61
•
4
datasets
7
nbeerbower/gutenberg-moderne-dpo
Viewer
•
Updated
•
346
•
18
•
1
nbeerbower/gutenberg2-dpo
Viewer
•
Updated
•
293
•
115
•
14
nbeerbower/Schule-DPO
Viewer
•
Updated
•
34
•
15
nbeerbower/cover-images
Viewer
•
Updated
•
4
•
367
nbeerbower/Arkhaios-DPO
Viewer
•
Updated
•
222
•
70
•
6
nbeerbower/Purpura-DPO
Viewer
•
Updated
•
230
•
63
•
5
nbeerbower/bible-dpo
Viewer
•
Updated
•
31.1k
•
49