Aligning to Thousands of Preferences via System Message Generalization
Paper
•
2405.17977
•
Published
•
7
System Message Generalization
-
-
kaist-ai/Multifaceted-Collection
Viewer • Updated • 197k • 237 • 15 -
kaist-ai/janus-7b
Text Generation • Updated • 135 • 8 -
kaist-ai/Multifaceted-Bench
Viewer • Updated • 921 • 170 • 6 -
kaist-ai/Multifaceted-Collection-DPO
Viewer • Updated • 65.1k • 124 • 9 -
kaist-ai/janus-dpo-7b
Text Generation • Updated • 105 • 3 -
kaist-ai/Multifaceted-Collection-ORPO
Viewer • Updated • 64.6k • 137 • 10 -
kaist-ai/janus-orpo-7b
Text Generation • Updated • 2k • 2 -
kaist-ai/Multifaceted-Collection-RM
Viewer • Updated • 64.9k • 113 • 4 -
kaist-ai/janus-rm-7b
Updated • 73 • 4 -
kaist-ai/Multifaceted-Collection-small
Viewer • Updated • 65.7k • 96 • 5