Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
chujiezheng
's Collections
Weak-to-Strong Extrapolation Expedites Alignment
Model Checkpoints in the ExPO Paper
Weak-to-Strong Extrapolation Expedites Alignment
updated
12 days ago
Better aligned models obtained by weak-to-strong model extrapolation (ExPO)
Upvote
16
+6
Weak-to-Strong Extrapolation Expedites Alignment
Paper
•
2404.16792
•
Published
Apr 25
•
11
chujiezheng/Smaug-Llama-3-70B-Instruct-ExPO
Text Generation
•
Updated
May 27
•
1.05k
•
2
chujiezheng/Smaug-34B-v0.1-ExPO
Text Generation
•
Updated
about 1 month ago
•
1.89k
chujiezheng/Starling-LM-7B-beta-ExPO
Text Generation
•
Updated
May 27
•
1.48k
•
1
chujiezheng/Starling-LM-7B-alpha-ExPO
Text Generation
•
Updated
May 27
•
2.5k
chujiezheng/LLaMA3-iterative-DPO-final-ExPO
Text Generation
•
Updated
May 27
•
1.11k
•
1
chujiezheng/Llama-3-Instruct-8B-SimPO-ExPO
Text Generation
•
Updated
28 days ago
•
713
•
14
chujiezheng/Mistral7B-PairRM-SPPO-ExPO
Text Generation
•
Updated
28 days ago
•
463
chujiezheng/Snorkel-Mistral-PairRM-DPO-ExPO
Text Generation
•
Updated
May 27
•
454
chujiezheng/tulu-2-dpo-70b-ExPO
Text Generation
•
Updated
May 27
•
1.46k
chujiezheng/tulu-2-dpo-13b-ExPO
Text Generation
•
Updated
May 27
•
457
chujiezheng/tulu-2-dpo-7b-ExPO
Text Generation
•
Updated
May 27
•
1.13k
chujiezheng/Llama3-70B-Chinese-Chat-ExPO
Text Generation
•
Updated
May 27
•
1
chujiezheng/Llama3-8B-Chinese-Chat-ExPO
Text Generation
•
Updated
May 27
•
600
•
1
chujiezheng/neo_7b_instruct_v0.1-ExPO
Text Generation
•
Updated
10 days ago
•
7
chujiezheng/zephyr-7b-beta-ExPO
Text Generation
•
Updated
May 27
•
864
chujiezheng/zephyr-7b-alpha-ExPO
Text Generation
•
Updated
May 27
•
856
chujiezheng/zephyr-7b-dpo-full-ExPO
Text Generation
•
Updated
May 27
•
868
chujiezheng/internlm2-chat-20b-ExPO
Text Generation
•
Updated
May 27
•
4
•
1
chujiezheng/internlm2-chat-7b-ExPO
Text Generation
•
Updated
May 27
•
4
chujiezheng/internlm2-chat-1_8b-ExPO
Text Generation
•
Updated
May 27
•
3
•
1
Upvote
16
+12
Share collection
View history
Collection guide
Browse collections