See our paper at https://huggingface.co/papers/2405.19332.
Shenao Zhang
ZhangShenao
AI & ML interests
None yet
Recent Activity
updated
a model
about 4 hours ago
ZhangShenao/critic_debug
published
a model
about 4 hours ago
ZhangShenao/critic_debug
updated
a dataset
3 days ago
ZhangShenao/bt-math_gsm-gemma-1.1-7b-it-iter_sample_7500_temp_1.0_gen_1
Organizations
Collections
3
-
ZhangShenao/SELM-Llama-3-8B-Instruct-iter-3
Text Generation • Updated • 56 • 5 -
ZhangShenao/SELM-Llama-3-8B-Instruct-iter-2
Text Generation • Updated • 19 -
ZhangShenao/SELM-Llama-3-8B-Instruct-iter-1
Text Generation • Updated • 14 -
Self-Exploring Language Models: Active Preference Elicitation for Online Alignment
Paper • 2405.19332 • Published • 22
models
395
ZhangShenao/critic_debug
Updated
ZhangShenao/math_gsm-Mistral-7B-Instruct-v0.2-msft-sample_7473_tp_unfreeze_qk_ep_10
Updated
•
11
ZhangShenao/math_gsm-Mistral-7B-Instruct-v0.2-msft-sample_7473_tp_unfreeze_noneep_10
Updated
•
10
ZhangShenao/math_gsm-Mistral-7B-Instruct-v0.2-msft-sample_7473_tp_unfreeze_vo_ep_10
Updated
•
10
ZhangShenao/math_gsm-Mistral-7B-Instruct-v0.2-msft-sample_7473_tp_unfreeze_reverse_vo
Updated
•
12
ZhangShenao/math_gsm-gemma-1.1-7b-it-msft-sample_7473_tp_unfreeze_reverse_vo
Updated
•
15
ZhangShenao/math_gsm-Mistral-7B-Instruct-v0.2-msft-sample_7473_tp_unfreeze_qk
Updated
•
8
ZhangShenao/math_gsm-Mistral-7B-Instruct-v0.2-msft-sample_7473_tp_unfreeze_vo
Updated
•
10
ZhangShenao/math_gsm-Mistral-7B-Instruct-v0.2-msft-sample_7473_tp_unfreeze_none
Text Generation
•
Updated
•
16
ZhangShenao/math_gsm-gemma-1.1-7b-it-msft-sample_7473_tp_unfreeze_none
Text Generation
•
Updated
•
8
datasets
235
ZhangShenao/bt-math_gsm-gemma-1.1-7b-it-iter_sample_7500_temp_1.0_gen_1
Viewer
•
Updated
•
3.74k
•
35
ZhangShenao/msft-math_gsm-Mistral-7B-Instruct-v0.2-iter_sample_7473_tp
Viewer
•
Updated
•
7.47k
•
36
ZhangShenao/msft-math_gsm-gemma-1.1-7b-it-iter_sample_7473_tp
Viewer
•
Updated
•
7.47k
•
55
ZhangShenao/bt_norej-math_gsm-gemma-1.1-7b-it-iter_sample_7500_temp_1.0_gen_1_mlr5e-5
Viewer
•
Updated
•
7.47k
•
39
ZhangShenao/bt_norej-math_gsm-Mistral-7B-Instruct-v0.2-iter_sample_7500_temp_1.0_gen_1_mlr5e-5
Viewer
•
Updated
•
7.47k
•
42
ZhangShenao/bt_norej_full-math_gsm-Mistral-7B-Instruct-v0.2-iter_sample_7500_temp_1.0_gen_1_mlr5e-5
Viewer
•
Updated
•
7.47k
•
31
ZhangShenao/bt-math_gsm-Meta-Llama-3-8B-Instruct-iter_sample_7500_temp_1.0_gen_1_mlr5e-5
Viewer
•
Updated
•
5.43k
•
65
ZhangShenao/bt-math_gsm-Mistral-7B-Instruct-v0.2-iter_sample_7500_temp_1.0_gen_1_mlr5e-5
Viewer
•
Updated
•
3.05k
•
56
ZhangShenao/bt_sft-math_gsm-gemma-1.1-7b-it-iter_sample_7500_tp
Viewer
•
Updated
•
7.47k
•
66
ZhangShenao/bt-math_gsm-gemma-1.1-7b-it-iter_sample_7500_temp_1.0_gen_1_mlr5e-5
Viewer
•
Updated
•
3.74k
•
84