chujiezheng
commited on
Commit
•
d3e8342
1
Parent(s):
dba98d9
Update README.md
Browse files
README.md
CHANGED
@@ -10,7 +10,7 @@ The extrapolated (ExPO) model based on [`UCLA-AGI/Mistral7B-PairRM-SPPO`](https:
|
|
10 |
|
11 |
Specifically, we obtain this model by extrapolating **(alpha = 0.3)** from the weights of the SFT and DPO/RLHF checkpoints, achieving superior alignment with human preference.
|
12 |
|
13 |
-
This model achieves the **35.4%** win rate and **31.8%** LC win rate on **AlpacaEval 2.0
|
14 |
|
15 |
## Evaluation Results
|
16 |
|
|
|
10 |
|
11 |
Specifically, we obtain this model by extrapolating **(alpha = 0.3)** from the weights of the SFT and DPO/RLHF checkpoints, achieving superior alignment with human preference.
|
12 |
|
13 |
+
This extrapolated model achieves the **35.4%** win rate and **31.8%** LC win rate on **AlpacaEval 2.0**, outperforming the original `Mistral7B-PairRM-SPPO`'s 32.2% and 30.5%, respectively.
|
14 |
|
15 |
## Evaluation Results
|
16 |
|