Update README.md
Browse files
README.md
CHANGED
@@ -15,5 +15,5 @@ DPO Trainer
|
|
15 |
TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.
|
16 |
```
|
17 |
Metrics
|
18 |
-
![Metrics](
|
19 |
|
|
|
15 |
TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.
|
16 |
```
|
17 |
Metrics
|
18 |
+
![Metrics](4bit.vs.16.jpg)
|
19 |
|