Update README.md

README.md

@@ -22,9 +22,10 @@ This is a **value** model produced during the PPO training of [this](https://hug
 It was initialised from the [Tulu v2.5 13B UltraFeedback RM](https://huggingface.co/allenai/tulu-v2.5-13b-uf-rm).
 We release the value model as it may provide a good starting point for additional research or improved decoding with our released PPO models.
 
+At time of writing, you may have to [install transformers from source](https://huggingface.co/docs/transformers/en/installation#install-from-source) to get the `LlamaForTokenClassification` class.
 
 For more details, read the paper:
-[Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback](https://link.todo).
+[Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback](https://arxiv.org/abs/2406.09279).
 
 
 ## .Model description
@@ -78,6 +79,7 @@ If you find Tulu 2.5 is useful in your work, please cite it with:
       title={{Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback}}, 
       author={{Hamish Ivison and Yizhong Wang and Jiacheng Liu and Ellen Wu and Valentina Pyatkin and Nathan Lambert and Yejin Choi and Noah A. Smith and Hannaneh Hajishirzi}}
       year={2024},
+      eprint={2406.09279},
       archivePrefix={arXiv},
       primaryClass={cs.CL}
 }