Update README.md

README.md

@@ -22,8 +22,8 @@ This is a 8B reward model used for PPO training trained on the UltraFeedback dat
 For more details, read the paper:
 [Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback](https://arxiv.org/abs/2406.09279).
 
-**Built with Meta Llama 3.1!**
-Note that Llama 3.1 is released under the Meta Llama 3 community license, included here under `llama_3_license.txt`.
+Note this model is finetuned from Llama 3.1, released under the Meta Llama 3.1 community license, included here under `llama_3_license.txt`.
+
 
 ## Performance