Update README.md

README.md

@@ -7,9 +7,10 @@ metrics:
 ---
 
 
-GPT2 large model trained on Anthropic/hh-rlhf helpful dataset. It is specifically used for helpful response detection or RLHF. Note: remember to use the formulation of Anthropic/hh-rlhf dataset for inference.
+GPT2 large model trained on Anthropic/hh-rlhf helpful dataset. It is specifically used for helpful response detection or RLHF. It achieves an accuracy of 0.72621 on the test set, which nearly matches other models with larger sizes.
+
+Note: 1. Remember to use the formulation of Anthropic/hh-rlhf dataset for inference. 2. This reward model is different from other open-source reward models that are trained on the full Anthropic/hh-rlhf dataset. 
 
-It achieves an accuracy of 0.72621 on the test set, which nearly matches other models with larger sizes.
 
 ## Usage:
 ```