Update README.md

README.md

@@ -8,29 +8,17 @@ model-index:
   results: []
 datasets:
 - winglian/no_robots_rlhf
+- HuggingFaceH4/no_robots
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
 [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
-# qlora-out
+# openhermes-2_5-dpo-no-robots 
 
-This model is a fine-tuned version of [teknium/OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) on an unknown dataset.
+This model is a RL fine-tuned version of [teknium/OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) on a preference dataset derived from HuggingFace's [no robots dataset](https://huggingface.co/datasets/HuggingFaceH4/no_robots) using DPO.
 
-## Model description
-
-More information needed
-
-## Intended uses & limitations
-
-More information needed
-
-## Training and evaluation data
-
-More information needed
-
-## Training procedure
 
 ### Training hyperparameters