Update README.md

README.md

@@ -1,23 +1,16 @@
----
-language:
-- en
-license: apache-2.0
-tags:
-- text-generation-inference
-- transformers
-- unsloth
-- mistral
-- trl
-- dpo
-base_model: unsloth/mistral-7b-v0.2-bnb-4bit
----
+This model was trained as part of a series of experiments testing the performance of pure DPO vs SFT vs ORPO, all supported by Unsloth/Huggingface TRL.
 
-# Uploaded  model
+Rank: 8
+Alpha: 16
+Learning rate: 5e-6
+Beta: 0.1
+Batch size: 8
+Epochs: 1
+Learning rate schedulers: Linear
+Prompt Format: ``You are a helpful assistant.<s>[INST] PROMPT [/INST]RESPONSE</s>``
 
-- **Developed by:** G-reen
-- **License:** apache-2.0
-- **Finetuned from model :** unsloth/mistral-7b-v0.2-bnb-4bit
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/65a5c0e82823ba72ed2cee7d/Tg3dknWsTvfqM96Fab2YJ.png)
 
-This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/65a5c0e82823ba72ed2cee7d/8DQ0WiypkVIJeK_Y18Wv0.png)
 
 [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)