End of training

README.md

@@ -103,7 +103,7 @@ xformers_attention: true
 
 This model is a fine-tuned version of [unsloth/Mistral-Nemo-Base-2407](https://huggingface.co/unsloth/Mistral-Nemo-Base-2407) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 2.2204
+- Loss: 2.2105
 
 ## Model description
 
@@ -135,7 +135,7 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
-| 1.7828        | 0.0001 | 10   | 2.2204          |
+| 1.7549        | 0.0001 | 10   | 2.2105          |
 
 
 ### Framework versions

adapter_config.json

@@ -20,13 +20,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "v_proj",
-    "q_proj",
-    "down_proj",
+    "gate_proj",
     "k_proj",
+    "q_proj",
     "up_proj",
-    "gate_proj",
-    "o_proj"
+    "o_proj",
+    "v_proj",
+    "down_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fa80a9a7a9cfc89745e921dc799e810f8a3ed233800ed5b1912079606cf6a9df
+oid sha256:8c6cd975167c51f9b9c976fe220726b3ae2c7ccf76a51a7b214cedde21fa950f
 size 228267658

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:62ae9cca12a6c64aeb0b76139592fde21a88611a915ce124ed478880a006240f
+oid sha256:211cc8563b7f179f2d3796553f0df7a1d52be1c8cc5d5f014e81e62b43e93beb
 size 228140600

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:69056286cee379b2a60510baded90c3897f96142bc2bc7e673a3da84cb0f8ba7
+oid sha256:376fc42fac8f7e87caa61bac2e0903518b148a91af089e1a2041c1c1c361fb59
 size 6776