End of training

README.md

@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [CohereForAI/aya-23-8B](https://huggingface.co/CohereForAI/aya-23-8B) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 2.8404
+- Loss: 2.3016
 
 ## Model description
 
@@ -34,7 +34,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 1e-06
+- learning_rate: 5e-06
 - train_batch_size: 16
 - eval_batch_size: 16
 - seed: 42
@@ -47,16 +47,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| No log        | 1.0   | 6    | 2.8962          |
-| No log        | 2.0   | 12   | 2.8825          |
-| No log        | 3.0   | 18   | 2.8692          |
-| No log        | 4.0   | 24   | 2.8596          |
-| No log        | 5.0   | 30   | 2.8520          |
-| No log        | 6.0   | 36   | 2.8449          |
-| No log        | 7.0   | 42   | 2.8432          |
-| No log        | 8.0   | 48   | 2.8417          |
-| No log        | 9.0   | 54   | 2.8399          |
-| No log        | 10.0  | 60   | 2.8411          |
+| No log        | 1.0   | 6    | 2.8530          |
+| No log        | 2.0   | 12   | 2.6595          |
+| No log        | 3.0   | 18   | 2.5028          |
+| No log        | 4.0   | 24   | 2.4215          |
+| No log        | 5.0   | 30   | 2.3694          |
+| No log        | 6.0   | 36   | 2.3343          |
+| No log        | 7.0   | 42   | 2.3137          |
+| No log        | 8.0   | 48   | 2.3057          |
+| No log        | 9.0   | 54   | 2.3008          |
+| No log        | 10.0  | 60   | 2.3014          |
 
 
 ### Framework versions

model-00001-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c72cfe6f436ee1fd1e3947a302a8fe8daee12d580924462de4f7d92a3a7a9dcc
+oid sha256:6e937e17077ffddc9abe3abe60b0c07181f05b7c3c45e49bf9a46eed9c1a76b2
 size 4907825264

model-00002-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3032e00f54ae7456853f9b64848a680b83f276f88893962c0c753a217aac057b
+oid sha256:460740e8b1cd5b09d25e0b60ac2f421efd614d555f4c00f4a1e65d01cc59caf4
 size 4915824704

model-00003-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:503985bec890eab3c3fe6d454ff7cae991b222686e40f20303d5d04b91c803aa
+oid sha256:a52a0b12641669f61828dd1b1f59bde8f04441c12cfa3f2e559b407fec262651
 size 4999719592

model-00004-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1b8788fd4c5204442b28cd2ec0f3e2a499147de3c009bcf2da22d114498c77a9
+oid sha256:23e340e20c00ffb9eb105ace12f0dd639489e60206a5d3059b59b4a4cbca2352
 size 1224771944