End of training

README.md

@@ -1,6 +1,6 @@
 ---
-license: mit
-base_model: xlm-roberta-large
+license: apache-2.0
+base_model: distilbert-base-uncased
 tags:
 - generated_from_trainer
 model-index:
@@ -13,9 +13,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 # my_awesome_qa_model
 
-This model is a fine-tuned version of [xlm-roberta-large](https://huggingface.co/xlm-roberta-large) on the None dataset.
+This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 5.9506
+- Loss: 1.6880
 
 ## Model description
 
@@ -35,27 +35,23 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 2e-05
-- train_batch_size: 4
-- eval_batch_size: 4
+- train_batch_size: 16
+- eval_batch_size: 16
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 10
+- num_epochs: 6
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| No log        | 1.0   | 197  | 5.9506          |
-| No log        | 2.0   | 394  | 5.9506          |
-| 5.9533        | 3.0   | 591  | 5.9506          |
-| 5.9533        | 4.0   | 788  | 5.9506          |
-| 5.9533        | 5.0   | 985  | 5.9506          |
-| 5.986         | 6.0   | 1182 | 5.9506          |
-| 5.986         | 7.0   | 1379 | 5.9506          |
-| 5.9844        | 8.0   | 1576 | 5.9506          |
-| 5.9844        | 9.0   | 1773 | 5.9506          |
-| 5.9844        | 10.0  | 1970 | 5.9506          |
+| No log        | 1.0   | 50   | 1.4554          |
+| No log        | 2.0   | 100  | 1.4497          |
+| No log        | 3.0   | 150  | 1.5431          |
+| No log        | 4.0   | 200  | 1.6534          |
+| No log        | 5.0   | 250  | 1.6872          |
+| No log        | 6.0   | 300  | 1.6880          |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0d3168429c84297f9781ed189175ad8eccfba0074bf3b12abffeeca3fe6eba93
+oid sha256:d778f25690f72edc3f1f0ef76cf3b1870721589901043fe6ab8f513f70d4a13b
 size 265470032

runs/Apr07_14-13-17_d285764a1c28/events.out.tfevents.1712499198.d285764a1c28.298.6

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e1a5838153950e06a6fa00b73df6a0c53afa5deb63c8675997c943afc6c06f4c
-size 7093
+oid sha256:c9b800c630e400fbfabfcd42321a98f82337c84b403eb4d3b8500b9168f69d55
+size 7718

runs/Apr07_14-19-11_d285764a1c28/events.out.tfevents.1712499551.d285764a1c28.298.7

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ed8fea7ab35050eba43bbdab19fc84a10f0d63835be0686429c214828d501388
+size 6459

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6793bd2a32968012de17bbef848f98587e6a2e99deb5b40e80935487ce3c92d8
+oid sha256:2698a64642c1cca56a51c93ae89d5fa45a3f88fb31755517f2404798fde3e0df
 size 4920