Model save

README.md

@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model was trained from scratch on the squad_v2 dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.9064
+- Loss: 0.8582
 
 ## Model description
 
@@ -35,11 +35,11 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 2e-05
-- train_batch_size: 256
-- eval_batch_size: 256
+- train_batch_size: 64
+- eval_batch_size: 64
 - seed: 42
 - gradient_accumulation_steps: 4
-- total_train_batch_size: 1024
+- total_train_batch_size: 256
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - num_epochs: 4
@@ -58,6 +58,16 @@ The following hyperparameters were used during training:
 | 0.9455        | 1.57  | 800  | 0.9351          |
 | 0.9322        | 1.76  | 900  | 0.9451          |
 | 0.9269        | 1.96  | 1000 | 0.9064          |
+| 0.9105        | 2.16  | 1100 | 0.8837          |
+| 0.8805        | 2.35  | 1200 | 0.8876          |
+| 0.8703        | 2.55  | 1300 | 0.9853          |
+| 0.8699        | 2.75  | 1400 | 0.9235          |
+| 0.8633        | 2.94  | 1500 | 0.8930          |
+| 0.828         | 3.14  | 1600 | 0.8582          |
+| 0.8284        | 3.33  | 1700 | 0.9203          |
+| 0.8076        | 3.53  | 1800 | 0.8866          |
+| 0.7805        | 3.73  | 1900 | 0.9099          |
+| 0.7974        | 3.92  | 2000 | 0.8746          |
 
 
 ### Framework versions

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:55c5cc052ef03c546835061e4d4369927b827e973b662412dd48e2a0d4e631f5
+oid sha256:a1015732ab2ae348cd6ae78157b4884d85a150bd1ceb8818efefd7e812ffd881
 size 496295078