Training in progress epoch 0

README.md

@@ -15,13 +15,13 @@ probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Train Loss: 1.3959
-- Train End Logits Accuracy: 0.6237
-- Train Start Logits Accuracy: 0.6113
-- Validation Loss: 1.5509
-- Validation End Logits Accuracy: 0.6054
-- Validation Start Logits Accuracy: 0.5803
-- Epoch: 1
+- Train Loss: 2.0576
+- Train End Logits Accuracy: 0.4779
+- Train Start Logits Accuracy: 0.4592
+- Validation Loss: 1.4984
+- Validation End Logits Accuracy: 0.6130
+- Validation Start Logits Accuracy: 0.5891
+- Epoch: 0
 
 ## Model description
 
@@ -40,20 +40,19 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 1112, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
+- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 2208, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
 - training_precision: float32
 
 ### Training results
 
 | Train Loss | Train End Logits Accuracy | Train Start Logits Accuracy | Validation Loss | Validation End Logits Accuracy | Validation Start Logits Accuracy | Epoch |
 |:----------:|:-------------------------:|:---------------------------:|:---------------:|:------------------------------:|:--------------------------------:|:-----:|
-| 2.6112     | 0.3765                    | 0.3608                      | 1.7039          | 0.5682                         | 0.5274                           | 0     |
-| 1.3959     | 0.6237                    | 0.6113                      | 1.5509          | 0.6054                         | 0.5803                           | 1     |
+| 2.0576     | 0.4779                    | 0.4592                      | 1.4984          | 0.6130                         | 0.5891                           | 0     |
 
 
 ### Framework versions
 
-- Transformers 4.35.2
-- TensorFlow 2.15.0
-- Datasets 2.16.1
+- Transformers 4.36.2
+- TensorFlow 2.13.0
+- Datasets 2.1.0
 - Tokenizers 0.15.0

config.json

@@ -18,6 +18,6 @@
   "seq_classif_dropout": 0.2,
   "sinusoidal_pos_embds": false,
   "tie_weights_": true,
-  "transformers_version": "4.35.2",
+  "transformers_version": "4.36.2",
   "vocab_size": 30522
 }

logs/train/events.out.tfevents.1705385121.9bf3114b91fb.58.0.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d759c29dd3d264aec6b0b4e88905d4f3796ba64d08a8abc60754634acf969495
+size 1781732

logs/validation/events.out.tfevents.1705385800.9bf3114b91fb.58.1.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ede5447749c32f1855358abace9f5dcf04399d1ead50314846e617d6b13386e1
+size 604

tf_model.h5

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:91b28cd94fe44ca99f0da64b28608b59d2b6febd88deeb6f85fb21f08cfaae23
+oid sha256:4f569ae398d6e536b94b6123e60cd7cb991e22df5dc97feb7b01c20f1afa8ea8
 size 265583592