Training in progress epoch 0

README.md

@@ -15,13 +15,13 @@ probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Train Loss: 1.1466
-- Train End Logits Accuracy: 0.6860
-- Train Start Logits Accuracy: 0.6593
-- Validation Loss: 1.4412
-- Validation End Logits Accuracy: 0.6158
-- Validation Start Logits Accuracy: 0.6041
-- Epoch: 1
+- Train Loss: 1.8241
+- Train End Logits Accuracy: 0.5283
+- Train Start Logits Accuracy: 0.5035
+- Validation Loss: 1.4113
+- Validation End Logits Accuracy: 0.6294
+- Validation Start Logits Accuracy: 0.5923
+- Epoch: 0
 
 ## Model description
 
@@ -40,20 +40,19 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 2208, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
+- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 3308, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
 - training_precision: float32
 
 ### Training results
 
 | Train Loss | Train End Logits Accuracy | Train Start Logits Accuracy | Validation Loss | Validation End Logits Accuracy | Validation Start Logits Accuracy | Epoch |
 |:----------:|:-------------------------:|:---------------------------:|:---------------:|:------------------------------:|:--------------------------------:|:-----:|
-| 2.0151     | 0.4895                    | 0.4712                      | 1.4940          | 0.6022                         | 0.5863                           | 0     |
-| 1.1466     | 0.6860                    | 0.6593                      | 1.4412          | 0.6158                         | 0.6041                           | 1     |
+| 1.8241     | 0.5283                    | 0.5035                      | 1.4113          | 0.6294                         | 0.5923                           | 0     |
 
 
 ### Framework versions
 
-- Transformers 4.36.2
-- TensorFlow 2.13.0
-- Datasets 2.1.0
+- Transformers 4.35.2
+- TensorFlow 2.15.0
+- Datasets 2.16.1
 - Tokenizers 0.15.0

config.json

@@ -18,6 +18,6 @@
   "seq_classif_dropout": 0.2,
   "sinusoidal_pos_embds": false,
   "tie_weights_": true,
-  "transformers_version": "4.36.2",
+  "transformers_version": "4.35.2",
   "vocab_size": 30522
 }

logs/train/events.out.tfevents.1705396533.c9ecd1b23b25.404.0.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cccc8c32cd570787ac5b41fa395395cfb17c4ee831b213ae4087b49c933c5398
+size 1205493

logs/validation/events.out.tfevents.1705397604.c9ecd1b23b25.404.1.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fdbe6b2c0c113aaf41d168a3d7ca66bf598346ea972f4023576e236fff521806
+size 604

tf_model.h5

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e8a7477c56d54ba01e280e0d7b0f2763a0b1685bb807717e623715db724e55d7
+oid sha256:3c3737b64bc4494c56f62bd01f511f221b5e782d297de4afe6f22544c16fd7a3
 size 265583592