Training in progress epoch 0

README.md

@@ -14,10 +14,10 @@ probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Train Loss: 0.1925
-- Validation Loss: 0.5498
-- Train Matthews Correlation: 0.5046
-- Epoch: 2
+- Train Loss: 0.5186
+- Validation Loss: 0.4780
+- Train Matthews Correlation: 0.4164
+- Epoch: 0
 
 ## Model description
 
@@ -43,14 +43,12 @@ The following hyperparameters were used during training:
 
 | Train Loss | Validation Loss | Train Matthews Correlation | Epoch |
 |:----------:|:---------------:|:--------------------------:|:-----:|
-| 0.5217     | 0.4845          | 0.4323                     | 0     |
-| 0.3278     | 0.4758          | 0.5131                     | 1     |
-| 0.1925     | 0.5498          | 0.5046                     | 2     |
+| 0.5186     | 0.4780          | 0.4164                     | 0     |
 
 
 ### Framework versions
 
-- Transformers 4.19.0.dev0
-- TensorFlow 2.8.0-rc0
-- Datasets 2.1.1.dev0
+- Transformers 4.21.0.dev0
+- TensorFlow 2.9.1
+- Datasets 2.3.3.dev0
 - Tokenizers 0.11.0

config.json

@@ -18,6 +18,6 @@
   "seq_classif_dropout": 0.2,
   "sinusoidal_pos_embds": false,
   "tie_weights_": true,
-  "transformers_version": "4.19.0.dev0",
+  "transformers_version": "4.21.0.dev0",
   "vocab_size": 30522
 }

logs/train/events.out.tfevents.1651825487.matt-TRX40-AORUS-PRO-WIFI.12805.0.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:91612c2925672a7e39faeb5fc498c1a68a1f46918f5cf4324c1af50b507adef9
+size 1495416

logs/train/events.out.tfevents.1658242151.matt-TRX40-AORUS-PRO-WIFI.34659.0.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:52e08c96c625b321897c9c563e0de660a4ff6490b8d0db5cdfc999844000c888
+size 1590973

logs/validation/events.out.tfevents.1658242169.matt-TRX40-AORUS-PRO-WIFI.34659.1.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc122105f842ad6229487254b4398c533ca4594581c2e9e9bc8d1cb423b86bd3
+size 194

special_tokens_map.json

@@ -1 +1,7 @@
-{"unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]"}
+{
+  "cls_token": "[CLS]",
+  "mask_token": "[MASK]",
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "unk_token": "[UNK]"
+}

tf_model.h5

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ce41d43b591db8e03fcbcd6fa1daf459f26c322354db05aa39e1e354034928cb
+oid sha256:43b7f4ce1e1165be1e370f2752c63881f4ccd724c76995ace02e73bf4a807a5d
 size 267951896

tokenizer_config.json

@@ -1 +1,14 @@
-{"do_lower_case": true, "unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]", "tokenize_chinese_chars": true, "strip_accents": null, "model_max_length": 512, "special_tokens_map_file": null, "name_or_path": "distilbert-base-uncased", "tokenizer_class": "DistilBertTokenizer"}
+{
+  "cls_token": "[CLS]",
+  "do_lower_case": true,
+  "mask_token": "[MASK]",
+  "model_max_length": 512,
+  "name_or_path": "distilbert-base-uncased",
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "special_tokens_map_file": null,
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "DistilBertTokenizer",
+  "unk_token": "[UNK]"
+}