Hugging Face's logo

senthil2002
/
distil_bert_own_txt_clf_model

Text Classification
Transformers
Safetensors
bert
Generated from Trainer
Inference Endpoints
Model card Files Community
senthil2002 commited on
Commit
635d959
•
1 Parent(s): 97afb2e

End of training

Browse files
Files changed (4) hide show
  1. README.md +13 -24
  2. config.json +11 -9
  3. model.safetensors +2 -2
  4. training_args.bin +2 -2
README.md CHANGED
@@ -20,11 +20,11 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 1.2314
24
- - Accuracy: 0.8
25
- - F1: 0.7950
26
- - Precision: 0.8053
27
- - Recall: 0.8084
28
 
29
  ## Model description
30
 
@@ -57,26 +57,15 @@ The following hyperparameters were used during training:
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
59
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
60
- | 1.3619 | 3.33 | 50 | 1.1190 | 0.5083 | 0.3510 | 0.3025 | 0.4690 |
61
- | 1.0373 | 6.67 | 100 | 0.6955 | 0.75 | 0.7245 | 0.7800 | 0.7244 |
62
- | 0.4461 | 10.0 | 150 | 0.8629 | 0.6833 | 0.6799 | 0.7370 | 0.6928 |
63
- | 0.0585 | 13.33 | 200 | 1.3333 | 0.7333 | 0.7132 | 0.7888 | 0.7391 |
64
- | 0.002 | 16.67 | 250 | 1.2095 | 0.775 | 0.7688 | 0.8003 | 0.7797 |
65
- | 0.0053 | 20.0 | 300 | 1.0637 | 0.7833 | 0.7728 | 0.7803 | 0.7773 |
66
- | 0.0006 | 23.33 | 350 | 1.0393 | 0.7833 | 0.7731 | 0.7866 | 0.7804 |
67
- | 0.0004 | 26.67 | 400 | 1.0850 | 0.7917 | 0.7825 | 0.8004 | 0.7913 |
68
- | 0.0004 | 30.0 | 450 | 1.0655 | 0.7833 | 0.7731 | 0.7866 | 0.7804 |
69
- | 0.0003 | 33.33 | 500 | 1.0775 | 0.7833 | 0.7731 | 0.7866 | 0.7804 |
70
- | 0.0003 | 36.67 | 550 | 1.0626 | 0.7833 | 0.7731 | 0.7866 | 0.7804 |
71
- | 0.0003 | 40.0 | 600 | 1.0474 | 0.775 | 0.7636 | 0.7736 | 0.7695 |
72
- | 0.0003 | 43.33 | 650 | 1.0526 | 0.775 | 0.7636 | 0.7736 | 0.7695 |
73
- | 0.0003 | 46.67 | 700 | 1.0609 | 0.775 | 0.7636 | 0.7736 | 0.7695 |
74
- | 0.0003 | 50.0 | 750 | 1.0607 | 0.775 | 0.7636 | 0.7736 | 0.7695 |
75
 
76
 
77
  ### Framework versions
78
 
79
- - Transformers 4.38.1
80
- - Pytorch 2.1.0+cu121
81
- - Datasets 2.17.1
82
- - Tokenizers 0.15.2
 
20
 
21
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 0.4812
24
+ - Accuracy: 0.92
25
+ - F1: 0.9132
26
+ - Precision: 0.95
27
+ - Recall: 0.9
28
 
29
  ## Model description
30
 
 
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
59
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
60
+ | 1.1251 | 12.5 | 50 | 0.6663 | 0.76 | 0.7758 | 0.7762 | 0.7783 |
61
+ | 0.088 | 25.0 | 100 | 0.8098 | 0.8 | 0.8211 | 0.8643 | 0.8033 |
62
+ | 0.0019 | 37.5 | 150 | 0.8122 | 0.84 | 0.8555 | 0.8833 | 0.8433 |
63
+ | 0.0012 | 50.0 | 200 | 0.8162 | 0.84 | 0.8555 | 0.8833 | 0.8433 |
 
 
 
 
 
 
 
 
 
 
 
64
 
65
 
66
  ### Framework versions
67
 
68
+ - Transformers 4.44.0
69
+ - Pytorch 2.3.1+cu121
70
+ - Datasets 2.20.0
71
+ - Tokenizers 0.19.1
config.json CHANGED
@@ -14,18 +14,20 @@
14
  "hidden_dropout_prob": 0.1,
15
  "hidden_size": 768,
16
  "id2label": {
17
- "0": "View_class",
18
- "1": "Del_class",
19
- "2": "Edit_class",
20
- "3": "Add_class"
 
21
  },
22
  "initializer_range": 0.02,
23
  "intermediate_size": 3072,
24
  "label2id": {
25
- "Add_class": 3,
26
- "Del_class": 1,
27
- "Edit_class": 2,
28
- "View_class": 0
 
29
  },
30
  "layer_norm_eps": 1e-12,
31
  "max_position_embeddings": 512,
@@ -42,7 +44,7 @@
42
  "sinusoidal_pos_embds": false,
43
  "tie_weights_": true,
44
  "torch_dtype": "float32",
45
- "transformers_version": "4.38.1",
46
  "type_vocab_size": 2,
47
  "use_cache": true,
48
  "vocab_size": 30522
 
14
  "hidden_dropout_prob": 0.1,
15
  "hidden_size": 768,
16
  "id2label": {
17
+ "0": "Delete_class",
18
+ "1": "Edit_class",
19
+ "2": "View_class",
20
+ "3": "unknown",
21
+ "4": "Add_class"
22
  },
23
  "initializer_range": 0.02,
24
  "intermediate_size": 3072,
25
  "label2id": {
26
+ "Add_class": 4,
27
+ "Delete_class": 0,
28
+ "Edit_class": 1,
29
+ "View_class": 2,
30
+ "unknown": 3
31
  },
32
  "layer_norm_eps": 1e-12,
33
  "max_position_embeddings": 512,
 
44
  "sinusoidal_pos_embds": false,
45
  "tie_weights_": true,
46
  "torch_dtype": "float32",
47
+ "transformers_version": "4.44.0",
48
  "type_vocab_size": 2,
49
  "use_cache": true,
50
  "vocab_size": 30522
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bc8535eeaacf18553c373d8bff79f42340f79838f63f343c4278f78ac0e5ed4a
3
- size 437964800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8faf8a164a45a99905619442fe9bc2f9022c0974f920c5b7a36b008af1e91c70
3
+ size 437967876
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5025dc56ffdbea45a06154c1570858603fc827b6a4001d28c4c7b9972e7790d5
3
- size 4856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1da662c0c032ba67fbb6719be23630896424d2209db87bcc4ea72bf99bc0543
3
+ size 5176