Hugging Face's logo

sotseth
/
output

Text Classification
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
sotseth commited on
Commit
cc66fc6
•
1 Parent(s): aa47ca0

End of training

Browse files
Files changed (17) hide show
  1. README.md +64 -0
  2. config.json +39 -0
  3. model.safetensors +3 -0
  4. runs/Nov01_07-18-41_cefd2920e282/events.out.tfevents.1698823140.cefd2920e282.2664.0 +3 -0
  5. runs/Nov02_17-35-58_854bbcebb551/events.out.tfevents.1698946571.854bbcebb551.1245.0 +3 -0
  6. runs/Nov02_17-35-58_854bbcebb551/events.out.tfevents.1698949334.854bbcebb551.1245.1 +3 -0
  7. runs/Nov06_22-37-46_6c8330291840/events.out.tfevents.1699310280.6c8330291840.588.0 +3 -0
  8. runs/Nov07_18-23-11_f7861474fc09/events.out.tfevents.1699381467.f7861474fc09.1396.0 +3 -0
  9. runs/Nov07_19-34-48_9c10e3e529f3/events.out.tfevents.1699386111.9c10e3e529f3.294.0 +3 -0
  10. runs/Nov08_21-38-47_9b5eff9f4724/events.out.tfevents.1699479537.9b5eff9f4724.469.0 +3 -0
  11. runs/Nov09_11-43-58_b5c41c6ea59a/events.out.tfevents.1699530251.b5c41c6ea59a.617.0 +3 -0
  12. runs/Nov09_19-19-27_5c95ed4ca3fd/events.out.tfevents.1699557576.5c95ed4ca3fd.4647.0 +3 -0
  13. runs/Nov09_19-19-27_5c95ed4ca3fd/events.out.tfevents.1699562081.5c95ed4ca3fd.4647.1 +3 -0
  14. runs/Nov09_21-15-46_5c95ed4ca3fd/events.out.tfevents.1699564560.5c95ed4ca3fd.34599.0 +3 -0
  15. runs/Nov10_22-09-26_8411bb85556b/events.out.tfevents.1699654176.8411bb85556b.629.0 +3 -0
  16. runs/Nov10_22-09-26_8411bb85556b/events.out.tfevents.1699655574.8411bb85556b.629.1 +3 -0
  17. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: cardiffnlp/twitter-roberta-base-sentiment-latest
3
+ tags:
4
+ - generated_from_trainer
5
+ metrics:
6
+ - accuracy
7
+ model-index:
8
+ - name: output
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # output
16
+
17
+ This model is a fine-tuned version of [cardiffnlp/twitter-roberta-base-sentiment-latest](https://huggingface.co/cardiffnlp/twitter-roberta-base-sentiment-latest) on an unknown dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 0.5333
20
+ - Accuracy: 0.786
21
+
22
+ ## Model description
23
+
24
+ More information needed
25
+
26
+ ## Intended uses & limitations
27
+
28
+ More information needed
29
+
30
+ ## Training and evaluation data
31
+
32
+ More information needed
33
+
34
+ ## Training procedure
35
+
36
+ ### Training hyperparameters
37
+
38
+ The following hyperparameters were used during training:
39
+ - learning_rate: 5e-05
40
+ - train_batch_size: 8
41
+ - eval_batch_size: 8
42
+ - seed: 42
43
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
+ - lr_scheduler_type: linear
45
+ - num_epochs: 3
46
+
47
+ ### Training results
48
+
49
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
50
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
51
+ | 0.7137 | 0.5 | 500 | 0.6020 | 0.7675 |
52
+ | 0.6209 | 1.0 | 1000 | 0.5333 | 0.786 |
53
+ | 0.4622 | 1.5 | 1500 | 0.6210 | 0.792 |
54
+ | 0.4764 | 2.0 | 2000 | 0.7468 | 0.783 |
55
+ | 0.3036 | 2.5 | 2500 | 0.8896 | 0.795 |
56
+ | 0.2941 | 3.0 | 3000 | 0.8803 | 0.8035 |
57
+
58
+
59
+ ### Framework versions
60
+
61
+ - Transformers 4.35.0
62
+ - Pytorch 2.1.0+cu118
63
+ - Datasets 2.14.6
64
+ - Tokenizers 0.14.1
config.json ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "cardiffnlp/twitter-roberta-base-sentiment-latest",
3
+ "architectures": [
4
+ "RobertaForSequenceClassification"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "bos_token_id": 0,
8
+ "classifier_dropout": null,
9
+ "eos_token_id": 2,
10
+ "gradient_checkpointing": false,
11
+ "hidden_act": "gelu",
12
+ "hidden_dropout_prob": 0.1,
13
+ "hidden_size": 768,
14
+ "id2label": {
15
+ "0": "negative",
16
+ "1": "neutral",
17
+ "2": "positive"
18
+ },
19
+ "initializer_range": 0.02,
20
+ "intermediate_size": 3072,
21
+ "label2id": {
22
+ "negative": 0,
23
+ "neutral": 1,
24
+ "positive": 2
25
+ },
26
+ "layer_norm_eps": 1e-05,
27
+ "max_position_embeddings": 514,
28
+ "model_type": "roberta",
29
+ "num_attention_heads": 12,
30
+ "num_hidden_layers": 12,
31
+ "pad_token_id": 1,
32
+ "position_embedding_type": "absolute",
33
+ "problem_type": "single_label_classification",
34
+ "torch_dtype": "float32",
35
+ "transformers_version": "4.35.0",
36
+ "type_vocab_size": 1,
37
+ "use_cache": true,
38
+ "vocab_size": 50265
39
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d11bd8063ac4a70dd0b0243ff056b17d8b18eea631bc1d9e65bdc10a6c5f613e
3
+ size 498615900
runs/Nov01_07-18-41_cefd2920e282/events.out.tfevents.1698823140.cefd2920e282.2664.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe7cc6c1c9ad574b6d951f1fb23bfbc3e1a865eb23c629816ee3fe81c087d268
3
+ size 5107
runs/Nov02_17-35-58_854bbcebb551/events.out.tfevents.1698946571.854bbcebb551.1245.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd9e1cc7e014e4f67e3657d229da0f7ca382f5dbcada9fdbef088709a0a12d84
3
+ size 7249
runs/Nov02_17-35-58_854bbcebb551/events.out.tfevents.1698949334.854bbcebb551.1245.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85077192c22dbe3026a7fbee42bcc61548f17ced3a04a8ece034e7dfcf4293cf
3
+ size 346
runs/Nov06_22-37-46_6c8330291840/events.out.tfevents.1699310280.6c8330291840.588.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b782b400653e0988bc1747d1012024010b4eea4a26038e665b34d4b1b572e2bc
3
+ size 8568
runs/Nov07_18-23-11_f7861474fc09/events.out.tfevents.1699381467.f7861474fc09.1396.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5968c16e04cf84f68646abd0ef9332d506b0bb6c05d2ad1efa2060ddfb6fbe24
3
+ size 4328
runs/Nov07_19-34-48_9c10e3e529f3/events.out.tfevents.1699386111.9c10e3e529f3.294.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb0679d61d6e387b2593d82d0a4a717da3cb55cf9cb7caba1af473d6c4e1f974
3
+ size 14409
runs/Nov08_21-38-47_9b5eff9f4724/events.out.tfevents.1699479537.9b5eff9f4724.469.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4bf1b95dfbe5b38e54070bc8b416e95654ad40c57fc2afe001355b26432578d
3
+ size 14409
runs/Nov09_11-43-58_b5c41c6ea59a/events.out.tfevents.1699530251.b5c41c6ea59a.617.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bfc3160f513c8bcd8f557ca2b3909b4187de1899f527775b6293c61d3bd5a029
3
+ size 7249
runs/Nov09_19-19-27_5c95ed4ca3fd/events.out.tfevents.1699557576.5c95ed4ca3fd.4647.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6fda35cedbcf14ef83dac558c959ef8db152c38b090be6828ea225eb8a6409bd
3
+ size 14409
runs/Nov09_19-19-27_5c95ed4ca3fd/events.out.tfevents.1699562081.5c95ed4ca3fd.4647.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5ccccbac158deb3ccc012077f4077eebd4e13f699de3cb56bfd8cc7b1732519
3
+ size 411
runs/Nov09_21-15-46_5c95ed4ca3fd/events.out.tfevents.1699564560.5c95ed4ca3fd.34599.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e9bd07249897379f08895ff1c11ac032d51792693eb0e0d9ec8e1925f07704c
3
+ size 6374
runs/Nov10_22-09-26_8411bb85556b/events.out.tfevents.1699654176.8411bb85556b.629.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e04e82c9087c3669dd1604bdb9a107f4c5f70014e2db252871b2572d99fbf1b5
3
+ size 7688
runs/Nov10_22-09-26_8411bb85556b/events.out.tfevents.1699655574.8411bb85556b.629.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce7e122daaa15f8f00c536bd90490c2dba2722d4463a2018ee1cb9f4a3013466
3
+ size 411
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15a19887b5bd97a75e88c6526676a22d686e26d0833e38f0ad719b1496a74c9b
3
+ size 4536