Hugging Face's logo

stulcrad
/
CNEC2_0_Supertypes_xlm-roberta-large

Token Classification
Transformers
TensorBoard
Safetensors
xlm-roberta
Generated from Trainer
Eval Results
Inference Endpoints
Model card Files Metrics Community
stulcrad commited on
Commit
0310483
•
1 Parent(s): 4dfc7fd

Model save

Browse files
Files changed (2) hide show
  1. README.md +36 -23
  2. runs/Mar05_23-55-41_n21/events.out.tfevents.1709679343.n21.2238827.1 +2 -2
README.md CHANGED
@@ -25,16 +25,16 @@ model-index:
25
  metrics:
26
  - name: Precision
27
  type: precision
28
- value: 0.8359161349134002
29
  - name: Recall
30
  type: recall
31
- value: 0.8851351351351351
32
  - name: F1
33
  type: f1
34
- value: 0.8598218471636193
35
  - name: Accuracy
36
  type: accuracy
37
- value: 0.9700420107199769
38
  ---
39
 
40
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -44,11 +44,11 @@ should probably proofread and complete it, then remove this comment. -->
44
 
45
  This model is a fine-tuned version of [FacebookAI/xlm-roberta-large](https://huggingface.co/FacebookAI/xlm-roberta-large) on the cnec dataset.
46
  It achieves the following results on the evaluation set:
47
- - Loss: 0.1918
48
- - Precision: 0.8359
49
- - Recall: 0.8851
50
- - F1: 0.8598
51
- - Accuracy: 0.9700
52
 
53
  ## Model description
54
 
@@ -68,26 +68,39 @@ More information needed
68
 
69
  The following hyperparameters were used during training:
70
  - learning_rate: 2e-05
71
- - train_batch_size: 32
72
- - eval_batch_size: 32
73
  - seed: 42
74
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
75
  - lr_scheduler_type: linear
76
- - num_epochs: 20
77
 
78
  ### Training results
79
 
80
- | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
81
- |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
82
- | 0.2903 | 2.22 | 500 | 0.1438 | 0.7586 | 0.8417 | 0.7980 | 0.9626 |
83
- | 0.1147 | 4.44 | 1000 | 0.1401 | 0.7866 | 0.8629 | 0.8230 | 0.9660 |
84
- | 0.0796 | 6.67 | 1500 | 0.1402 | 0.7956 | 0.8755 | 0.8336 | 0.9677 |
85
- | 0.0561 | 8.89 | 2000 | 0.1419 | 0.8094 | 0.8793 | 0.8429 | 0.9700 |
86
- | 0.0416 | 11.11 | 2500 | 0.1562 | 0.8271 | 0.8793 | 0.8524 | 0.9687 |
87
- | 0.0306 | 13.33 | 3000 | 0.1761 | 0.8309 | 0.8890 | 0.8589 | 0.9702 |
88
- | 0.0233 | 15.56 | 3500 | 0.1785 | 0.8332 | 0.8798 | 0.8559 | 0.9701 |
89
- | 0.0188 | 17.78 | 4000 | 0.1875 | 0.8362 | 0.8847 | 0.8598 | 0.9694 |
90
- | 0.015 | 20.0 | 4500 | 0.1918 | 0.8359 | 0.8851 | 0.8598 | 0.9700 |
 
 
 
 
 
 
 
 
 
 
 
 
 
91
 
92
 
93
  ### Framework versions
 
25
  metrics:
26
  - name: Precision
27
  type: precision
28
+ value: 0.8427382053654024
29
  - name: Recall
30
  type: recall
31
+ value: 0.8793436293436293
32
  - name: F1
33
  type: f1
34
+ value: 0.8606518658478979
35
  - name: Accuracy
36
  type: accuracy
37
+ value: 0.9671736925974214
38
  ---
39
 
40
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
44
 
45
  This model is a fine-tuned version of [FacebookAI/xlm-roberta-large](https://huggingface.co/FacebookAI/xlm-roberta-large) on the cnec dataset.
46
  It achieves the following results on the evaluation set:
47
+ - Loss: 0.2674
48
+ - Precision: 0.8427
49
+ - Recall: 0.8793
50
+ - F1: 0.8607
51
+ - Accuracy: 0.9672
52
 
53
  ## Model description
54
 
 
68
 
69
  The following hyperparameters were used during training:
70
  - learning_rate: 2e-05
71
+ - train_batch_size: 16
72
+ - eval_batch_size: 16
73
  - seed: 42
74
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
75
  - lr_scheduler_type: linear
76
+ - num_epochs: 25
77
 
78
  ### Training results
79
 
80
+ | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
81
+ |:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:------:|:--------:|
82
+ | 0.5221 | 1.11 | 500 | 0.1718 | 0.6648 | 0.8012 | 0.7266 | 0.9535 |
83
+ | 0.1777 | 2.22 | 1000 | 0.1397 | 0.7499 | 0.8393 | 0.7921 | 0.9627 |
84
+ | 0.1321 | 3.33 | 1500 | 0.1383 | 0.7760 | 0.8711 | 0.8208 | 0.9655 |
85
+ | 0.1132 | 4.44 | 2000 | 0.1456 | 0.7646 | 0.8542 | 0.8069 | 0.9636 |
86
+ | 0.1008 | 5.56 | 2500 | 0.1442 | 0.7750 | 0.8692 | 0.8194 | 0.9648 |
87
+ | 0.0782 | 6.67 | 3000 | 0.1516 | 0.8107 | 0.8663 | 0.8376 | 0.9657 |
88
+ | 0.0692 | 7.78 | 3500 | 0.1690 | 0.8023 | 0.8620 | 0.8311 | 0.9660 |
89
+ | 0.0582 | 8.89 | 4000 | 0.1591 | 0.8125 | 0.8847 | 0.8470 | 0.9672 |
90
+ | 0.0511 | 10.0 | 4500 | 0.1813 | 0.8033 | 0.8832 | 0.8414 | 0.9661 |
91
+ | 0.0432 | 11.11 | 5000 | 0.1833 | 0.8231 | 0.8822 | 0.8516 | 0.9669 |
92
+ | 0.0381 | 12.22 | 5500 | 0.2097 | 0.8062 | 0.8634 | 0.8338 | 0.9659 |
93
+ | 0.0328 | 13.33 | 6000 | 0.2043 | 0.8026 | 0.8711 | 0.8355 | 0.9661 |
94
+ | 0.0292 | 14.44 | 6500 | 0.2217 | 0.8255 | 0.8769 | 0.8505 | 0.9669 |
95
+ | 0.0247 | 15.56 | 7000 | 0.2411 | 0.8297 | 0.8745 | 0.8515 | 0.9667 |
96
+ | 0.0206 | 16.67 | 7500 | 0.2425 | 0.8255 | 0.8764 | 0.8502 | 0.9663 |
97
+ | 0.0184 | 17.78 | 8000 | 0.2405 | 0.8329 | 0.8586 | 0.8455 | 0.9668 |
98
+ | 0.0157 | 18.89 | 8500 | 0.2521 | 0.8314 | 0.8832 | 0.8565 | 0.9677 |
99
+ | 0.0134 | 20.0 | 9000 | 0.2504 | 0.8349 | 0.8764 | 0.8552 | 0.9671 |
100
+ | 0.0116 | 21.11 | 9500 | 0.2570 | 0.8344 | 0.8779 | 0.8556 | 0.9678 |
101
+ | 0.0109 | 22.22 | 10000 | 0.2570 | 0.8320 | 0.8793 | 0.8550 | 0.9677 |
102
+ | 0.0093 | 23.33 | 10500 | 0.2639 | 0.8373 | 0.8793 | 0.8578 | 0.9674 |
103
+ | 0.0086 | 24.44 | 11000 | 0.2674 | 0.8427 | 0.8793 | 0.8607 | 0.9672 |
104
 
105
 
106
  ### Framework versions
runs/Mar05_23-55-41_n21/events.out.tfevents.1709679343.n21.2238827.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e53e3351e0cd1d5b8a878a22ae0a5d183036a0cce611103ef5ec49094a64c3d1
3
- size 18820
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b7a2ada3aef5bb4521de23f5ddbe5e98fd3a305a286205a77c14ed9b53d24b5
3
+ size 19174