Hugging Face's logo

addy88
/
distilroberta-base-finegrain

Text Classification
Transformers
PyTorch
TensorBoard
roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
1
addy88 commited on
Commit
75f2155
·
1 Parent(s): adfc12a

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -9
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.3577
20
- - F1: 0.9163
21
 
22
  ## Model description
23
 
@@ -43,16 +43,32 @@ The following hyperparameters were used during training:
43
  - distributed_type: multi-GPU
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
- - num_epochs: 4
47
 
48
  ### Training results
49
 
50
- | Training Loss | Epoch | Step | Validation Loss | F1 |
51
- |:-------------:|:-----:|:----:|:---------------:|:------:|
52
- | 0.4202 | 1.0 | 844 | 0.4011 | 0.9163 |
53
- | 0.3887 | 2.0 | 1688 | 0.4048 | 0.9163 |
54
- | 0.3871 | 3.0 | 2532 | 0.3380 | 0.9163 |
55
- | 0.3972 | 4.0 | 3376 | 0.3577 | 0.9163 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
56
 
57
 
58
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.3713
20
+ - F1: 0.9129
21
 
22
  ## Model description
23
 
 
43
  - distributed_type: multi-GPU
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
+ - num_epochs: 20
47
 
48
  ### Training results
49
 
50
+ | Training Loss | Epoch | Step | Validation Loss | F1 |
51
+ |:-------------:|:-----:|:-----:|:---------------:|:------:|
52
+ | 0.3944 | 1.0 | 844 | 0.3998 | 0.9163 |
53
+ | 0.3886 | 2.0 | 1688 | 0.4020 | 0.9163 |
54
+ | 0.3899 | 3.0 | 2532 | 0.3423 | 0.9163 |
55
+ | 0.4026 | 4.0 | 3376 | 0.3837 | 0.9163 |
56
+ | 0.3911 | 5.0 | 4220 | 0.3492 | 0.9163 |
57
+ | 0.3856 | 6.0 | 5064 | 0.3504 | 0.9163 |
58
+ | 0.4058 | 7.0 | 5908 | 0.3682 | 0.9163 |
59
+ | 0.4057 | 8.0 | 6752 | 0.3767 | 0.9163 |
60
+ | 0.3807 | 9.0 | 7596 | 0.3519 | 0.9163 |
61
+ | 0.394 | 10.0 | 8440 | 0.3603 | 0.9163 |
62
+ | 0.39 | 11.0 | 9284 | 0.3630 | 0.9163 |
63
+ | 0.3945 | 12.0 | 10128 | 0.3846 | 0.9163 |
64
+ | 0.3948 | 13.0 | 10972 | 0.3711 | 0.9163 |
65
+ | 0.3981 | 14.0 | 11816 | 0.3516 | 0.9163 |
66
+ | 0.4144 | 15.0 | 12660 | 0.3526 | 0.9163 |
67
+ | 0.3999 | 16.0 | 13504 | 0.3560 | 0.9163 |
68
+ | 0.376 | 17.0 | 14348 | 0.3671 | 0.9163 |
69
+ | 0.412 | 18.0 | 15192 | 0.3630 | 0.9163 |
70
+ | 0.389 | 19.0 | 16036 | 0.3669 | 0.9136 |
71
+ | 0.374 | 20.0 | 16880 | 0.3713 | 0.9129 |
72
 
73
 
74
  ### Framework versions