MHGanainy commited on
Commit
766adef
1 Parent(s): 9627892

Model save

Browse files
Files changed (1) hide show
  1. README.md +7 -11
README.md CHANGED
@@ -16,9 +16,9 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.1732
20
- - Macro-f1: 0.0
21
- - Micro-f1: 0.0
22
 
23
  ## Model description
24
 
@@ -38,13 +38,9 @@ More information needed
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 3e-05
41
- - train_batch_size: 128
42
- - eval_batch_size: 128
43
  - seed: 1
44
- - distributed_type: multi-GPU
45
- - num_devices: 2
46
- - total_train_batch_size: 256
47
- - total_eval_batch_size: 256
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
  - num_epochs: 2.0
@@ -54,8 +50,8 @@ The following hyperparameters were used during training:
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Macro-f1 | Micro-f1 |
56
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|
57
- | No log | 1.0 | 215 | 0.1769 | 0.0 | 0.0 |
58
- | No log | 2.0 | 430 | 0.1732 | 0.0 | 0.0 |
59
 
60
 
61
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.0744
20
+ - Macro-f1: 0.3551
21
+ - Micro-f1: 0.7166
22
 
23
  ## Model description
24
 
 
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 3e-05
41
+ - train_batch_size: 16
42
+ - eval_batch_size: 16
43
  - seed: 1
 
 
 
 
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
  - num_epochs: 2.0
 
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Macro-f1 | Micro-f1 |
52
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|
53
+ | 0.0758 | 1.0 | 3438 | 0.0814 | 0.2964 | 0.6862 |
54
+ | 0.0618 | 2.0 | 6876 | 0.0744 | 0.3551 | 0.7166 |
55
 
56
 
57
  ### Framework versions