Hugging Face's logo

jysssacc
/
roberta-base_PrefixTuning_lr5e-05_bs4_epoch20_wd0.01

PEFT
Safetensors
Generated from Trainer
Model card Files Community
jysssacc commited on
Commit
443b2bc
•
1 Parent(s): ecc8978

End of training

Browse files
Files changed (2) hide show
  1. README.md +21 -21
  2. adapter_model.safetensors +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 14.8306
20
 
21
  ## Model description
22
 
@@ -48,26 +48,26 @@ The following hyperparameters were used during training:
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
- | 15.235 | 1.0 | 157 | 20.7652 |
52
- | 14.9119 | 2.0 | 314 | 20.6532 |
53
- | 14.909 | 3.0 | 471 | 20.4567 |
54
- | 14.5468 | 4.0 | 628 | 20.1871 |
55
- | 13.941 | 5.0 | 785 | 19.9154 |
56
- | 13.176 | 6.0 | 942 | 19.6207 |
57
- | 12.9805 | 7.0 | 1099 | 19.2918 |
58
- | 12.4231 | 8.0 | 1256 | 18.8852 |
59
- | 11.8273 | 9.0 | 1413 | 18.4282 |
60
- | 11.6991 | 10.0 | 1570 | 17.9415 |
61
- | 11.227 | 11.0 | 1727 | 17.5004 |
62
- | 10.9029 | 12.0 | 1884 | 17.0798 |
63
- | 10.5759 | 13.0 | 2041 | 16.6434 |
64
- | 10.8651 | 14.0 | 2198 | 16.2280 |
65
- | 10.3505 | 15.0 | 2355 | 15.8335 |
66
- | 10.2129 | 16.0 | 2512 | 15.5030 |
67
- | 9.9004 | 17.0 | 2669 | 15.2226 |
68
- | 9.8744 | 18.0 | 2826 | 15.0080 |
69
- | 9.8198 | 19.0 | 2983 | 14.8749 |
70
- | 9.8549 | 20.0 | 3140 | 14.8306 |
71
 
72
 
73
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 14.4579
20
 
21
  ## Model description
22
 
 
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
+ | 15.4862 | 1.0 | 157 | 20.8478 |
52
+ | 14.9721 | 2.0 | 314 | 20.7345 |
53
+ | 15.0553 | 3.0 | 471 | 20.5177 |
54
+ | 14.4627 | 4.0 | 628 | 20.2344 |
55
+ | 14.0788 | 5.0 | 785 | 19.9480 |
56
+ | 13.2092 | 6.0 | 942 | 19.6334 |
57
+ | 13.0141 | 7.0 | 1099 | 19.2349 |
58
+ | 12.5052 | 8.0 | 1256 | 18.7395 |
59
+ | 11.8852 | 9.0 | 1413 | 18.2110 |
60
+ | 11.889 | 10.0 | 1570 | 17.7415 |
61
+ | 11.2937 | 11.0 | 1727 | 17.3058 |
62
+ | 11.0163 | 12.0 | 1884 | 16.8580 |
63
+ | 10.8939 | 13.0 | 2041 | 16.3684 |
64
+ | 10.8183 | 14.0 | 2198 | 15.9196 |
65
+ | 10.353 | 15.0 | 2355 | 15.5043 |
66
+ | 10.1386 | 16.0 | 2512 | 15.1272 |
67
+ | 9.9726 | 17.0 | 2669 | 14.8365 |
68
+ | 9.8421 | 18.0 | 2826 | 14.6183 |
69
+ | 9.9193 | 19.0 | 2983 | 14.4978 |
70
+ | 9.848 | 20.0 | 3140 | 14.4579 |
71
 
72
 
73
  ### Framework versions
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cc9ea40aa815c6fadf25e7b1e8276e046cb9f97601495ca2c5ece98a9762b69c
3
  size 737408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6687ca5cff822d20e7bdbe87ee989f25bbea45de7b3e9cae5e1fe536938304a6
3
  size 737408