Hugging Face's logo

zera09
/
Word-selector

TensorBoard
Safetensors
longt5
Generated from Trainer
Model card Files Metrics Community
zera09 commited on
Commit
24bee52
•
1 Parent(s): 6890e73

End of training

Browse files
Files changed (2) hide show
  1. README.md +39 -29
  2. runs/Oct21_15-08-41_user/events.out.tfevents.1729503522.user.1869720.0 +2 -2
README.md CHANGED
@@ -17,12 +17,12 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [google/long-t5-tglobal-base](https://huggingface.co/google/long-t5-tglobal-base) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 2.1303
21
- - Rouge1: 0.3216
22
- - Rouge2: 0.0621
23
- - Rougel: 0.2469
24
- - Rougelsum: 0.2469
25
- - Gen Len: 48.8488
26
 
27
  ## Model description
28
 
@@ -47,32 +47,42 @@ The following hyperparameters were used during training:
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
- - num_epochs: 20
51
 
52
  ### Training results
53
 
54
- | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
55
- |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
56
- | No log | 1.0 | 400 | 2.2490 | 0.1594 | 0.0161 | 0.1319 | 0.1321 | 69.2094 |
57
- | 2.7083 | 2.0 | 800 | 2.1665 | 0.2025 | 0.0287 | 0.1648 | 0.1647 | 69.5888 |
58
- | 2.369 | 3.0 | 1200 | 2.1296 | 0.2381 | 0.0344 | 0.1878 | 0.1878 | 57.9775 |
59
- | 2.2185 | 4.0 | 1600 | 2.0890 | 0.2525 | 0.0399 | 0.1986 | 0.1984 | 60.2588 |
60
- | 2.1014 | 5.0 | 2000 | 2.0731 | 0.2795 | 0.0484 | 0.2199 | 0.2199 | 49.5737 |
61
- | 2.1014 | 6.0 | 2400 | 2.0601 | 0.2862 | 0.0525 | 0.2249 | 0.2246 | 54.4206 |
62
- | 1.9992 | 7.0 | 2800 | 2.0592 | 0.3004 | 0.0533 | 0.2351 | 0.2351 | 49.9325 |
63
- | 1.9232 | 8.0 | 3200 | 2.0529 | 0.3033 | 0.0558 | 0.2366 | 0.2368 | 49.8744 |
64
- | 1.8534 | 9.0 | 3600 | 2.0600 | 0.3024 | 0.0573 | 0.2366 | 0.2366 | 50.355 |
65
- | 1.795 | 10.0 | 4000 | 2.0715 | 0.3082 | 0.0561 | 0.2392 | 0.2392 | 47.2162 |
66
- | 1.795 | 11.0 | 4400 | 2.0657 | 0.3137 | 0.0595 | 0.2437 | 0.2439 | 50.3438 |
67
- | 1.73 | 12.0 | 4800 | 2.0759 | 0.3142 | 0.0597 | 0.2434 | 0.2433 | 51.1619 |
68
- | 1.6844 | 13.0 | 5200 | 2.0818 | 0.3172 | 0.0605 | 0.2458 | 0.2458 | 48.9956 |
69
- | 1.6398 | 14.0 | 5600 | 2.0942 | 0.3149 | 0.0599 | 0.2428 | 0.243 | 47.3812 |
70
- | 1.6063 | 15.0 | 6000 | 2.1047 | 0.3171 | 0.0609 | 0.243 | 0.243 | 51.685 |
71
- | 1.6063 | 16.0 | 6400 | 2.1095 | 0.3234 | 0.0622 | 0.248 | 0.248 | 50.1588 |
72
- | 1.5659 | 17.0 | 6800 | 2.1180 | 0.3212 | 0.0627 | 0.2479 | 0.2478 | 49.0894 |
73
- | 1.5456 | 18.0 | 7200 | 2.1212 | 0.3208 | 0.0616 | 0.2455 | 0.2456 | 48.8688 |
74
- | 1.5177 | 19.0 | 7600 | 2.1275 | 0.3214 | 0.0628 | 0.2467 | 0.2467 | 48.4125 |
75
- | 1.5161 | 20.0 | 8000 | 2.1303 | 0.3216 | 0.0621 | 0.2469 | 0.2469 | 48.8488 |
 
 
 
 
 
 
 
 
 
 
76
 
77
 
78
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [google/long-t5-tglobal-base](https://huggingface.co/google/long-t5-tglobal-base) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 4.5118
21
+ - Rouge1: 0.3547
22
+ - Rouge2: 0.0761
23
+ - Rougel: 0.2663
24
+ - Rougelsum: 0.2667
25
+ - Gen Len: 25.195
26
 
27
  ## Model description
28
 
 
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
+ - num_epochs: 30
51
 
52
  ### Training results
53
 
54
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
55
+ |:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
56
+ | No log | 1.0 | 400 | 3.9221 | 0.2104 | 0.0295 | 0.1684 | 0.1684 | 34.3531 |
57
+ | 4.5051 | 2.0 | 800 | 3.7571 | 0.285 | 0.0449 | 0.2195 | 0.2197 | 20.2419 |
58
+ | 3.9507 | 3.0 | 1200 | 3.6847 | 0.2976 | 0.0513 | 0.2309 | 0.2311 | 22.7119 |
59
+ | 3.6575 | 4.0 | 1600 | 3.6350 | 0.3137 | 0.0595 | 0.2411 | 0.2411 | 25.9231 |
60
+ | 3.4177 | 5.0 | 2000 | 3.6229 | 0.3311 | 0.0636 | 0.2527 | 0.2527 | 22.3788 |
61
+ | 3.4177 | 6.0 | 2400 | 3.6223 | 0.3359 | 0.0658 | 0.254 | 0.2543 | 21.2994 |
62
+ | 3.1741 | 7.0 | 2800 | 3.6313 | 0.3453 | 0.0674 | 0.2617 | 0.2618 | 21.9181 |
63
+ | 3.013 | 8.0 | 3200 | 3.6278 | 0.3453 | 0.0689 | 0.2649 | 0.2651 | 22.93 |
64
+ | 2.8253 | 9.0 | 3600 | 3.6755 | 0.3511 | 0.0705 | 0.2658 | 0.2662 | 23.1806 |
65
+ | 2.6705 | 10.0 | 4000 | 3.7081 | 0.3509 | 0.0742 | 0.2663 | 0.2664 | 22.5356 |
66
+ | 2.6705 | 11.0 | 4400 | 3.7424 | 0.3528 | 0.0716 | 0.264 | 0.2643 | 23.3775 |
67
+ | 2.5081 | 12.0 | 4800 | 3.8135 | 0.3553 | 0.0753 | 0.2686 | 0.2686 | 22.985 |
68
+ | 2.3745 | 13.0 | 5200 | 3.8369 | 0.3548 | 0.0753 | 0.2671 | 0.2675 | 23.7719 |
69
+ | 2.2399 | 14.0 | 5600 | 3.8816 | 0.3591 | 0.0762 | 0.2708 | 0.2709 | 23.1612 |
70
+ | 2.1414 | 15.0 | 6000 | 3.9132 | 0.361 | 0.0781 | 0.2719 | 0.2721 | 24.4581 |
71
+ | 2.1414 | 16.0 | 6400 | 3.9946 | 0.3579 | 0.077 | 0.2715 | 0.2714 | 23.2131 |
72
+ | 2.0099 | 17.0 | 6800 | 4.0376 | 0.3595 | 0.0766 | 0.2701 | 0.2703 | 23.6681 |
73
+ | 1.9252 | 18.0 | 7200 | 4.0829 | 0.3576 | 0.0774 | 0.2691 | 0.2694 | 23.79 |
74
+ | 1.8406 | 19.0 | 7600 | 4.1218 | 0.3613 | 0.0776 | 0.2718 | 0.272 | 23.9888 |
75
+ | 1.7602 | 20.0 | 8000 | 4.1754 | 0.3588 | 0.0787 | 0.2702 | 0.2704 | 24.5425 |
76
+ | 1.7602 | 21.0 | 8400 | 4.2440 | 0.3602 | 0.0769 | 0.2716 | 0.2717 | 24.9531 |
77
+ | 1.6725 | 22.0 | 8800 | 4.2860 | 0.3581 | 0.0775 | 0.2688 | 0.2691 | 24.6638 |
78
+ | 1.6036 | 23.0 | 9200 | 4.3163 | 0.3582 | 0.0764 | 0.2697 | 0.27 | 24.5994 |
79
+ | 1.5572 | 24.0 | 9600 | 4.3655 | 0.3545 | 0.0749 | 0.2655 | 0.2658 | 25.145 |
80
+ | 1.5034 | 25.0 | 10000 | 4.3811 | 0.3583 | 0.0781 | 0.2695 | 0.2698 | 25.6856 |
81
+ | 1.5034 | 26.0 | 10400 | 4.4350 | 0.3593 | 0.0788 | 0.2691 | 0.2692 | 25.2394 |
82
+ | 1.4617 | 27.0 | 10800 | 4.4539 | 0.357 | 0.078 | 0.2686 | 0.269 | 25.2906 |
83
+ | 1.4175 | 28.0 | 11200 | 4.4785 | 0.3549 | 0.0757 | 0.2657 | 0.2661 | 25.62 |
84
+ | 1.3971 | 29.0 | 11600 | 4.5061 | 0.3567 | 0.0767 | 0.2661 | 0.2665 | 25.1988 |
85
+ | 1.3828 | 30.0 | 12000 | 4.5118 | 0.3547 | 0.0761 | 0.2663 | 0.2667 | 25.195 |
86
 
87
 
88
  ### Framework versions
runs/Oct21_15-08-41_user/events.out.tfevents.1729503522.user.1869720.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bf6e1061f066a34b4166a6e016014cf4db1ca1a346e3bb0df76600a93969701a
3
- size 23751
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ac0b18c5c658df1e962382fb3ea9ec6d938fd3bbabf76cf545e5d7ea57763b1
3
+ size 24630