Hugging Face's logo

ldos
/
text_shortening_model_v80

Text2Text Generation
Transformers
PyTorch
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Community
1
ldos commited on
Commit
f8d409c
•
1 Parent(s): 0ea09e3

End of training

Browse files
Files changed (3) hide show
  1. README.md +89 -0
  2. generation_config.json +6 -0
  3. pytorch_model.bin +1 -1
README.md ADDED
@@ -0,0 +1,89 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: t5-base
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: text_shortening_model_v80
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # text_shortening_model_v80
15
+
16
+ This model is a fine-tuned version of [t5-base](https://huggingface.co/t5-base) on the None dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 1.1772
19
+ - Bert precision: 0.8996
20
+ - Bert recall: 0.9009
21
+ - Bert f1-score: 0.8998
22
+ - Average word count: 6.8393
23
+ - Max word count: 16
24
+ - Min word count: 3
25
+ - Average token count: 11.092
26
+ - % shortened texts with length > 12: 0.9816
27
+
28
+ ## Model description
29
+
30
+ More information needed
31
+
32
+ ## Intended uses & limitations
33
+
34
+ More information needed
35
+
36
+ ## Training and evaluation data
37
+
38
+ More information needed
39
+
40
+ ## Training procedure
41
+
42
+ ### Training hyperparameters
43
+
44
+ The following hyperparameters were used during training:
45
+ - learning_rate: 0.0001
46
+ - train_batch_size: 64
47
+ - eval_batch_size: 64
48
+ - seed: 42
49
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
+ - lr_scheduler_type: linear
51
+ - num_epochs: 25
52
+
53
+ ### Training results
54
+
55
+ | Training Loss | Epoch | Step | Validation Loss | Bert precision | Bert recall | Bert f1-score | Average word count | Max word count | Min word count | Average token count | % shortened texts with length > 12 |
56
+ |:-------------:|:-----:|:----:|:---------------:|:--------------:|:-----------:|:-------------:|:------------------:|:--------------:|:--------------:|:-------------------:|:----------------------------------:|
57
+ | 1.3549 | 1.0 | 30 | 1.0184 | 0.8861 | 0.887 | 0.886 | 7.016 | 18 | 2 | 11.2061 | 2.6994 |
58
+ | 0.9772 | 2.0 | 60 | 0.9395 | 0.889 | 0.8903 | 0.8892 | 6.9436 | 16 | 2 | 11.1276 | 1.8405 |
59
+ | 0.8398 | 3.0 | 90 | 0.9211 | 0.8904 | 0.8916 | 0.8906 | 6.9534 | 16 | 2 | 11.119 | 2.3313 |
60
+ | 0.7412 | 4.0 | 120 | 0.9235 | 0.8926 | 0.8945 | 0.8931 | 6.9239 | 16 | 2 | 11.1926 | 1.5951 |
61
+ | 0.6652 | 5.0 | 150 | 0.9173 | 0.8936 | 0.8968 | 0.8947 | 7.0442 | 16 | 3 | 11.4135 | 1.5951 |
62
+ | 0.5992 | 6.0 | 180 | 0.9270 | 0.8962 | 0.8982 | 0.8968 | 6.9485 | 16 | 3 | 11.2209 | 1.8405 |
63
+ | 0.5381 | 7.0 | 210 | 0.9565 | 0.8948 | 0.8962 | 0.8951 | 6.8209 | 16 | 2 | 11.1043 | 1.3497 |
64
+ | 0.4899 | 8.0 | 240 | 0.9812 | 0.8956 | 0.8984 | 0.8966 | 7.0098 | 16 | 2 | 11.2282 | 1.9632 |
65
+ | 0.4528 | 9.0 | 270 | 0.9842 | 0.8954 | 0.8979 | 0.8962 | 6.9791 | 16 | 3 | 11.2773 | 1.7178 |
66
+ | 0.4233 | 10.0 | 300 | 1.0057 | 0.897 | 0.8977 | 0.8969 | 6.8294 | 16 | 2 | 11.0589 | 1.5951 |
67
+ | 0.3971 | 11.0 | 330 | 1.0276 | 0.8967 | 0.8976 | 0.8967 | 6.8761 | 16 | 2 | 11.1411 | 1.1043 |
68
+ | 0.3713 | 12.0 | 360 | 1.0316 | 0.8962 | 0.8958 | 0.8955 | 6.7583 | 16 | 2 | 10.9816 | 1.1043 |
69
+ | 0.3428 | 13.0 | 390 | 1.0775 | 0.898 | 0.8982 | 0.8977 | 6.838 | 16 | 2 | 11.092 | 1.1043 |
70
+ | 0.3256 | 14.0 | 420 | 1.0831 | 0.8987 | 0.8993 | 0.8985 | 6.8552 | 16 | 2 | 11.1141 | 1.227 |
71
+ | 0.3116 | 15.0 | 450 | 1.0982 | 0.8979 | 0.899 | 0.898 | 6.8638 | 16 | 2 | 11.119 | 1.1043 |
72
+ | 0.2958 | 16.0 | 480 | 1.1273 | 0.8965 | 0.8991 | 0.8974 | 6.9546 | 16 | 3 | 11.238 | 1.5951 |
73
+ | 0.2838 | 17.0 | 510 | 1.1205 | 0.8984 | 0.9003 | 0.8989 | 6.9583 | 16 | 3 | 11.227 | 1.4724 |
74
+ | 0.2683 | 18.0 | 540 | 1.1435 | 0.8978 | 0.8991 | 0.898 | 6.8847 | 16 | 2 | 11.1178 | 1.227 |
75
+ | 0.2594 | 19.0 | 570 | 1.1495 | 0.899 | 0.8986 | 0.8983 | 6.7939 | 16 | 2 | 11.0307 | 0.8589 |
76
+ | 0.2522 | 20.0 | 600 | 1.1621 | 0.8993 | 0.8992 | 0.8988 | 6.7767 | 16 | 3 | 11.0294 | 0.7362 |
77
+ | 0.2457 | 21.0 | 630 | 1.1693 | 0.8991 | 0.9017 | 0.9 | 6.9006 | 16 | 3 | 11.2 | 0.9816 |
78
+ | 0.2442 | 22.0 | 660 | 1.1728 | 0.8986 | 0.9008 | 0.8992 | 6.8773 | 16 | 3 | 11.1644 | 0.9816 |
79
+ | 0.235 | 23.0 | 690 | 1.1740 | 0.8986 | 0.9002 | 0.899 | 6.8564 | 16 | 3 | 11.1178 | 0.9816 |
80
+ | 0.2319 | 24.0 | 720 | 1.1751 | 0.8995 | 0.9008 | 0.8997 | 6.8417 | 16 | 3 | 11.0908 | 0.9816 |
81
+ | 0.2315 | 25.0 | 750 | 1.1772 | 0.8996 | 0.9009 | 0.8998 | 6.8393 | 16 | 3 | 11.092 | 0.9816 |
82
+
83
+
84
+ ### Framework versions
85
+
86
+ - Transformers 4.33.1
87
+ - Pytorch 2.0.1+cu118
88
+ - Datasets 2.14.5
89
+ - Tokenizers 0.13.3
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "decoder_start_token_id": 0,
3
+ "eos_token_id": 1,
4
+ "pad_token_id": 0,
5
+ "transformers_version": "4.33.1"
6
+ }
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e172a37ec3fb81c8e984ab7309d244676a9f168068b468419775a0aa0cbb6f1d
3
  size 891702929
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29ddc36c6bf5836667c915b93592f6b5e7c916f1b2ae13864979eacee3fc0885
3
  size 891702929