Ahmed235 commited on
Commit
56607e4
1 Parent(s): 4f92ebb

End of training

Browse files
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google-t5/t5-small
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: t5_summarize
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # t5_summarize
15
+
16
+ This model is a fine-tuned version of [google-t5/t5-small](https://huggingface.co/google-t5/t5-small) on the None dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 2.6492
19
+ - Evaluation Runtime: 28.4792
20
+ - Rounded Rouge Scores: {'rouge1': 0.174, 'rouge2': 0.0607, 'rougeL': 0.1367, 'rougeLsum': 0.1369}
21
+
22
+ ## Model description
23
+
24
+ More information needed
25
+
26
+ ## Intended uses & limitations
27
+
28
+ More information needed
29
+
30
+ ## Training and evaluation data
31
+
32
+ More information needed
33
+
34
+ ## Training procedure
35
+
36
+ ### Training hyperparameters
37
+
38
+ The following hyperparameters were used during training:
39
+ - learning_rate: 2e-05
40
+ - train_batch_size: 4
41
+ - eval_batch_size: 4
42
+ - seed: 42
43
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
+ - lr_scheduler_type: linear
45
+ - num_epochs: 10
46
+ - mixed_precision_training: Native AMP
47
+
48
+ ### Training results
49
+
50
+ | Training Loss | Epoch | Step | Validation Loss | Evaluation Runtime | Rounded Rouge Scores |
51
+ |:-------------:|:-----:|:----:|:---------------:|:------------------:|:---------------------------------------------------------------------------:|
52
+ | 2.7245 | 1.0 | 500 | 2.6814 | 29.2864 | {'rouge1': 0.1697, 'rouge2': 0.0584, 'rougeL': 0.1344, 'rougeLsum': 0.1345} |
53
+ | 2.7318 | 2.0 | 1000 | 2.6707 | 27.6464 | {'rouge1': 0.1735, 'rouge2': 0.0597, 'rougeL': 0.1372, 'rougeLsum': 0.1373} |
54
+ | 2.7164 | 3.0 | 1500 | 2.6646 | 27.3926 | {'rouge1': 0.1734, 'rouge2': 0.06, 'rougeL': 0.1371, 'rougeLsum': 0.1372} |
55
+ | 2.7054 | 4.0 | 2000 | 2.6600 | 27.3819 | {'rouge1': 0.1739, 'rouge2': 0.0599, 'rougeL': 0.1367, 'rougeLsum': 0.1368} |
56
+ | 2.6955 | 5.0 | 2500 | 2.6581 | 27.9933 | {'rouge1': 0.1731, 'rouge2': 0.0601, 'rougeL': 0.1361, 'rougeLsum': 0.1361} |
57
+ | 2.6865 | 6.0 | 3000 | 2.6535 | 28.2157 | {'rouge1': 0.1733, 'rouge2': 0.0603, 'rougeL': 0.1363, 'rougeLsum': 0.1364} |
58
+ | 2.6821 | 7.0 | 3500 | 2.6521 | 29.0758 | {'rouge1': 0.174, 'rouge2': 0.0606, 'rougeL': 0.1366, 'rougeLsum': 0.1369} |
59
+ | 2.681 | 8.0 | 4000 | 2.6508 | 31.2621 | {'rouge1': 0.1743, 'rouge2': 0.0609, 'rougeL': 0.1367, 'rougeLsum': 0.1369} |
60
+ | 2.6771 | 9.0 | 4500 | 2.6499 | 30.4251 | {'rouge1': 0.1735, 'rouge2': 0.0605, 'rougeL': 0.1364, 'rougeLsum': 0.1365} |
61
+ | 2.6751 | 10.0 | 5000 | 2.6492 | 28.4792 | {'rouge1': 0.174, 'rouge2': 0.0607, 'rougeL': 0.1367, 'rougeLsum': 0.1369} |
62
+
63
+
64
+ ### Framework versions
65
+
66
+ - Transformers 4.38.2
67
+ - Pytorch 2.2.1+cu121
68
+ - Datasets 2.18.0
69
+ - Tokenizers 0.15.2
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "decoder_start_token_id": 0,
3
+ "eos_token_id": 1,
4
+ "pad_token_id": 0,
5
+ "transformers_version": "4.38.2"
6
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2053bb40bbdaadac23017c782c6443ebac23bcaa5174e591ea47ec4819acb7c5
3
  size 242041896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d5eee5f2f52888440a8819b5f8c109ccbf2e5cf1552433605a5ea7a6fe0857e
3
  size 242041896
runs/Mar15_22-39-19_2df0342b555b/events.out.tfevents.1710542360.2df0342b555b.2026.2 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bcbec9ca94f89cede8605cdaaa7d06c193da55f9715223dff3518679ef5c1690
3
- size 9408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:399b78dac962c958e5a5959d999d1d124c5028d5044c4f80b1953bee9d35cd5d
3
+ size 11394