End of training

README.md

@@ -0,0 +1,88 @@
+---
+license: apache-2.0
+base_model: t5-base
+tags:
+- generated_from_trainer
+metrics:
+- rouge
+model-index:
+- name: t5-fine-tuned-with-25-yake-keywords
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# t5-fine-tuned-with-25-yake-keywords
+
+This model is a fine-tuned version of [t5-base](https://huggingface.co/t5-base) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.7255
+- Rouge1: 25.5557
+- Rouge2: 11.1446
+- Rougel: 20.7482
+- Rougelsum: 24.0749
+- Gen Len: 19.0
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 2
+- eval_batch_size: 2
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 25
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Gen Len |
+|:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
+| 1.3097        | 1.0   | 604   | 1.3789          | 25.4996 | 11.1787 | 20.8197 | 23.9248   | 19.0    |
+| 1.1951        | 2.0   | 1208  | 1.3779          | 25.3276 | 11.2651 | 20.6966 | 23.6966   | 19.0    |
+| 1.1081        | 3.0   | 1812  | 1.3903          | 26.1128 | 11.8339 | 21.2543 | 24.5472   | 18.994  |
+| 1.0272        | 4.0   | 2416  | 1.4042          | 26.0231 | 11.5574 | 21.152  | 24.3645   | 18.992  |
+| 0.919         | 5.0   | 3020  | 1.4225          | 25.8646 | 11.6121 | 21.0205 | 24.3016   | 18.992  |
+| 0.8643        | 6.0   | 3624  | 1.4410          | 25.9734 | 11.6221 | 21.0577 | 24.4231   | 18.99   |
+| 0.8215        | 7.0   | 4228  | 1.4599          | 25.6546 | 11.2999 | 20.8896 | 24.2294   | 19.0    |
+| 0.7931        | 8.0   | 4832  | 1.4926          | 25.0796 | 10.9369 | 20.3639 | 23.629    | 19.0    |
+| 0.7664        | 9.0   | 5436  | 1.5090          | 25.4341 | 11.0028 | 20.6241 | 23.9038   | 19.0    |
+| 0.7053        | 10.0  | 6040  | 1.5259          | 25.491  | 10.8959 | 20.5515 | 23.934    | 18.998  |
+| 0.6725        | 11.0  | 6644  | 1.5481          | 25.3073 | 10.7089 | 20.4993 | 23.8286   | 19.0    |
+| 0.6462        | 12.0  | 7248  | 1.5710          | 25.6276 | 11.0744 | 20.7313 | 24.1134   | 19.0    |
+| 0.6275        | 13.0  | 7852  | 1.5884          | 25.8615 | 11.0844 | 20.9412 | 24.2996   | 19.0    |
+| 0.5838        | 14.0  | 8456  | 1.6131          | 26.1201 | 11.4081 | 21.3173 | 24.6139   | 19.0    |
+| 0.5682        | 15.0  | 9060  | 1.6259          | 25.7212 | 11.1367 | 20.8247 | 24.1398   | 19.0    |
+| 0.5629        | 16.0  | 9664  | 1.6473          | 25.6506 | 11.2149 | 20.8629 | 24.1527   | 19.0    |
+| 0.5446        | 17.0  | 10268 | 1.6645          | 25.4396 | 10.7189 | 20.4852 | 23.924    | 19.0    |
+| 0.5108        | 18.0  | 10872 | 1.6716          | 25.7213 | 11.2197 | 20.858  | 24.3088   | 19.0    |
+| 0.5358        | 19.0  | 11476 | 1.6882          | 25.7908 | 11.2416 | 20.9464 | 24.2852   | 19.0    |
+| 0.4959        | 20.0  | 12080 | 1.7027          | 25.6556 | 11.2363 | 20.8495 | 24.1665   | 18.992  |
+| 0.4942        | 21.0  | 12684 | 1.7131          | 25.6156 | 11.175  | 20.7688 | 24.1641   | 19.0    |
+| 0.4833        | 22.0  | 13288 | 1.7178          | 25.7798 | 11.2421 | 20.896  | 24.2101   | 19.0    |
+| 0.4702        | 23.0  | 13892 | 1.7227          | 25.7147 | 11.2161 | 20.9105 | 24.1549   | 19.0    |
+| 0.4747        | 24.0  | 14496 | 1.7241          | 25.6314 | 11.1929 | 20.8068 | 24.1442   | 19.0    |
+| 0.4691        | 25.0  | 15100 | 1.7255          | 25.5557 | 11.1446 | 20.7482 | 24.0749   | 19.0    |
+
+
+### Framework versions
+
+- Transformers 4.34.0
+- Pytorch 2.0.1+cu118
+- Datasets 2.14.5
+- Tokenizers 0.14.1

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "decoder_start_token_id": 0,
+  "eos_token_id": 1,
+  "pad_token_id": 0,
+  "transformers_version": "4.34.0"
+}

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:186cc06efe208be6c929814e59a7eacda006eade01caeb3d87cae580af28f578
+oid sha256:0cc649618996e6c47c5031291e9605be45e405ba2ecbaf3cb8604292083a83f3
 size 891702929