phdreg commited on
Commit
af79716
1 Parent(s): 5b3b208

Model save

Browse files
README.md CHANGED
@@ -1,8 +1,8 @@
1
  ---
 
 
2
  tags:
3
  - generated_from_trainer
4
- metrics:
5
- - rouge
6
  model-index:
7
  - name: t5-small-finetuned-feedback
8
  results: []
@@ -13,14 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # t5-small-finetuned-feedback
15
 
16
- This model was trained from scratch on an unknown dataset.
17
- It achieves the following results on the evaluation set:
18
- - Loss: 1.6219
19
- - Rouge1: 50.8511
20
- - Rouge2: 26.8493
21
- - Rougel: 48.4905
22
- - Rougelsum: 48.5418
23
- - Gen Len: 10.0496
24
 
25
  ## Model description
26
 
@@ -45,23 +38,14 @@ The following hyperparameters were used during training:
45
  - seed: 42
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
- - num_epochs: 10
49
  - mixed_precision_training: Native AMP
50
 
51
  ### Training results
52
 
53
- | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
54
- |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
55
- | No log | 1.0 | 61 | 2.1472 | 36.9176 | 16.7706 | 34.7237 | 34.8094 | 11.3802 |
56
- | No log | 2.0 | 122 | 1.9311 | 45.014 | 22.0586 | 42.7869 | 42.7636 | 10.6694 |
57
- | No log | 3.0 | 183 | 1.8201 | 49.8661 | 25.8069 | 47.7022 | 47.7394 | 10.3223 |
58
- | No log | 4.0 | 244 | 1.7519 | 51.0514 | 27.3576 | 48.9062 | 48.9733 | 10.4132 |
59
- | No log | 5.0 | 305 | 1.7028 | 51.377 | 27.9206 | 49.4673 | 49.4886 | 10.0992 |
60
- | No log | 6.0 | 366 | 1.6731 | 50.702 | 27.4872 | 48.7413 | 48.7108 | 10.2066 |
61
- | No log | 7.0 | 427 | 1.6496 | 50.8295 | 27.4685 | 48.8267 | 48.7703 | 10.0 |
62
- | No log | 8.0 | 488 | 1.6334 | 50.7437 | 26.9485 | 48.4296 | 48.4472 | 10.0496 |
63
- | 2.0857 | 9.0 | 549 | 1.6239 | 50.7779 | 26.9387 | 48.5702 | 48.619 | 10.0331 |
64
- | 2.0857 | 10.0 | 610 | 1.6219 | 50.8511 | 26.8493 | 48.4905 | 48.5418 | 10.0496 |
65
 
66
 
67
  ### Framework versions
 
1
  ---
2
+ license: apache-2.0
3
+ base_model: t5-small
4
  tags:
5
  - generated_from_trainer
 
 
6
  model-index:
7
  - name: t5-small-finetuned-feedback
8
  results: []
 
13
 
14
  # t5-small-finetuned-feedback
15
 
16
+ This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on an unknown dataset.
 
 
 
 
 
 
 
17
 
18
  ## Model description
19
 
 
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
+ - num_epochs: 1
42
  - mixed_precision_training: Native AMP
43
 
44
  ### Training results
45
 
46
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
47
+ |:-------------:|:-----:|:----:|:---------------:|:-------:|:------:|:-------:|:---------:|:-------:|
48
+ | No log | 1.0 | 61 | 3.6183 | 23.4714 | 9.0363 | 20.5954 | 20.9234 | 17.6529 |
 
 
 
 
 
 
 
 
 
49
 
50
 
51
  ### Framework versions
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "t5-small-finetuned-feedback",
3
  "architectures": [
4
  "T5ForConditionalGeneration"
5
  ],
 
1
  {
2
+ "_name_or_path": "t5-small",
3
  "architectures": [
4
  "T5ForConditionalGeneration"
5
  ],
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ec6f2d5bc088d33dcf46c6c0642af32b41875e125e062d02b659c71bb6940c19
3
  size 242041896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71e2e75f6888eca9a56bed689f0345c32b0fd606e7c18ece00420e438d020e8f
3
  size 242041896
runs/May01_06-48-28_f2d32a93a370/events.out.tfevents.1714546109.f2d32a93a370.1748.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83fd3b6a1f4c3b00299e759c217ec602369a4eeab13d2b8f951c7c033897c1c2
3
+ size 5688
runs/May01_08-16-33_f2d32a93a370/events.out.tfevents.1714551393.f2d32a93a370.37027.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a48709d0da69b9111d45a9996bc2a95d1893e29f3b78352e193fcda398ddca5
3
+ size 6548
tokenizer.json CHANGED
@@ -2,7 +2,7 @@
2
  "version": "1.0",
3
  "truncation": {
4
  "direction": "Right",
5
- "max_length": 1024,
6
  "strategy": "LongestFirst",
7
  "stride": 0
8
  },
 
2
  "version": "1.0",
3
  "truncation": {
4
  "direction": "Right",
5
+ "max_length": 128,
6
  "strategy": "LongestFirst",
7
  "stride": 0
8
  },
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:90e1c1eed3eca63eb423b3a83594a93393350a010e8d3774f161bf4c4e5acbe6
3
  size 5176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:998a825f8e1d6a5348b14bc50d0d875e7401482592a6f5cea9b00c6aee16ae4c
3
  size 5176