Hugging Face's logo

irp1999
/
mbart-neutralization

Text2Text Generation
Transformers
TensorBoard
Safetensors
mbart
simplification
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
irp1999 commited on
Commit
fd71396
•
1 Parent(s): b89b433

Training complete

Browse files
Files changed (3) hide show
  1. README.md +12 -12
  2. generation_config.json +8 -3
  3. model.safetensors +1 -1
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
- license: apache-2.0
3
- base_model: google/flan-t5-base
4
  tags:
5
  - simplification
6
  - generated_from_trainer
@@ -16,11 +16,11 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  # mbart-neutralization
18
 
19
- This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 1.3981
22
- - Bleu: 0.8291
23
- - Gen Len: 19.0
24
 
25
  ## Model description
26
 
@@ -40,8 +40,8 @@ More information needed
40
 
41
  The following hyperparameters were used during training:
42
  - learning_rate: 5.6e-05
43
- - train_batch_size: 1
44
- - eval_batch_size: 1
45
  - seed: 42
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
@@ -49,10 +49,10 @@ The following hyperparameters were used during training:
49
 
50
  ### Training results
51
 
52
- | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
53
- |:-------------:|:-----:|:----:|:---------------:|:------:|:-------:|
54
- | No log | 1.0 | 121 | 1.4544 | 0.9156 | 19.0 |
55
- | No log | 2.0 | 242 | 1.3981 | 0.8291 | 19.0 |
56
 
57
 
58
  ### Framework versions
 
1
  ---
2
+ license: mit
3
+ base_model: facebook/mbart-large-50
4
  tags:
5
  - simplification
6
  - generated_from_trainer
 
16
 
17
  # mbart-neutralization
18
 
19
+ This model is a fine-tuned version of [facebook/mbart-large-50](https://huggingface.co/facebook/mbart-large-50) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.0181
22
+ - Bleu: 98.7341
23
+ - Gen Len: 18.4896
24
 
25
  ## Model description
26
 
 
40
 
41
  The following hyperparameters were used during training:
42
  - learning_rate: 5.6e-05
43
+ - train_batch_size: 8
44
+ - eval_batch_size: 8
45
  - seed: 42
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
 
49
 
50
  ### Training results
51
 
52
+ | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
53
+ |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|
54
+ | No log | 1.0 | 440 | 0.0307 | 91.2911 | 18.25 |
55
+ | 0.2343 | 2.0 | 880 | 0.0181 | 98.7341 | 18.4896 |
56
 
57
 
58
  ### Framework versions
generation_config.json CHANGED
@@ -1,6 +1,11 @@
1
  {
2
- "decoder_start_token_id": 0,
3
- "eos_token_id": 1,
4
- "pad_token_id": 0,
 
 
 
 
 
5
  "transformers_version": "4.37.2"
6
  }
 
1
  {
2
+ "bos_token_id": 0,
3
+ "decoder_start_token_id": 2,
4
+ "early_stopping": true,
5
+ "eos_token_id": 2,
6
+ "forced_eos_token_id": 2,
7
+ "max_length": 200,
8
+ "num_beams": 5,
9
+ "pad_token_id": 1,
10
  "transformers_version": "4.37.2"
11
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:82b99059e8a57dff52042a00e25d4bad26516a7860a6c6a7eec46d08d1ec4894
3
  size 2444578688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be81fdab8cada8f8cdd8d57dfd898b9eeb36743291ee9865ff988dadb47b2efc
3
  size 2444578688