mt5-small-finetuned-amazon-en-es

This model is a fine-tuned version of google/mt5-small on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 3.0197
• Rouge1: 16.6252
• Rouge2: 7.8463
• Rougel: 16.5669
• Rougelsum: 16.5091

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5.6e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• num_epochs: 8

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum
2.9379	1.0	1209	3.3203	19.0063	9.7984	18.5969	18.4743
3.5668	2.0	2418	3.0886	17.4365	8.614	17.0761	17.0194
3.3727	3.0	3627	3.0707	16.7181	8.3534	16.5387	16.4384
3.2658	4.0	4836	3.0663	16.7178	8.2583	16.5202	16.4407
3.1784	5.0	6045	3.0332	16.6095	7.7741	16.3874	16.3206
3.1276	6.0	7254	3.0291	16.2199	7.3083	15.9939	15.8797
3.1038	7.0	8463	3.0194	16.5163	7.8339	16.3592	16.2554
3.0796	8.0	9672	3.0197	16.6252	7.8463	16.5669	16.5091

Framework versions

• Transformers 4.46.2
• Pytorch 2.5.1+cu121
• Datasets 3.1.0
• Tokenizers 0.20.3