flan-t5-large-dialoguSum_Solar_koen

This model is a fine-tuned version of google/flan-t5-large on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.9489
• Rouge1: 40.4427
• Rouge2: 19.2666
• Rougel: 35.3406
• Rougelsum: 37.153
• Gen Len: 18.9259

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 1e-05
• train_batch_size: 1
• eval_batch_size: 1
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	Gen Len
1.1391	1.0	12457	0.9631	39.7797	18.5492	35.1145	36.8184	18.8918
1.054	2.0	24914	0.9489	40.4427	19.2666	35.3406	37.153	18.9259
0.895	3.0	37371	0.9514	39.2746	18.1121	34.2658	35.963	18.8998
0.8201	4.0	49828	0.9508	39.8938	18.8547	35.1437	36.8985	18.8878
0.8495	5.0	62285	0.9553	39.5362	18.5342	34.8851	36.5751	18.9058

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu121
• Datasets 2.21.0
• Tokenizers 0.19.1