Hugging Face's logo

binhK
/
flan_t5_finetuned_sarcastic

Text2Text Generation
Transformers
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Community
flan_t5_finetuned_sarcastic / README.md
binhK's picture
binhK
End of training
27ba38f verified
preview code
|
raw
history blame contribute delete
1.67 kB
metadata
license: apache-2.0
base_model: google/flan-t5-base
tags:
  - generated_from_trainer
metrics:
  - rouge
model-index:
  - name: flan_t5_finetuned_sarcastic
    results: []

flan_t5_finetuned_sarcastic

This model is a fine-tuned version of google/flan-t5-base on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 4.5109
  • Rouge1: 19.0525
  • Rouge2: 6.5322
  • Rougel: 17.439
  • Rougelsum: 17.4744
  • Gen Len: 17.4448

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 2

Training results

Training Loss Epoch Step Validation Loss Rouge1 Rouge2 Rougel Rougelsum Gen Len
1.6482 1.0 834 4.4165 18.9525 6.7215 17.5456 17.4554 17.1070
1.4688 2.0 1668 4.5109 19.0525 6.5322 17.439 17.4744 17.4448

Framework versions

  • Transformers 4.40.2
  • Pytorch 2.3.0
  • Datasets 2.19.1
  • Tokenizers 0.19.1