Validation Metrics

Loss: 2.133
Rouge1: 45.861
Rouge2: 14.179
RougeL: 23.565
RougeLsum: 40.908
Gen Len: 195.334

Downloads last month: 15

Safetensors

Model size

460M params

Tensor type

F32

Inference Examples

Summarization

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train Blaise-g/led_pubmed_sumpubmed_1

Evaluation results

ROUGE-1 on Blaise-g/SumPubmed
test set self-reported

41.252
ROUGE-2 on Blaise-g/SumPubmed
test set self-reported

11.129
ROUGE-L on Blaise-g/SumPubmed
test set self-reported

20.253
ROUGE-LSUM on Blaise-g/SumPubmed
test set self-reported

37.150
loss on Blaise-g/SumPubmed
test set self-reported

6.371
gen_len on Blaise-g/SumPubmed
test set self-reported

193.374

View on Papers With Code