lewtun HF staff commited on
Commit
e570e5a
1 Parent(s): e1f2529

Add evaluation results on the 3.0.0 config of cnn_dailymail

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the 3.0.0 config of the [cnn_dailymail](https://huggingface.co/datasets/cnn_dailymail) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-cnn_dailymail-b454c496-12155619).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=cnn_dailymail).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=cnn_dailymail).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -283,6 +283,39 @@ model-index:
283
  type: gen_len
284
  value: 27.4815
285
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
286
  ---
287
 
288
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2
 
283
  type: gen_len
284
  value: 27.4815
285
  verified: true
286
+ - task:
287
+ type: summarization
288
+ name: Summarization
289
+ dataset:
290
+ name: cnn_dailymail
291
+ type: cnn_dailymail
292
+ config: 3.0.0
293
+ split: test
294
+ metrics:
295
+ - name: ROUGE-1
296
+ type: rouge
297
+ value: 27.5692
298
+ verified: true
299
+ - name: ROUGE-2
300
+ type: rouge
301
+ value: 6.1264
302
+ verified: true
303
+ - name: ROUGE-L
304
+ type: rouge
305
+ value: 17.1127
306
+ verified: true
307
+ - name: ROUGE-LSUM
308
+ type: rouge
309
+ value: 23.0066
310
+ verified: true
311
+ - name: loss
312
+ type: loss
313
+ value: 2.218526601791382
314
+ verified: true
315
+ - name: gen_len
316
+ type: gen_len
317
+ value: 39.1952
318
+ verified: true
319
  ---
320
 
321
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2