lewtun HF staff commited on
Commit
cd7bcb7
1 Parent(s): bda5299

Add evaluation results on the y config and test split of big_patent

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the y config and test split of the [big_patent](https://huggingface.co/datasets/big_patent) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-big_patent-y-7d0862-15806178).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=big_patent).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=big_patent).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -307,6 +307,39 @@ model-index:
307
  type: gen_len
308
  value: 131.3622
309
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
310
  ---
311
 
312
  # Longformer Encoder-Decoder (LED) for Narrative-Esque Long Text Summarization
 
307
  type: gen_len
308
  value: 131.3622
309
  verified: true
310
+ - task:
311
+ type: summarization
312
+ name: Summarization
313
+ dataset:
314
+ name: big_patent
315
+ type: big_patent
316
+ config: y
317
+ split: test
318
+ metrics:
319
+ - name: ROUGE-1
320
+ type: rouge
321
+ value: 33.7585
322
+ verified: true
323
+ - name: ROUGE-2
324
+ type: rouge
325
+ value: 9.4101
326
+ verified: true
327
+ - name: ROUGE-L
328
+ type: rouge
329
+ value: 18.8927
330
+ verified: true
331
+ - name: ROUGE-LSUM
332
+ type: rouge
333
+ value: 28.5051
334
+ verified: true
335
+ - name: loss
336
+ type: loss
337
+ value: 5.162865161895752
338
+ verified: true
339
+ - name: gen_len
340
+ type: gen_len
341
+ value: 222.6626
342
+ verified: true
343
  ---
344
 
345
  # Longformer Encoder-Decoder (LED) for Narrative-Esque Long Text Summarization