Add evaluation results on the default config of billsum

#5
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -274,6 +274,39 @@ model-index:
274
  type: gen_len
275
  value: 231.0762
276
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
277
  ---
278
 
279
  # Longformer Encoder-Decoder (LED) for Narrative-Esque Long Text Summarization
 
274
  type: gen_len
275
  value: 231.0762
276
  verified: true
277
+ - task:
278
+ type: summarization
279
+ name: Summarization
280
+ dataset:
281
+ name: billsum
282
+ type: billsum
283
+ config: default
284
+ split: test
285
+ metrics:
286
+ - name: ROUGE-1
287
+ type: rouge
288
+ value: 36.8502
289
+ verified: true
290
+ - name: ROUGE-2
291
+ type: rouge
292
+ value: 15.9147
293
+ verified: true
294
+ - name: ROUGE-L
295
+ type: rouge
296
+ value: 23.4762
297
+ verified: true
298
+ - name: ROUGE-LSUM
299
+ type: rouge
300
+ value: 30.9597
301
+ verified: true
302
+ - name: loss
303
+ type: loss
304
+ value: 3.878790855407715
305
+ verified: true
306
+ - name: gen_len
307
+ type: gen_len
308
+ value: 131.3622
309
+ verified: true
310
  ---
311
 
312
  # Longformer Encoder-Decoder (LED) for Narrative-Esque Long Text Summarization