lewtun HF staff commited on
Commit
70bd9b9
1 Parent(s): df7285d

Add evaluation results on the samsum config of samsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the samsum config of the [samsum](https://huggingface.co/datasets/samsum) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-samsum-db063b78-12135617).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=samsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=samsum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -217,6 +217,39 @@ model-index:
217
  type: gen_len
218
  value: 63.4493
219
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
220
  ---
221
 
222
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2
 
217
  type: gen_len
218
  value: 63.4493
219
  verified: true
220
+ - task:
221
+ type: summarization
222
+ name: Summarization
223
+ dataset:
224
+ name: samsum
225
+ type: samsum
226
+ config: samsum
227
+ split: test
228
+ metrics:
229
+ - name: ROUGE-1
230
+ type: rouge
231
+ value: 26.8026
232
+ verified: true
233
+ - name: ROUGE-2
234
+ type: rouge
235
+ value: 6.0656
236
+ verified: true
237
+ - name: ROUGE-L
238
+ type: rouge
239
+ value: 20.0098
240
+ verified: true
241
+ - name: ROUGE-LSUM
242
+ type: rouge
243
+ value: 21.9115
244
+ verified: true
245
+ - name: loss
246
+ type: loss
247
+ value: 2.317471981048584
248
+ verified: true
249
+ - name: gen_len
250
+ type: gen_len
251
+ value: 19.1111
252
+ verified: true
253
  ---
254
 
255
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2