lewtun HF staff commited on
Commit
e877db7
1 Parent(s): 3b6ab3e

Add evaluation results on the kmfoda--booksum config of kmfoda/booksum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the kmfoda--booksum config of the [kmfoda/booksum](https://huggingface.co/datasets/kmfoda/booksum) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-kmfoda__booksum-a84cddd6-12085614).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=kmfoda/booksum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=kmfoda/booksum).

Files changed (1) hide show
  1. README.md +36 -1
README.md CHANGED
@@ -181,7 +181,42 @@ parameters:
181
  length_penalty: 0.3
182
  encoder_no_repeat_ngram_size: 3
183
  num_beams: 4
184
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
185
  ---
186
 
187
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2
 
181
  length_penalty: 0.3
182
  encoder_no_repeat_ngram_size: 3
183
  num_beams: 4
184
+ model-index:
185
+ - name: pszemraj/long-t5-tglobal-base-16384-booksum-V11-big_patent-V2
186
+ results:
187
+ - task:
188
+ type: summarization
189
+ name: Summarization
190
+ dataset:
191
+ name: kmfoda/booksum
192
+ type: kmfoda/booksum
193
+ config: kmfoda--booksum
194
+ split: test
195
+ metrics:
196
+ - name: ROUGE-1
197
+ type: rouge
198
+ value: 23.1439
199
+ verified: true
200
+ - name: ROUGE-2
201
+ type: rouge
202
+ value: 3.2393
203
+ verified: true
204
+ - name: ROUGE-L
205
+ type: rouge
206
+ value: 12.7038
207
+ verified: true
208
+ - name: ROUGE-LSUM
209
+ type: rouge
210
+ value: 19.8101
211
+ verified: true
212
+ - name: loss
213
+ type: loss
214
+ value: 2.766307830810547
215
+ verified: true
216
+ - name: gen_len
217
+ type: gen_len
218
+ value: 63.4493
219
+ verified: true
220
  ---
221
 
222
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2