Add evaluation results on the kmfoda--booksum config and test split of kmfoda/booksum

#12
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -177,6 +177,39 @@ model-index:
177
  type: gen_len
178
  value: 233.8107
179
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
180
  ---
181
 
182
  # BigBirdPegasus model (large)
 
177
  type: gen_len
178
  value: 233.8107
179
  verified: true
180
+ - task:
181
+ type: summarization
182
+ name: Summarization
183
+ dataset:
184
+ name: kmfoda/booksum
185
+ type: kmfoda/booksum
186
+ config: kmfoda--booksum
187
+ split: test
188
+ metrics:
189
+ - name: ROUGE-1
190
+ type: rouge
191
+ value: 9.4741
192
+ verified: true
193
+ - name: ROUGE-2
194
+ type: rouge
195
+ value: 0.6261
196
+ verified: true
197
+ - name: ROUGE-L
198
+ type: rouge
199
+ value: 7.6203
200
+ verified: true
201
+ - name: ROUGE-LSUM
202
+ type: rouge
203
+ value: 8.8656
204
+ verified: true
205
+ - name: loss
206
+ type: loss
207
+ value: 7.033373832702637
208
+ verified: true
209
+ - name: gen_len
210
+ type: gen_len
211
+ value: 189.2068
212
+ verified: true
213
  ---
214
 
215
  # BigBirdPegasus model (large)