autoevaluator HF staff commited on
Commit
657011b
·
1 Parent(s): de903d9

Add evaluation results on the kmfoda--booksum config and test split of kmfoda/booksum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the kmfoda--booksum config and test split of the [kmfoda/booksum](https://huggingface.co/datasets/kmfoda/booksum) dataset by

@pszemraj
, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-kmfoda__booksum-kmfoda__booksum-29029e-2376274530).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=kmfoda/booksum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=kmfoda/booksum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -78,6 +78,39 @@ model-index:
78
  type: gen_len
79
  value: 186.2003
80
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
81
  ---
82
 
83
  # BigBirdPegasus model (large)
 
78
  type: gen_len
79
  value: 186.2003
80
  verified: true
81
+ - task:
82
+ type: summarization
83
+ name: Summarization
84
+ dataset:
85
+ name: kmfoda/booksum
86
+ type: kmfoda/booksum
87
+ config: kmfoda--booksum
88
+ split: test
89
+ metrics:
90
+ - name: ROUGE-1
91
+ type: rouge
92
+ value: 15.24
93
+ verified: true
94
+ - name: ROUGE-2
95
+ type: rouge
96
+ value: 1.0121
97
+ verified: true
98
+ - name: ROUGE-L
99
+ type: rouge
100
+ value: 10.6817
101
+ verified: true
102
+ - name: ROUGE-LSUM
103
+ type: rouge
104
+ value: 14.3223
105
+ verified: true
106
+ - name: loss
107
+ type: loss
108
+ value: 7.293437480926514
109
+ verified: true
110
+ - name: gen_len
111
+ type: gen_len
112
+ value: 198.4067
113
+ verified: true
114
  ---
115
 
116
  # BigBirdPegasus model (large)