Commit
•
bd2b497
1
Parent(s):
580f81d
Add evaluation results on the 3.0.0 config and test split of cnn_dailymail
Browse filesBeep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the 3.0.0 config and test split of the [cnn_dailymail](https://huggingface.co/datasets/cnn_dailymail) dataset by
@Raj
P Sini, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-cnn_dailymail-3.0.0-52cdb7-47832145225).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=cnn_dailymail).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=cnn_dailymail).
README.md
CHANGED
@@ -20,6 +20,45 @@ model-index:
|
|
20 |
value: 41.70204016592095
|
21 |
- type: rouge2
|
22 |
value: 15.134827404979639
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
23 |
---
|
24 |
|
25 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
|
20 |
value: 41.70204016592095
|
21 |
- type: rouge2
|
22 |
value: 15.134827404979639
|
23 |
+
- task:
|
24 |
+
type: summarization
|
25 |
+
name: Summarization
|
26 |
+
dataset:
|
27 |
+
name: cnn_dailymail
|
28 |
+
type: cnn_dailymail
|
29 |
+
config: 3.0.0
|
30 |
+
split: test
|
31 |
+
metrics:
|
32 |
+
- type: rouge
|
33 |
+
value: 42.6935
|
34 |
+
name: ROUGE-1
|
35 |
+
verified: true
|
36 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjllYzUzNWNjZWQyMDdjNTYxYTFhNmM5MWZlNzljZWVmNTE0N2E1ZWQxNDUzZTkwNTY5OWY2YzViNDIyMDg3MiIsInZlcnNpb24iOjF9.ehl1eTGu4x9i_8rpVUvzqK6y89N0AvVHHUc_Z_A35TpR1_6hhxnxpB67RWaPd5cYhUKVvwryxHfaoLH0WHlfDg
|
37 |
+
- type: rouge
|
38 |
+
value: 19.9458
|
39 |
+
name: ROUGE-2
|
40 |
+
verified: true
|
41 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNTdkODkyMjBlMGZlOTgzOTQ5OGE2ZmEzMjM3NDRiOTBlYzU0YTU5YmQzMDBmZTMwOWQ4Nzc3NGM4ZWZkODZhOCIsInZlcnNpb24iOjF9.ChzOw3oJ2CKdqnJr8GyRcpbhoMdmhvVelOEOZ9l9OoPS8dGF2dsZhz6pPmuIcVLuap6uPryFLJyM3s_doXEFCA
|
42 |
+
- type: rouge
|
43 |
+
value: 28.7611
|
44 |
+
name: ROUGE-L
|
45 |
+
verified: true
|
46 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNzg2OGZjOWNlNjYyZTQxZjRkYTMzMjE4MGI4YjI2NTRjMTRmMDYyNjBkNzk2ODdlZjVhOWY1Zjc3OTAyMTk4MyIsInZlcnNpb24iOjF9.QUE_vKtGAnZf3Dd3cM9boIZba5DPLxUtQb8I5TQgwWy6pcJ8PKNvewR5uscU6aNmIY_gcfNtyE6c-7xIxHBFAQ
|
47 |
+
- type: rouge
|
48 |
+
value: 39.0496
|
49 |
+
name: ROUGE-LSUM
|
50 |
+
verified: true
|
51 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjdkM2E4YTYwMWU3MTRkMDc5ODI0N2JhMWU4ODdhZTY0NDg1ZDQxMjRiYzQ4Y2Q2Y2RmZmZjZGY1YzEwNmE0NyIsInZlcnNpb24iOjF9.OhIZWxf5COw52hqK-Kan73Tsr3C3lIXS72SRYNH9Ph81JxQ1D12QeSlN6JaAtFmOWLxs_xs60H0Icbo9-letDg
|
52 |
+
- type: loss
|
53 |
+
value: 2.429295539855957
|
54 |
+
name: loss
|
55 |
+
verified: true
|
56 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOTI5MzUxMjNhODM3ZDQ4NDk3ZTgzYTQyYjBlZTExYzI3MmJjZjdhNjhkODMyMzA0M2Q5Nzk3MTViM2QxOGJkYSIsInZlcnNpb24iOjF9.2iOkGmRyyVxJdc9oQukeKWCxu0V-5zudxIg4msELcHvks3hQwHcO8QKSZ2A7Io_QC0F999maTIqCTvPcJTvxBQ
|
57 |
+
- type: gen_len
|
58 |
+
value: 97.3349
|
59 |
+
name: gen_len
|
60 |
+
verified: true
|
61 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMjZiZmZkNzEyYTlhOGI3YWVlMjdjOWMzYWQ4YmU5ZjI0Yzk2NDE0OTkwYjFkNTNmMWM3MDk1OWU1ZDA0NTYyOCIsInZlcnNpb24iOjF9.oE6OwT5oO8xJak7HN4L0OHzmoaSghLZqiFy24KygS21jNVpbwXj793rV5RcPkJNWJb6agRktxXqtCZyxAzqMBw
|
62 |
---
|
63 |
|
64 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|