ArtifactAI autoevaluator HF staff commited on
Commit
7866ac0
1 Parent(s): 904a89c

Add evaluation results on the section config and test split of ccdv/arxiv-summarization (#2)

Browse files

- Add evaluation results on the section config and test split of ccdv/arxiv-summarization (b691903590e5a18bc04749506d08798cf2b6a3d3)


Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +42 -0
README.md CHANGED
@@ -4,6 +4,48 @@ license: apache-2.0
4
  tags:
5
  - summarization
6
  datasets: arxiv-summarization
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  ---
8
 
9
  ## Introduction
 
4
  tags:
5
  - summarization
6
  datasets: arxiv-summarization
7
+ model-index:
8
+ - name: ArtifactAI/led_base_16384_arxiv_summarization
9
+ results:
10
+ - task:
11
+ type: summarization
12
+ name: Summarization
13
+ dataset:
14
+ name: ccdv/arxiv-summarization
15
+ type: ccdv/arxiv-summarization
16
+ config: section
17
+ split: test
18
+ metrics:
19
+ - type: rouge
20
+ value: 37.3255
21
+ name: ROUGE-1
22
+ verified: true
23
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiODIyZWNhMTgxNDlkYThhNGFlOGIxYjhhMTU4Y2JjN2I2ZDVkYWVhMmU5ZjQxZmQ3ZGY4ZmY1Y2Y2YzYwZjg5MCIsInZlcnNpb24iOjF9.Q5rZaUa1WvJThE1dOVOWEAOTweDkQPilaP9OCdM1W7ypC-XVTrKC-XjeYvgpET8GSqMROoYP9Z0oJdD1KcWeCw
24
+ - type: rouge
25
+ value: 10.8948
26
+ name: ROUGE-2
27
+ verified: true
28
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYmJkN2E4YzE3MWY0ZTg4YjFkMGY5MjY2YjhmYzBjZGU3Mjc2NjNhYzkwMDkwOTMwNjdmYWI1ZmY2YmQ3OTA2MiIsInZlcnNpb24iOjF9.u9SrzD-QRXU2mboRwkhgyJcDGPfZoGY5vCoC4ROUc2WLB9IcSypzCAfGsIg488aWJ-iGUmfwbGQqj8Vb50mmCA
29
+ - type: rouge
30
+ value: 20.3875
31
+ name: ROUGE-L
32
+ verified: true
33
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNzk5NTM4MjM0MGU0OTdmZWEzMjhkMmUxMTY3YTVmMzUzODllZWEwMWEwNjE5ZWNiYzY0MjM1MTFlZWE3NmNmNiIsInZlcnNpb24iOjF9.tJxNOMKwjJlTVhcjoLdy8phj4cSG3b5YaQd5vzl9RJc-kCLcC7Q_F7LDYlEFa7L2S04b6YAcn1JzPsCNy9avAA
34
+ - type: rouge
35
+ value: 33.3014
36
+ name: ROUGE-LSUM
37
+ verified: true
38
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDVlZjZhMWNlZmE1YmQ1NDQ4ZmIyMzU5YjgxZmE5ZDEzYWJlNDBiODJjZDBhZWYyMmJhYmE4MWQ3ZGE4ZDUxMCIsInZlcnNpb24iOjF9.NGxXK6cEvyIia_iCjuIeR_JL0fKNONDmnaPKslwf56p7Hletg44oi17jM7LIkZ6ToZb31vvcKjx2DO4-k1V0CQ
39
+ - type: loss
40
+ value: 3.182162284851074
41
+ name: loss
42
+ verified: true
43
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiM2U1YjkzMmIyNmEzYjlhNWZkNTNmMjgzNjZlMmY2ZWY1OGIyNzM2YmU1MzdiMDAxZDVmNmE5OGNiYThlNTA4ZiIsInZlcnNpb24iOjF9.CeWkK2aAodOUyj7omgJ0sq66GDTuEBRIuDOxLCkw6h1UshWCY2KT-uCUNcQfKMIvPaEjqIKjvtbWBKkmHipHAw
44
+ - type: gen_len
45
+ value: 145.5905
46
+ name: gen_len
47
+ verified: true
48
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDMzNTIzZTcwMzczNGEzMmU4YjAyOTZhNDVlNmUyNzVjZGE5MjNhYzQ4MGNlYmQ4MjNlOWY4YzY0NDExNDhiZCIsInZlcnNpb24iOjF9.fX3AuS-fWZfYe5KPDr8FSxuVZYwcUKglSIhKYIVdwTsfXgUVTdDzC6wBiBRpS3ybW0yFSxlKnAbBdJEshOpDBw
49
  ---
50
 
51
  ## Introduction