autoevaluator HF staff commited on
Commit
16737ee
1 Parent(s): 77653b1

Add evaluation results on the samsum config and train split of samsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the samsum config and train split of the [samsum](https://huggingface.co/datasets/samsum) dataset by

@uunicee

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-samsum-samsum-0cab72-2447375877).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=samsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=samsum).

Files changed (1) hide show
  1. README.md +57 -15
README.md CHANGED
@@ -1,31 +1,73 @@
1
-
2
  ---
3
  language: en
 
4
  tags:
5
  - azureml
6
  - t5
7
  - summarization
8
  - deepspeed
9
- license: apache-2.0
10
  datasets:
11
  - samsum
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  model-index:
13
- - name: t5-large-samsum-deepspeed
14
  results:
15
- - task:
16
- name: Abstractive Text Summarization
17
- type: abstractive-text-summarization
18
  dataset:
19
- name: "SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarization"
20
  type: samsum
21
- widget:
22
- - text: |
23
- Kevin: Hey man, are you excited to watch Finding Nemo tonight?
24
- Henry: Yea, I can't wait to watch that same movie for the 89th time. Is Nate coming over to watch it with us tonight?
25
- Kevin: Yep, he said he'll be arriving a bit later at around 7 since he gets off of work at 6. Have you taken out the garbage yet? It's starting to make the kitchen really smell.
26
- Henry: Oh I forgot. I'll do that once I'm finished with my assignment for my math class. I didn't get to start on it until an hour ago, and it's due in 30 minutes.
27
- Kevin: Okay dude, you should take it out as soon as possible. By the way, Nate is bringing his girlfriend and their cat too.
28
- Henry: Nice, I'm really looking forward to seeing them again.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
  ---
30
 
31
  ## `t5-large-samsum-deepspeed`
 
 
1
  ---
2
  language: en
3
+ license: apache-2.0
4
  tags:
5
  - azureml
6
  - t5
7
  - summarization
8
  - deepspeed
 
9
  datasets:
10
  - samsum
11
+ widget:
12
+ - text: 'Kevin: Hey man, are you excited to watch Finding Nemo tonight?
13
+
14
+ Henry: Yea, I can''t wait to watch that same movie for the 89th time. Is Nate
15
+ coming over to watch it with us tonight?
16
+
17
+ Kevin: Yep, he said he''ll be arriving a bit later at around 7 since he gets off
18
+ of work at 6. Have you taken out the garbage yet? It''s starting to make the kitchen
19
+ really smell.
20
+
21
+ Henry: Oh I forgot. I''ll do that once I''m finished with my assignment for my
22
+ math class. I didn''t get to start on it until an hour ago, and it''s due in 30
23
+ minutes.
24
+
25
+ Kevin: Okay dude, you should take it out as soon as possible. By the way, Nate
26
+ is bringing his girlfriend and their cat too.
27
+
28
+ Henry: Nice, I''m really looking forward to seeing them again.'
29
  model-index:
30
+ - name: henryu-lin/t5-large-samsum-deepspeed
31
  results:
32
+ - task:
33
+ type: summarization
34
+ name: Summarization
35
  dataset:
36
+ name: samsum
37
  type: samsum
38
+ config: samsum
39
+ split: train
40
+ metrics:
41
+ - type: rouge
42
+ value: 40.8694
43
+ name: ROUGE-1
44
+ verified: true
45
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZjgxNDg4YjM4YjY0MDVhZmY5ZjQ1YTgyN2RhOGIwY2M5YjljMjAwYjI0ZWEzMzMxMzBlYmE5MjY3ODM1MjI4YiIsInZlcnNpb24iOjF9.NkOSwlWC_r8ewewRk1X9KJxaTEWZ0lDz0SuABLeUf1tESeTBowSJJBXgwiYb7gjpHnipfcK2HczlNRl-KzdDAA
46
+ - type: rouge
47
+ value: 19.223
48
+ name: ROUGE-2
49
+ verified: true
50
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNjc3ZTY3ZWU0OWE5Zjc1ZjdiZWE4NDQ0YzI3MTMxNTM3ZDRjY2Y1YWM1OWQyOWMwMTZlMmRlZTI5ZGNkMmI5OSIsInZlcnNpb24iOjF9.4jHtzkDGNLPHSC7RN9Hi5jeiLy9F3JwBpDKdCjkiDmZY_cgHHCTr5v6QTr7VISZNQdCNg27iO0d8ohSIxVVXBg
51
+ - type: rouge
52
+ value: 31.0688
53
+ name: ROUGE-L
54
+ verified: true
55
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNmQzZjhhMjJjZWFkYWViODlhMDQ4MTY0YWI4NzRjZWMyMGZlMDQ1MjA0Yzk0MTczOWU0ODMyYjQ3NGEwOTZhNiIsInZlcnNpb24iOjF9.nUPHLaP5n_7YYbtV6ms0-fOGtPvEx826Ivsv-MfKiUVKyxTJ-9G_xbECK2cS1XQxuO05tlWhO89zz03vsNkuAQ
56
+ - type: rouge
57
+ value: 38.3786
58
+ name: ROUGE-LSUM
59
+ verified: true
60
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNTJlMGUwMTE4NWRkMWZkYzU0NzA3ODQzOWE2MWY3MWU2YmFjNzQ0ZTU2MDZiYTY0ZmY2N2U4NmUyOTY5NDRkMiIsInZlcnNpb24iOjF9.-T68JCuA99EVzu4fIOJN-Vyu-d__RYvfnKPaLu4pJ2cOmRVKh2Qc6pHnjXDP2powPu2R6pD6KcANZhEE4AEVAw
61
+ - type: loss
62
+ value: 2.184831380844116
63
+ name: loss
64
+ verified: true
65
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNTJkZjk3Y2YwM2E4ZDQxYzZkOGNkYzY3N2I4NzkyZmU4ZjYyYjk1Y2FiZjRkN2I1MTEzZmI4Y2FjNjBiYWNjZiIsInZlcnNpb24iOjF9.7OgmxB2mQ7CYH9p9p56bf7cAjkA6YflzB75zd0-O1WYgrsEibX-Zb2H6-0SMqxD-drWrRrEpma1Tu1fWSkBhDQ
66
+ - type: gen_len
67
+ value: 42.2081
68
+ name: gen_len
69
+ verified: true
70
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMmEyZmYyOGVmN2JlYzM2MzI4YzU3ZDhjYmYwZDlhZTliNzk0ODVjNjU5MGNlMmRjOGZiOTk0MGU1YWM0NDcxMCIsInZlcnNpb24iOjF9.b9-F5AzXERN-pVcH61r23kaqdKO4iX79mQPRnoZ_riZ91o6UihsNftdGa50vgleloGDwkKT4aR6PNMZujCRZDQ
71
  ---
72
 
73
  ## `t5-large-samsum-deepspeed`