Commit
•
16737ee
1
Parent(s):
77653b1
Add evaluation results on the samsum config and train split of samsum
Browse filesBeep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the samsum config and train split of the [samsum](https://huggingface.co/datasets/samsum) dataset by
@uunicee
, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-samsum-samsum-0cab72-2447375877).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=samsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=samsum).
README.md
CHANGED
@@ -1,31 +1,73 @@
|
|
1 |
-
|
2 |
---
|
3 |
language: en
|
|
|
4 |
tags:
|
5 |
- azureml
|
6 |
- t5
|
7 |
- summarization
|
8 |
- deepspeed
|
9 |
-
license: apache-2.0
|
10 |
datasets:
|
11 |
- samsum
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
12 |
model-index:
|
13 |
-
- name: t5-large-samsum-deepspeed
|
14 |
results:
|
15 |
-
- task:
|
16 |
-
|
17 |
-
|
18 |
dataset:
|
19 |
-
name:
|
20 |
type: samsum
|
21 |
-
|
22 |
-
|
23 |
-
|
24 |
-
|
25 |
-
|
26 |
-
|
27 |
-
|
28 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
29 |
---
|
30 |
|
31 |
## `t5-large-samsum-deepspeed`
|
|
|
|
|
1 |
---
|
2 |
language: en
|
3 |
+
license: apache-2.0
|
4 |
tags:
|
5 |
- azureml
|
6 |
- t5
|
7 |
- summarization
|
8 |
- deepspeed
|
|
|
9 |
datasets:
|
10 |
- samsum
|
11 |
+
widget:
|
12 |
+
- text: 'Kevin: Hey man, are you excited to watch Finding Nemo tonight?
|
13 |
+
|
14 |
+
Henry: Yea, I can''t wait to watch that same movie for the 89th time. Is Nate
|
15 |
+
coming over to watch it with us tonight?
|
16 |
+
|
17 |
+
Kevin: Yep, he said he''ll be arriving a bit later at around 7 since he gets off
|
18 |
+
of work at 6. Have you taken out the garbage yet? It''s starting to make the kitchen
|
19 |
+
really smell.
|
20 |
+
|
21 |
+
Henry: Oh I forgot. I''ll do that once I''m finished with my assignment for my
|
22 |
+
math class. I didn''t get to start on it until an hour ago, and it''s due in 30
|
23 |
+
minutes.
|
24 |
+
|
25 |
+
Kevin: Okay dude, you should take it out as soon as possible. By the way, Nate
|
26 |
+
is bringing his girlfriend and their cat too.
|
27 |
+
|
28 |
+
Henry: Nice, I''m really looking forward to seeing them again.'
|
29 |
model-index:
|
30 |
+
- name: henryu-lin/t5-large-samsum-deepspeed
|
31 |
results:
|
32 |
+
- task:
|
33 |
+
type: summarization
|
34 |
+
name: Summarization
|
35 |
dataset:
|
36 |
+
name: samsum
|
37 |
type: samsum
|
38 |
+
config: samsum
|
39 |
+
split: train
|
40 |
+
metrics:
|
41 |
+
- type: rouge
|
42 |
+
value: 40.8694
|
43 |
+
name: ROUGE-1
|
44 |
+
verified: true
|
45 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZjgxNDg4YjM4YjY0MDVhZmY5ZjQ1YTgyN2RhOGIwY2M5YjljMjAwYjI0ZWEzMzMxMzBlYmE5MjY3ODM1MjI4YiIsInZlcnNpb24iOjF9.NkOSwlWC_r8ewewRk1X9KJxaTEWZ0lDz0SuABLeUf1tESeTBowSJJBXgwiYb7gjpHnipfcK2HczlNRl-KzdDAA
|
46 |
+
- type: rouge
|
47 |
+
value: 19.223
|
48 |
+
name: ROUGE-2
|
49 |
+
verified: true
|
50 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNjc3ZTY3ZWU0OWE5Zjc1ZjdiZWE4NDQ0YzI3MTMxNTM3ZDRjY2Y1YWM1OWQyOWMwMTZlMmRlZTI5ZGNkMmI5OSIsInZlcnNpb24iOjF9.4jHtzkDGNLPHSC7RN9Hi5jeiLy9F3JwBpDKdCjkiDmZY_cgHHCTr5v6QTr7VISZNQdCNg27iO0d8ohSIxVVXBg
|
51 |
+
- type: rouge
|
52 |
+
value: 31.0688
|
53 |
+
name: ROUGE-L
|
54 |
+
verified: true
|
55 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNmQzZjhhMjJjZWFkYWViODlhMDQ4MTY0YWI4NzRjZWMyMGZlMDQ1MjA0Yzk0MTczOWU0ODMyYjQ3NGEwOTZhNiIsInZlcnNpb24iOjF9.nUPHLaP5n_7YYbtV6ms0-fOGtPvEx826Ivsv-MfKiUVKyxTJ-9G_xbECK2cS1XQxuO05tlWhO89zz03vsNkuAQ
|
56 |
+
- type: rouge
|
57 |
+
value: 38.3786
|
58 |
+
name: ROUGE-LSUM
|
59 |
+
verified: true
|
60 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNTJlMGUwMTE4NWRkMWZkYzU0NzA3ODQzOWE2MWY3MWU2YmFjNzQ0ZTU2MDZiYTY0ZmY2N2U4NmUyOTY5NDRkMiIsInZlcnNpb24iOjF9.-T68JCuA99EVzu4fIOJN-Vyu-d__RYvfnKPaLu4pJ2cOmRVKh2Qc6pHnjXDP2powPu2R6pD6KcANZhEE4AEVAw
|
61 |
+
- type: loss
|
62 |
+
value: 2.184831380844116
|
63 |
+
name: loss
|
64 |
+
verified: true
|
65 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNTJkZjk3Y2YwM2E4ZDQxYzZkOGNkYzY3N2I4NzkyZmU4ZjYyYjk1Y2FiZjRkN2I1MTEzZmI4Y2FjNjBiYWNjZiIsInZlcnNpb24iOjF9.7OgmxB2mQ7CYH9p9p56bf7cAjkA6YflzB75zd0-O1WYgrsEibX-Zb2H6-0SMqxD-drWrRrEpma1Tu1fWSkBhDQ
|
66 |
+
- type: gen_len
|
67 |
+
value: 42.2081
|
68 |
+
name: gen_len
|
69 |
+
verified: true
|
70 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMmEyZmYyOGVmN2JlYzM2MzI4YzU3ZDhjYmYwZDlhZTliNzk0ODVjNjU5MGNlMmRjOGZiOTk0MGU1YWM0NDcxMCIsInZlcnNpb24iOjF9.b9-F5AzXERN-pVcH61r23kaqdKO4iX79mQPRnoZ_riZ91o6UihsNftdGa50vgleloGDwkKT4aR6PNMZujCRZDQ
|
71 |
---
|
72 |
|
73 |
## `t5-large-samsum-deepspeed`
|