manojpreveen
commited on
Commit
•
5978d53
1
Parent(s):
22d1946
Update README.md
Browse files
README.md
CHANGED
@@ -5,7 +5,6 @@ tags:
|
|
5 |
license: apache-2.0
|
6 |
datasets:
|
7 |
- cnn_dailymail
|
8 |
-
- xsum
|
9 |
thumbnail: https://huggingface.co/front/thumbnails/distilbart_medium.png
|
10 |
---
|
11 |
|
@@ -15,15 +14,9 @@ This checkpoint should be loaded into `BartForConditionalGeneration.from_pretrai
|
|
15 |
|
16 |
### Metrics for DistilBART models
|
17 |
|
18 |
-
| Model Name
|
19 |
-
|
20 |
-
|
|
21 |
-
| distilbart-
|
22 |
-
| distilbart-
|
23 |
-
| distilbart-
|
24 |
-
| bart-large-xsum (baseline) | 406 | 229 | 1 | 21.85 | 36.50 |
|
25 |
-
| distilbart-xsum-12-6 | 306 | 137 | 1.68 | 22.12 | 36.99 |
|
26 |
-
| bart-large-cnn (baseline) | 406 | 381 | 1 | 21.06 | 30.63 |
|
27 |
-
| distilbart-12-3-cnn | 255 | 214 | 1.78 | 20.57 | 30.00 |
|
28 |
-
| distilbart-12-6-cnn | 306 | 307 | 1.24 | 21.26 | 30.59 |
|
29 |
-
| distilbart-6-6-cnn | 230 | 182 | 2.09 | 20.17 | 29.70 |
|
|
|
5 |
license: apache-2.0
|
6 |
datasets:
|
7 |
- cnn_dailymail
|
|
|
8 |
thumbnail: https://huggingface.co/front/thumbnails/distilbart_medium.png
|
9 |
---
|
10 |
|
|
|
14 |
|
15 |
### Metrics for DistilBART models
|
16 |
|
17 |
+
| Model Name | MM Params | Inference Time (MS) | Speedup | Rouge 2 | Rouge-L |
|
18 |
+
|:------------------------------------|------------:|----------------------:|----------:|----------:|----------:|
|
19 |
+
| facebook/bart-large-cnn (baseline) | 406 | 381 | 1 | 21.06 | 30.63 |
|
20 |
+
| manojpreveen/distilbart-cnn-v3 | 306 | 307 | 1.24 | 21.26 | 30.59 |
|
21 |
+
| manojpreveen/distilbart-cnn-v2 | 255 | 214 | 1.78 | 20.57 | 30.00 |
|
22 |
+
| manojpreveen/distilbart-cnn-v1 | 230 | 182 | 2.09 | 20.17 | 29.70 |
|
|
|
|
|
|
|
|
|
|
|
|