Commit
·
f394ef3
1
Parent(s):
9dda3a6
Update README.md
Browse files
README.md
CHANGED
@@ -2,4 +2,9 @@ This is a smaller version of the google/mt5-base model with only Spanish and som
|
|
2 |
|
3 |
|
4 |
The original model has 582M parameters, with 384M of them being input and output embeddings.
|
5 |
-
After shrinking the sentencepiece vocabulary from 250K to 30K (top 10K English and top 20K Spanish tokens) the number of model parameters reduced to 244M parameters, resulting on a model size reduced from 2.2GB to 0.9GB - 42% of the original one.
|
|
|
|
|
|
|
|
|
|
|
|
2 |
|
3 |
|
4 |
The original model has 582M parameters, with 384M of them being input and output embeddings.
|
5 |
+
After shrinking the sentencepiece vocabulary from 250K to 30K (top 10K English and top 20K Spanish tokens) the number of model parameters reduced to 244M parameters, resulting on a model size reduced from 2.2GB to 0.9GB - 42% of the original one.
|
6 |
+
---
|
7 |
+
language:
|
8 |
+
- es
|
9 |
+
- en
|
10 |
+
---
|