antoinelouis
commited on
Commit
•
ee65970
1
Parent(s):
2bc86f5
Update README.md
Browse files
README.md
CHANGED
@@ -39,11 +39,11 @@ output = model(**encoded_input)
|
|
39 |
|
40 |
## Variations
|
41 |
|
42 |
-
|
43 |
|
44 |
| Model | #Params | Size | Pruning |
|
45 |
|--------------------------------------------------------------------|:-------:|:-----:|:-------:|
|
46 |
-
| [CamemBERT](https://huggingface.co/camembert-base)
|
47 |
| | | | |
|
48 |
| [CamemBERT-L10](https://huggingface.co/antoinelouis/camembert-L10) | 96.4M | 386MB | -13% |
|
49 |
| [CamemBERT-L8](https://huggingface.co/antoinelouis/camembert-L8) | 82.3M | 329MB | -26% |
|
|
|
39 |
|
40 |
## Variations
|
41 |
|
42 |
+
CamemBERT has originally been released in base (110M) and large (335M) variations. The following checkpoints prune the base variation by dropping the top 2, 4, 6, 8, and 10 pretrained encoding layers, respectively.
|
43 |
|
44 |
| Model | #Params | Size | Pruning |
|
45 |
|--------------------------------------------------------------------|:-------:|:-----:|:-------:|
|
46 |
+
| [CamemBERT-base](https://huggingface.co/camembert-base) | 110.6M | 445MB | - |
|
47 |
| | | | |
|
48 |
| [CamemBERT-L10](https://huggingface.co/antoinelouis/camembert-L10) | 96.4M | 386MB | -13% |
|
49 |
| [CamemBERT-L8](https://huggingface.co/antoinelouis/camembert-L8) | 82.3M | 329MB | -26% |
|