antoinelouis
commited on
Commit
·
805fd9c
1
Parent(s):
d7e1dc2
Update README.md
Browse files
README.md
CHANGED
@@ -39,6 +39,8 @@ output = model(**encoded_input)
|
|
39 |
|
40 |
## Variations
|
41 |
|
|
|
|
|
42 |
| Model | #Params | Size | Pruning |
|
43 |
|--------------------------------------------------------------------|:-------:|:-----:|:-------:|
|
44 |
| [CamemBERT](https://huggingface.co/camembert-base) | 110.6M | 445MB | - |
|
@@ -51,6 +53,8 @@ output = model(**encoded_input)
|
|
51 |
|
52 |
## Citation
|
53 |
|
|
|
|
|
54 |
```bibtex
|
55 |
@online{louis2023,
|
56 |
author = 'Antoine Louis',
|
|
|
39 |
|
40 |
## Variations
|
41 |
|
42 |
+
CamemBERT has originally been released in base (110M) and large (335M) variations. The following checkpoints prune the base variation by dropping the top 2, 4, 6, 8, and 10 pretrained encoding layers, repsectively.
|
43 |
+
|
44 |
| Model | #Params | Size | Pruning |
|
45 |
|--------------------------------------------------------------------|:-------:|:-----:|:-------:|
|
46 |
| [CamemBERT](https://huggingface.co/camembert-base) | 110.6M | 445MB | - |
|
|
|
53 |
|
54 |
## Citation
|
55 |
|
56 |
+
For attribution in academic contexts, please cite this work as:
|
57 |
+
|
58 |
```bibtex
|
59 |
@online{louis2023,
|
60 |
author = 'Antoine Louis',
|