antoinelouis commited on
Commit
805fd9c
·
1 Parent(s): d7e1dc2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -39,6 +39,8 @@ output = model(**encoded_input)
39
 
40
  ## Variations
41
 
 
 
42
  | Model | #Params | Size | Pruning |
43
  |--------------------------------------------------------------------|:-------:|:-----:|:-------:|
44
  | [CamemBERT](https://huggingface.co/camembert-base) | 110.6M | 445MB | - |
@@ -51,6 +53,8 @@ output = model(**encoded_input)
51
 
52
  ## Citation
53
 
 
 
54
  ```bibtex
55
  @online{louis2023,
56
  author = 'Antoine Louis',
 
39
 
40
  ## Variations
41
 
42
+ CamemBERT has originally been released in base (110M) and large (335M) variations. The following checkpoints prune the base variation by dropping the top 2, 4, 6, 8, and 10 pretrained encoding layers, repsectively.
43
+
44
  | Model | #Params | Size | Pruning |
45
  |--------------------------------------------------------------------|:-------:|:-----:|:-------:|
46
  | [CamemBERT](https://huggingface.co/camembert-base) | 110.6M | 445MB | - |
 
53
 
54
  ## Citation
55
 
56
+ For attribution in academic contexts, please cite this work as:
57
+
58
  ```bibtex
59
  @online{louis2023,
60
  author = 'Antoine Louis',