File size: 1,829 Bytes
66e2965
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
# Vocabulary Trimmed [lmqg/mbart-large-cc25-frquad-qa](https://huggingface.co/lmqg/mbart-large-cc25-frquad-qa): `vocabtrimmer/mbart-large-cc25-frquad-qa-trimmed-fr` 
This model is a trimmed version of [lmqg/mbart-large-cc25-frquad-qa](https://huggingface.co/lmqg/mbart-large-cc25-frquad-qa) by [`vocabtrimmer`](https://github.com/asahi417/lm-vocab-trimmer), a tool for trimming vocabulary of language models to compress the model size.
Following table shows a summary of the trimming process.

|                            | lmqg/mbart-large-cc25-frquad-qa   | vocabtrimmer/mbart-large-cc25-frquad-qa-trimmed-fr   |
|:---------------------------|:----------------------------------|:-----------------------------------------------------|
| parameter_size_full        | 610,852,864                       | 442,588,160                                          |
| parameter_size_embedding   | 512,057,344                       | 175,527,936                                          |
| vocab_size                 | 250,028                           | 85,707                                               |
| compression_rate_full      | 100.0                             | 72.45                                                |
| compression_rate_embedding | 100.0                             | 34.28                                                |


Following table shows the parameter used to trim vocabulary.

 | language   | dataset                     | dataset_column   | dataset_name   | dataset_split   | target_vocab_size   |   min_frequency |
|:-----------|:----------------------------|:-----------------|:---------------|:----------------|:--------------------|----------------:|
| fr         | vocabtrimmer/mc4_validation | text             | fr             | validation      |                     |               2 |