imvladikon
commited on
Commit
•
e5596d9
1
Parent(s):
a568a8f
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
|
2 |
+
converted checkpoint of [XLM-V](https://dl.fbaipublicfiles.com/fairseq/xlmv/xlmv.base.tar.gz) from fairseq to huggingface
|
3 |
+
|
4 |
+
**Note: please use official checkpoints, if they will be added to transformers** (this repo is for personal usage/experiments)
|
5 |
+
|
6 |
+
Citation
|
7 |
+
--------
|
8 |
+
```
|
9 |
+
@misc{https://doi.org/10.48550/arxiv.2301.10472,
|
10 |
+
doi = {10.48550/ARXIV.2301.10472},
|
11 |
+
url = {https://arxiv.org/abs/2301.10472},
|
12 |
+
author = {Liang, Davis and Gonen, Hila and Mao, Yuning and Hou, Rui and Goyal, Naman and Ghazvininejad, Marjan and Zettlemoyer, Luke and Khabsa, Madian},
|
13 |
+
keywords = {Computation and Language (cs.CL), Machine Learning (cs.LG), FOS: Computer and information sciences, FOS: Computer and information sciences},
|
14 |
+
title = {XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models},
|
15 |
+
publisher = {arXiv},
|
16 |
+
year = {2023},
|
17 |
+
copyright = {Creative Commons Attribution Share Alike 4.0 International}
|
18 |
+
}
|
19 |
+
```
|