sjrosenthal
commited on
Commit
·
52afbc2
1
Parent(s):
a8f77eb
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,82 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
+
tags:
|
4 |
+
- MRC
|
5 |
+
- TyDiQA
|
6 |
+
- Natural Questions List
|
7 |
+
- xlm-roberta-large
|
8 |
+
language:
|
9 |
+
- multilingual
|
10 |
---
|
11 |
+
*Task*: MRC
|
12 |
+
|
13 |
+
# Model description
|
14 |
+
|
15 |
+
An XLM-RoBERTa reading comprehension model with joint training for TyDi, NQ, and List Question Answering (NQ list data) using a fine-tuned [SQuAD xlm-roberta-large](https://huggingface.co/PrimeQA/squad-v1-xlm-roberta-large) model
|
16 |
+
|
17 |
+
## Intended uses & limitations
|
18 |
+
|
19 |
+
You can use the raw model for the reading comprehension task. Biases associated with the pre-existing language model, xlm-roberta-large, that we used may be present in our fine-tuned model, joint-tydi-nq-list-task-xlm-roberta-large.
|
20 |
+
|
21 |
+
## Usage
|
22 |
+
|
23 |
+
You can use this model directly with the [PrimeQA](https://github.com/primeqa/primeqa) pipeline for reading comprehension [listqa.ipynb](https://github.com/primeqa/primeqa/blob/main/notebooks/mrc/listqa.ipynb).
|
24 |
+
|
25 |
+
### BibTeX entry and citation info
|
26 |
+
|
27 |
+
```bibtex
|
28 |
+
@article{kwiatkowski-etal-2019-natural,
|
29 |
+
title = "Natural Questions: A Benchmark for Question Answering Research",
|
30 |
+
author = "Kwiatkowski, Tom and
|
31 |
+
Palomaki, Jennimaria and
|
32 |
+
Redfield, Olivia and
|
33 |
+
Collins, Michael and
|
34 |
+
Parikh, Ankur and
|
35 |
+
Alberti, Chris and
|
36 |
+
Epstein, Danielle and
|
37 |
+
Polosukhin, Illia and
|
38 |
+
Devlin, Jacob and
|
39 |
+
Lee, Kenton and
|
40 |
+
Toutanova, Kristina and
|
41 |
+
Jones, Llion and
|
42 |
+
Kelcey, Matthew and
|
43 |
+
Chang, Ming-Wei and
|
44 |
+
Dai, Andrew M. and
|
45 |
+
Uszkoreit, Jakob and
|
46 |
+
Le, Quoc and
|
47 |
+
Petrov, Slav",
|
48 |
+
journal = "Transactions of the Association for Computational Linguistics",
|
49 |
+
volume = "7",
|
50 |
+
year = "2019",
|
51 |
+
address = "Cambridge, MA",
|
52 |
+
publisher = "MIT Press",
|
53 |
+
url = "https://aclanthology.org/Q19-1026",
|
54 |
+
doi = "10.1162/tacl_a_00276",
|
55 |
+
pages = "452--466",
|
56 |
+
}
|
57 |
+
```
|
58 |
+
|
59 |
+
```bibtex
|
60 |
+
@article{DBLP:journals/corr/abs-1911-02116,
|
61 |
+
author = {Alexis Conneau and
|
62 |
+
Kartikay Khandelwal and
|
63 |
+
Naman Goyal and
|
64 |
+
Vishrav Chaudhary and
|
65 |
+
Guillaume Wenzek and
|
66 |
+
Francisco Guzm{\'{a}}n and
|
67 |
+
Edouard Grave and
|
68 |
+
Myle Ott and
|
69 |
+
Luke Zettlemoyer and
|
70 |
+
Veselin Stoyanov},
|
71 |
+
title = {Unsupervised Cross-lingual Representation Learning at Scale},
|
72 |
+
journal = {CoRR},
|
73 |
+
volume = {abs/1911.02116},
|
74 |
+
year = {2019},
|
75 |
+
url = {http://arxiv.org/abs/1911.02116},
|
76 |
+
eprinttype = {arXiv},
|
77 |
+
eprint = {1911.02116},
|
78 |
+
timestamp = {Mon, 11 Nov 2019 18:38:09 +0100},
|
79 |
+
biburl = {https://dblp.org/rec/journals/corr/abs-1911-02116.bib},
|
80 |
+
bibsource = {dblp computer science bibliography, https://dblp.org}
|
81 |
+
}
|
82 |
+
```
|