Model added

README.md

@@ -0,0 +1,54 @@
+----
+language:
+- is
+thumbnail: 
+tags:
+- icelandic
+- qa
+license: 
+datasets:
+- ic3
+- igc
+metrics:
+- em
+- f1
+widget:
+- text: "Hverrar trúar var Halldór Laxness ?"
+  context: "Halldór Kiljan Laxness was born in 1902 in Reykjavik , the capital of Iceland , but spent his youth in the country . From the age of seventeen on , he travelled and lived abroad , chiefly on the European continent . He was influenced by expressionism and other modern currents in Germany and France . In the mid-twenties he was converted to Catholicism ; his spiritual experiences are reflected in several books of an autobiographical nature , chiefly Undir Helgahnúk ( Under the Holy Mountain ) , 1924 . In 1927 , he published his first important novel , Vefarinn mikli frá Kasmír ( The Great Weaver from Kashmir ) . Laxness’s religious period did not last long ; during a visit to America he became attracted to socialism . Alþydubókin ( The Book of the People ) , 1929 , is evidence of a change toward a socialist outlook . In 1930 , Laxness settled in Iceland . Laxness’s main achievement consists of three novel cycles written during the thirties , dealing with the people of Iceland . Þú vínviður hreini , 1931 , and Fuglinn í fjörunni , 1932 , ( both translated as Salka Valka ) , tell the story of a poor fisher girl ; Sjálfstætt fólk ( Independent People ) , 1934 - 35 , treats the fortunes of small farmers , whereas the tetralogy Ljós heimsins ( The Light of the World ) , 1937 - 40 , has as its hero an Icelandic folk poet . Laxness’s later works are frequently historical and influenced by the saga tradition : Íslandsklukkan ( The Bell of Iceland ) , 1943 - 46 , Gerpla ( The Happy Warriors ) , 1952 , and Paradísarheimt ( Paradise Reclaimed ) , 1960 . Laxness is also the author of the topical and sharply polemical Atómstöðin ( The Atom Station ) , 1948 ."
+
+---
+
+# XLMr-ENIS-QA-IsQ-EnA
+
+## Model description
+
+This is an Icelandic reading comprehension Q&A model.
+
+## Intended uses & limitations
+
+This model is part of my MSc thesis about Q&A for Icelandic.
+
+#### How to use
+
+```python
+from transformers import AutoTokenizer, AutoModelForQuestionAnswering
+  
+tokenizer = AutoTokenizer.from_pretrained("vesteinn/IceBERT-QA")
+
+model = AutoModelForQuestionAnswering.from_pretrained("vesteinn/IceBERT-QA")
+```
+
+#### Limitations and bias
+
+## Training data
+Translated English datasets were used along with the Natural Questions in Icelandic dataset.
+
+## Training procedure
+
+## Eval results
+
+### BibTeX entry and citation info
+
+```bibtex
+```
+

config.json

@@ -0,0 +1,26 @@
+{
+  "_name_or_path": "/p/project/joaiml/snaebjarnarson1/XLM/chkpt_27_204k",
+  "architectures": [
+    "XLMRobertaForQuestionAnswering"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "bos_token_id": 0,
+  "eos_token_id": 2,
+  "gradient_checkpointing": false,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 768,
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "layer_norm_eps": 1e-05,
+  "max_position_embeddings": 514,
+  "model_type": "xlm-roberta",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "pad_token_id": 1,
+  "position_embedding_type": "absolute",
+  "transformers_version": "4.6.0.dev0",
+  "type_vocab_size": 1,
+  "use_cache": true,
+  "vocab_size": 50005
+}

pytorch_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:21844b75209c199684393f1c8ff7039936d75cf7950fc74fd2201571b6f37ae3
+size 495517367

sentencepiece.bpe.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bb65eb67a28974dc307fed538cab36453dc8b0d934755dbdc54af9a9ad019cce
+size 1051645

special_tokens_map.json

@@ -0,0 +1 @@
+{"bos_token": "<s>", "eos_token": "</s>", "unk_token": "<unk>", "sep_token": "</s>", "pad_token": "<pad>", "cls_token": "<s>", "mask_token": "<mask>"}

tokenizer_config.json

@@ -0,0 +1 @@
+{"bos_token": "<s>", "eos_token": "</s>", "sep_token": "</s>", "cls_token": "<s>", "unk_token": "<unk>", "pad_token": "<pad>", "mask_token": {"content": "<mask>", "single_word": false, "lstrip": true, "rstrip": false, "normalized": true, "__type": "AddedToken"}, "special_tokens_map_file": "/p/project/joaiml/snaebjarnarson1/XLM/chkpt_27_204k/special_tokens_map.json", "name_or_path": "/p/project/joaiml/snaebjarnarson1/XLM/chkpt_27_204k"}