Merge branch 'main' of https://huggingface.co/pere/norwegian-gpt2-social into main

README.md

@@ -5,12 +5,23 @@ tags:
 - norwegian
 - GPT2
 - casual language modeling
-datasets:
-- oscar
 ---
 
-# Norwegian GPT-2 - Oscar
+# Norwegian GPT-2 - Social
 
 ## Description
+Experimental Norwegian GPT-2-model trained on a 37GB mainly social corpus.
 
-This is a sample reference model trained only on the Oscar Corpus for a day on a TPU v3-8. Pretrained model on Norwegian language using a causal language modeling (CLM) objective.
+The following sub-corpora are used:
+```bash
+wikipedia_download_nb.jsonl
+wikipedia_download_nn.jsonl
+newspapers_online_nb.jsonl
+newspapers_online_nn.jsonl
+twitter_2016_2018_no.jsonl
+twitter_news_2016_2018_no.jsonl
+open_subtitles_no.jsonl
+facebook_no.jsonl
+reddit_no.jsonl
+vgdebatt_no.jsonl
+```