| language: da | |
| tags: | |
| - danish | |
| - bert | |
| - masked-lm | |
| - Certainly | |
| license: cc-by-4.0 | |
| datasets: | |
| - common_crawl | |
| - wikipedia | |
| - dindebat.dk | |
| - hestenettet.dk | |
| - danish OpenSubtitles | |
| pipeline_tag: fill-mask | |
| widget: | |
| - text: "København er [MASK] i Danmark." | |
| # Danish BERT (version 2, uncased) by [Certainly](https://certainly.io/) (previously known as BotXO). | |
| All credit goes to [Certainly](https://certainly.io/) (previously known as BotXO), who developed Danish BERT. For data and training details see their [GitHub repository](https://github.com/certainlyio/nordic_bert) or [this article](https://www.certainly.io/blog/danish-bert-model/). | |
| It is both available in TensorFlow and Pytorch format. | |
| The original TensorFlow version can be downloaded using [this link](https://www.dropbox.com/s/19cjaoqvv2jicq9/danish_bert_uncased_v2.zip?dl=1). | |
| Here is an example on how to load Danish BERT in PyTorch using the [🤗Transformers](https://github.com/huggingface/transformers) library: | |
| ```python | |
| from transformers import AutoTokenizer, AutoModelForPreTraining | |
| tokenizer = AutoTokenizer.from_pretrained("Maltehb/danish-bert-botxo") | |
| model = AutoModelForPreTraining.from_pretrained("Maltehb/danish-bert-botxo") | |
| ``` | |