Hugging Face's logo

sarnikowski
/
electra-small-discriminator-da-256-cased

Transformers
PyTorch
TensorFlow
Danish
electra
pretraining
Inference Endpoints
Model card Files Community
electra-small-discriminator-da-256-cased / README.md
julien-c's picture
julien-c HF staff
Migrate model card from transformers-repo
290fcaf
preview code
|
raw
history blame contribute delete
824 Bytes
metadata
language: da
license: cc-by-4.0

Danish ELECTRA small (cased)

An ELECTRA model pretrained on a custom Danish corpus (~17.5gb). For details regarding data sources and training procedure, along with benchmarks on downstream tasks, go to: https://github.com/sarnikowski/danish_transformers/tree/main/electra

Usage 

from transformers import AutoTokenizer, AutoModel

tokenizer = AutoTokenizer.from_pretrained("sarnikowski/electra-small-discriminator-da-256-cased")
model = AutoModel.from_pretrained("sarnikowski/electra-small-discriminator-da-256-cased")

Questions?

If you have any questions feel free to open an issue on the danish_transformers repository, or send an email to p.sarnikowski@gmail.com