FacebookAI
/

xlm-mlm-ende-1024

xlm-mlm-ende-1024 / tokenizer_config.json

lysandre HF staff

Create tokenizer_config.json

56a2753 about 3 years ago

No virus

129 Bytes

{"model_max_length": 512, "do_lowercase_and_remove_accent": "true", "id2lang": {0: "de", 1: "en"}, "lang2id": {"de": 0, "en": 1}}