xlm-roberta-base / tokenizer_config.json
lysandre's picture
lysandre HF staff
Adds the tokenizer configuration file (#27)
e73636d verified
raw history blame
No virus
25 Bytes
{"model_max_length": 512}