journaux-lm-v1 / tokenizer_config.json
stefan-it's picture
tokenizer: add config and vocab
1bf6fbf verified
raw
history blame
49 Bytes
{"do_lower_case": false, "model_max_length": 512}