mbarthez / tokenizer_config.json
lysandre's picture
lysandre HF staff
Adds tokenizer_config.json file
3a5891a verified
raw
history blame
26 Bytes
{"model_max_length": 1024}