plt5-small / tokenizer_config.json
rmroczkowski's picture
First version of the plT5 Small model and tokenizer.
bd522da
raw
history blame
141 Bytes
{"eos_token": "</s>", "unk_token": "<unk>", "pad_token": "<pad>", "extra_ids": 0, "additional_special_tokens": null, "tokenizer_file": null}