SOBertBase / tokenizer_config.json
mmukh's picture
Upload 3 files
9edf289
raw
history blame contribute delete
79 Bytes
{
"model_max_length": 2048,
"tokenizer_class": "PreTrainedTokenizerFast"
}