rnaernie / tokenizer_config.json
ZhiyuanChen's picture
Upload folder using huggingface_hub
c397eef verified
{
"tokenizer_class": "RnaTokenizer",
"clean_up_tokenization_spaces": true,
"model_max_length": 513
}