RITA_s / tokenizer_config.json
DanielHesslow's picture
add tokenizer
8ca1e4f
raw
history blame
167 Bytes
{"special_tokens_map_file": "Seledorn/RITA_tokenizer/special_tokens_map.json", "name_or_path": "Seledorn/RITA_tokenizer", "tokenizer_class": "PreTrainedTokenizerFast"}