x-r-hy / added_tokens.json
yerevann's picture
add tokenizer
cfc81e8
raw
history blame
23 Bytes
{"<s>": 50, "</s>": 51}