infinitejoy's picture
add tokenizer
8fbe597
raw
history blame
23 Bytes
{"<s>": 65, "</s>": 66}