CHILDES-Farsi-phoneme-tokenizer / added_tokens.json
codebyzeb's picture
Upload tokenizer
fcab9a5 verified
raw
history blame
No virus
26 Bytes
{
"<|endoftext|>": 31
}