D1 / added_tokens.json
rpa020's picture
Upload tokenizer
e3c4632 verified
{
"<|endoftext|>": 25000
}