sn29_merged_v4 / added_tokens.json
luaqi's picture
Upload tokenizer
4e72061 verified
raw
history blame contribute delete
101 Bytes
{
"<|endofprompt|>": 100276,
"<|im_end|>": 100265,
"<|im_start|>": 100264,
"[PAD]": 100277
}