Qwen_test1 / added_tokens.json
fokyoum9's picture
Upload tokenizer
559d533 verified
raw
history blame contribute delete
237 Bytes
{
"<pad>": 151653,
"<|endoftext|>": 151643,
"<|im_end|>": 151645,
"<|im_start|>": 151644,
"[/INST]": 151648,
"[/RES]": 151652,
"[/SYS]": 151650,
"[INST]": 151647,
"[PAD]": 151646,
"[RES]": 151651,
"[SYS]": 151649
}