gpt2_oasst2_curated / added_tokens.json
shi-zheng-qxhs's picture
Upload tokenizer
2cec65d verified
{
"<|assistant|>": 50260,
"<|end|>": 50259,
"<|system|>": 50258,
"<|user|>": 50257
}