llama2-13b-8k-vyatta / added_tokens.json
frank098's picture
Upload tokenizer
aa0c244
{
"<pad>": 32000,
"<|assistant|>": 32001,
"<|prefix_begin|>": 32004,
"<|prefix_end|>": 32002,
"<|prompter|>": 32005,
"<|system|>": 32003
}