darijabertgenad / added_tokens.json
IssamL's picture
Upload tokenizer
30298e7
raw
history blame contribute delete
64 Bytes
{
"</s>": 3,
"<pad>": 2,
"<s>": 1,
"<|endoftext|>": 0
}