nekozutranslate / added_tokens.json
farihdzaky's picture
Upload tokenizer
119958e verified
raw
history blame contribute delete
29 Bytes
{
"<|PAD_TOKEN|>": 49152
}