BanglaGPT / added_tokens.json
shahidul034's picture
Upload tokenizer
a29b2f6 verified
raw
history blame contribute delete
47 Bytes
{
"<|endoftext|>": 50000,
"[UNK]": 50001
}