AnimeGPTSan / added_tokens.json
maharshipandya's picture
Upload tokenizer
ae7cd66
{
"<|pad|>": 50258,
"<|startoftext|>": 50257
}