CodeGPT-small-py-adaptedGPT2 / added_tokens.json
claudios's picture
Upload tokenizer
ff27607 verified
raw
history blame
78 Bytes
{
"</s>": 50259,
"<pad>": 50257,
"<s>": 50258,
"<|UNKNOWN|>": 50260
}