rugpt3large_neuro_chgk / added_tokens.json
mary905el's picture
add tokenizer
c3708d6
raw
history blame contribute delete
137 Bytes
{"[PAD]": 50262, "[CLS]": 50263, "<|endoftext|>": 50257, "[MASK]": 50264, "[UNK]": 50260, "[BOS]": 50258, "[EOS]": 50259, "[SEP]": 50261}