language-modeling-from-scratch / added_tokens.json
Tural's picture
Upload tokenizer
8dc8639
raw
history blame contribute delete
No virus
88 Bytes
{
"[CLS]": 2,
"[FRN]": 5,
"[MASK]": 4,
"[PAD]": 1,
"[SEP]": 3,
"[UNK]": 0
}