FinTwitBERT / added_tokens.json
StephanAkkerman's picture
Added tokenizer files
dac3fb4
raw
history blame
100 Bytes
{
"@USER": 30522,
"[CLS]": 101,
"[MASK]": 103,
"[PAD]": 0,
"[SEP]": 102,
"[UNK]": 100
}