albert-pt-br / added_tokens.json
josu's picture
add tokenizer
db97e63
raw
history blame
65 Bytes
{"[CLS]": 32000, "[SEP]": 32001, "<pad>": 32002, "[MASK]": 32003}