codebert-llvm-ic-v0 / special_tokens_map.json
iyaja's picture
add tokenizer
92cad50
raw
history blame
66 Bytes
{"sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]"}