codebert-llvm-ic-v0 / special_tokens_map.json
iyaja's picture
add tokenizer
92cad50
{"sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]"}