LeetCodeWizard_7B_V1.0 / added_tokens.json
Nan-Do's picture
Upload tokenizer
50e94a6
raw
history blame
105 Bytes
{
"[PAD]": 32000,
"▁<EOT>": 32004,
"▁<MID>": 32002,
"▁<PRE>": 32001,
"▁<SUF>": 32003
}