kogpt_6b_fp16 / special_tokens_map.json
MrBananaHuman
add tokenizer
fc45e64
raw
history blame
88 Bytes
{"bos_token": "[BOS]", "eos_token": "[EOS]", "unk_token": "[UNK]", "pad_token": "[PAD]"}