cognitivess / special_tokens_map.json
cognitivess's picture
Upload special_tokens_map.json with huggingface_hub
7de4175 verified
raw
history blame
88 Bytes
{"bos_token": "<|begin_of_text|>", "eos_token": "<|eot_id|>", "pad_token": "<|eot_id|>"}