tweets / special_tokens_map.json
lievan's picture
Upload ./ with huggingface_hub (#3)
bd0df1c
raw
history blame
214 Bytes
{"bos_token": "<bos>", "eos_token": "<eos>", "unk_token": "<|endoftext|>", "pad_token": "<pad>", "additional_special_tokens": ["<dense-vectors>", "<tokens>", "<verb>", "<ARG0>", "<ARG1>", "<global-dense-vectors>"]}