windowsartes
/

funnel_tokenizer

Model card Files Files and versions Community

funnel_tokenizer / added_tokens.json

windowsartes's picture

Upload tokenizer

3c2ba1f verified 6 months ago

history blame contribute delete

113 Bytes

	{
	"</s>": 903,
	"<s>": 902,
	"[CLS]": 907,
	"[MASK]": 908,
	"[PAD]": 906,
	"[SEP]": 905,
	"[UNK]": 904
	}