artemnech
/

enrut5-base

Text2Text Generation

Inference Endpoints

Model card Files Files and versions Community

enrut5-base / tokenizer_config.json

artemnech's picture

add tokenizer

9608ab4 over 2 years ago

190 Bytes

	{
	"additional_special_tokens": null,
	"eos_token": "</s>",
	"extra_ids": 0,
	"pad_token": "<pad>",
	"sp_model_kwargs": {},
	"tokenizer_class": "T5Tokenizer",
	"unk_token": "<unk>"
	}