gpt1_no-pretrain_xnli_exp2 / tokenizer_config.json

Training in progress, step 1000

17a1d9b about 1 year ago

163 Bytes

	{
	"clean_up_tokenization_spaces": true,
	"model_max_length": 512,
	"padding_side": "left",
	"tokenizer_class": "OpenAIGPTTokenizer",
	"unk_token": "<unk>"
	}