bnunticha
/

sentence-tokenizer-th

Token Classification

Generated from Trainer

Inference Endpoints

Model card Files Files and versions Community

sentence-tokenizer-th / added_tokens.json

bnunticha's picture

Training in progress, step 500

fc70118 over 1 year ago

history blame contribute delete

126 Bytes

	{
	"</s>": 6,
	"</s>NOTUSED": 2,
	"<_>": 8,
	"<mask>": 25004,
	"<pad>": 1,
	"<s>": 5,
	"<s>NOTUSED": 0,
	"<unk>": 3
	}