maritaca-ai
/

qwen2-maritalk-tokenizer-v2

Inference Endpoints

Model card Files Files and versions Community

qwen2-maritalk-tokenizer-v2 / added_tokens.json

hugo's picture

Upload tokenizer

2d096ae verified 24 days ago

history blame contribute delete

80 Bytes

	{
	"<\|endoftext\|>": 151643,
	"<\|im_end\|>": 151645,
	"<\|im_start\|>": 151644
	}