sigil-ml
/

WikipediaBPETokenizer

Model card Files Files and versions Community

WikipediaBPETokenizer / tokenizer.json

sdwalker62's picture

Rename bpe_tokenizer.json to tokenizer.json

37b9e7d verified about 2 months ago

history contribute delete

842 kB

File too large to display, you can check the raw version instead.