malaysia-ai
/

bpe-tokenizer

Model card Files Files and versions Community

huseinzol05 commited on Nov 27, 2023

Commit

4ebe40e

•

1 Parent(s): 1287f2f

Create README.md

Files changed (1) hide show

README.md +3 -0

README.md ADDED Viewed

	@@ -0,0 +1,3 @@


1	+ # Malaysian BPE Tokenizer
2	+
3	+ README at https://github.com/malaysia-ai/prepare-tokenizer