baebee
/

nuph-tokenizer

Transformers.js

Inference Endpoints

Model card Files Files and versions Community

baebee commited on Oct 11, 2023

Commit

0244572

•

1 Parent(s): 054de2e

Create README.md

Files changed (1) hide show

README.md +14 -0

README.md ADDED Viewed

	@@ -0,0 +1,14 @@

+---
+license: mit
+tags:
+- tokenizers
+- Tokenizers.js
+- Transformers
+- experimental
+- auto tokenizer
+- llama
+- llama 2
+- custom code
+---
+# Experimental tokenizer