maritaca-ai
/

sabia-2-tokenizer-small

Model card Files Files and versions Community

rodrigo-nogueira commited on Feb 3

Commit

cf5935b

•

1 Parent(s): 7b35669

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -6,7 +6,7 @@ The purpose of including this tokenizer is to allow you to estimate the number o
 For example:
-```
 import transformers
 tokenizer = transformers.AutoTokenizer.from_pretrained("maritaca-ai/maritalk-tokenizer-small")

 For example:
+```python
 import transformers
 tokenizer = transformers.AutoTokenizer.from_pretrained("maritaca-ai/maritalk-tokenizer-small")