llama-hebrew-tokenizer-20k / tokenizer_config.json

Commit History

Upload tokenizer
52e9922

Norod78 commited on