IndicTransTokenizer is missing
#2
by
PankajSingh0018
- opened
The custom tokenizer file with the name IndicTransTokenizer was missing from the github repo, thus unable to run the examples
We have migrated the custom IndicTrans2 tokenizer (for HF compatible IndicTrans2 models) to IndicTransTokenizer repository and it will be maintained there separately from now onwards.
This is automatically installed when you call install.sh script in huggingface_interface.
pranjalchitale
changed discussion status to
closed