pranjalchitale commited on
Commit
74a49d3
1 Parent(s): 5b7ae93

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -62,6 +62,8 @@ Please refer to `Appendix D: Model Card` of the [preprint](https://arxiv.org/abs
62
 
63
  Please refer to the [github repository](https://github.com/AI4Bharat/IndicTrans2/tree/main/huggingface_inference) for a detail description on how to use HF compatible IndicTrans2 models for inference.
64
 
 
 
65
 
66
  ### Citation
67
 
 
62
 
63
  Please refer to the [github repository](https://github.com/AI4Bharat/IndicTrans2/tree/main/huggingface_inference) for a detail description on how to use HF compatible IndicTrans2 models for inference.
64
 
65
+ **Note: IndicTrans2 is not compatible with AutoTokenizer, therefore we provide [IndicTransTokenizer](https://github.com/VarunGumma/IndicTransTokenizer)**
66
+
67
 
68
  ### Citation
69