This is great! Would it be possible to add any custom tokenizer if they are hosted in HF?
Functionality added
Thank you for the feedback
· Sign up or log in to comment
