Changes for fast tokenizer

#10
jonatanklosko changed pull request status to open
ArthurZ changed pull request status to merged

Sign up or log in to comment