lrl-modelcloud's picture
Use GPT2Tokenizer instead of Tiktokenizer (#3)
26db1b2 verified