lrl-modelcloud's picture
Use GPT2Tokenizer instead of Tiktokenizer (#3)
ac709c7 verified