internlm
/

internlm2-20b

Text Generation

Model card Files Files and versions Community

internlm2-20b / tokenization_internlm2_fast.py

Commit History

fix no white space when using stream_chat with fast tokenizer

f689c06

x54-729 commited on Feb 28, 2024

fast tokenizer and stream_chat fix (#2)

3996794
verified

x54-729 commited on Jan 24, 2024