Hugging Face's logo

THUDM
/
chatglm-6b

Transformers
PyTorch
Chinese
English
chatglm
glm
thudm
custom_code
Inference Endpoints
Model card Files Community
109
chatglm-6b / tokenization_chatglm.py

Commit History

Update decode method in tokenizer
4d0fc39

zxdu20 commited on

Always add gmask in token ids
3a99d79

zxdu20 commited on

Fix bug
53f0197

zxdu20 commited on

Fix eos token in tokenizer
aa51e62

zxdu20 commited on

Fix tokenizer config saving
7e69b85

zxdu20 commited on

Add gmask token id
36b7f2d

zxdu20 commited on

Update code for slim
63ce1ba

zxdu20 commited on

Drop icetk dependency
72985e8

zxdu20 commited on

Fix decode method for torch tensor
23ad39b

zxdu20 commited on

Support single integer or empty list as input to decode (#7)
fdb7a60

zxdu20 peakji commited on

Fix generate
fb23542

zxdu20 commited on

Fix attention_mask and position_ids
373fd6b

zxdu20 commited on

Fix encode method
e22cddf

zxdu20 commited on

Fix batch input
e1494f2

zxdu20 commited on

Implement batch generation
cc96a22

zxdu20 commited on

Change padding side
db22499

zxdu20 commited on

Fix typo in tokenization_chatglm.py
1b54948

songxxzp commited on

Remove image tokens when decoding
8492687

zxdu20 commited on

Update tokenizer
c4575e7

zxdu20 commited on

Add chatglm-6b
d11c6aa

Sengxian commited on