xu-song's picture
add more tokenizers
f4973d4
|
raw
history blame
231 Bytes
## AttributeError: 'BaichuanTokenizer' object has no attribute 'sp_model'
https://huggingface.co/baichuan-inc/Baichuan2-13B-Chat/discussions/18
transfomers 4.34 doesn't work for me either. Degrading to 4.33.1 works in my case