ValueError: Tokenizer class ChatGLMTokenizer does not exist or is not currently imported.
#92
by
sharkchillillll
- opened
from transformers import AutoTokenizer, AutoModel
MODEL_PATH = r"/Model/chatglm2-6b/"
tokenizer = AutoTokenizer.from_pretrained(MODEL_PATH)
model = AutoModel.from_pretrained(MODEL_PATH).half().cuda()
model = model.eval()
response, history = model.chat(tokenizer, "你好", history=[])
print(response)
response, history = model.chat(tokenizer, "晚上睡不着应该怎么办", history=history)
print(response)
已经把模型下载到指定的文件夹里面了，想问问各位，这个报错是什么原因导致的呢
同问
AutoTokenizer.from_pretrained(model_name_or_path,trust_remote_code=True),添加信任远程模型
也可以更新到我们新一代模型 chatglm3模型尝试，trust_remote_code=True 会有更好的效果
zRzRzRzRzRzRzR
changed discussion status to
closed