请问在text generation webui上怎么使用?

#1
by tikeoew - opened

您好,我用text generation webui加载了gguf后,发现回复的内容都是胡乱的数字或英文,请问需要调整什么配置来适配吗?

Owner

Hello!

This model was probably wrongly converted, I ll come back to you with proper quantization

Owner

Update in progress, model will be stored here https://huggingface.co/s3nh/Mistral-7B-Evol-Instruct-Chinese-GGUF

Nice! It works~thanks very much~~

Owner

Also taking requests, if you have any idea, willingnes for the model, just let me know!

s3nh changed discussion status to closed
Owner

Let me know how are your feeling with this model cause it was my first chinese attenpt

Sign up or log in to comment