Hugging Face's logo

TigerResearch
/
tigerbot-7b-sft-v1-4bit

Text Generation
Transformers
bloom
Inference Endpoints
text-generation-inference
Model card Files Community
1

请问有类似TheBloke所做的GPTQ模型里给出的使用auto-gptq运行的方法？

#1
by zmcmcc - opened
Discussion
zmcmcc

参考https://huggingface.co/TheBloke/Nous-Hermes-13B-GPTQ，能否使用类似的方法跑起来这个模型呢

Sign up or log in to comment