Need AWQ OR GPTQ int4 version
#2
by
william0014
- opened
it is great model, but could you provide the AWQ(int4) version , by the way, Qwen1.5-32B released , could you pull out Liberated-Qwen1.5-32B-AWQ?
it is great model, but could you provide the AWQ(int4) version , by the way, Qwen1.5-32B released , could you pull out Liberated-Qwen1.5-32B-AWQ?