Can HQQ quantized model run on cpu ?
Yes but it's gonna be very slow, it's not optimized for CPU runtime at all, we focus on GPU support only
· Sign up or log in to comment
