Beware! Requires new cuda.
13
#5 opened over 1 year ago
by
autobots
Getting size mismatch for model.layers with alpaca-lora-65B-GPTQ-4bit-1024g.safetensors
4
#3 opened over 1 year ago
by
GeoBuilder
Error in instructions?
1
#2 opened over 1 year ago
by
Co0ode
It also works on Windows, using last update of the CUDA GPTQ tree.
1
#1 opened over 1 year ago
by
BGLuck