GGUF / GPTQ /GGML available - should help on less spec'd hardware / 2, 3, 4, 5, 6 and 8-bit GGUF models for CPU+GPU inference

#8
by johndpope - opened
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment