Other exl2 quants pls

#1
by zypcastles - opened

The 8bpw quant won't be able to fit in 48GB VRAM, could you please provide some smaller quants, such as 4.65bpw? thanks!

Owner

Sure thing, I will try to get them out by the end of the week latest.

Sign up or log in to comment