schnapper79

/

lumikabra-123B_v0.1-exl2-8.0bpw

like 0

Any chance we could get a 5.0bpw quant? I'm curious to test out the model, but 8bpw won't fit in H100.

Thanks!