Quant Request
#2
by
OrangeApples
- opened
Hi @rAIfle ! Thanks for uploading all these quants and rpcal models. May I please request a 3.7b6h exl2 quant for this one? I noticed that your newer models have it already.
Could have sworn someone else had done 3.7 and 6 bpw rpcal of this already. I'll add this one to the to-do list, though it may take a bit before I get to it.
No worries! Sadly, I could not find the quants you're referring to. Zaq-hack did the 3.0 and 4.0 bpw quants already; the former is a little too low bpw for me while the latter is too large to give me decent context size.