3.0 BPW? Sorry to be that guy
#1
by
ProphetOfBostrom
- opened
But I just plugged in another 8GB and I'm discovering that 3.5BPWs don't load like I'd hoped.
Or alternatively - is there a LORA?
Will give an iq quant a go in the mean time if there's even time to fetch it.
measurement.json would ordinarily also be appreciated but as I can't download any big source weights this month (finite data limits, never do this!) I wouldn't be able to use it.
Thank you very much either way