GGUF quant please
#1
by
WoolCool
- opened
Could you please provide a GGUF quantization of this model?
It literally takes 5 minutes to make one, or you ask TheBloke to do it for you in his discord
Could you please provide a GGUF quantization of this model?
here is some - https://huggingface.co/mishima/CausalLM-34B-preview.GGUF