Unable to pull in from Ollama
not sure why your comment got hidden, but I think it's to do with the fact that I upload my larger split models into sub folders :( will either work with ollama to figure out how to properly support them, or switch how i upload.
@AIGUYCONTENT in the meantime feel free to pull from lmstudio-community as the Q8 will be the exact same
I can't see the original post, but any progress on this? I would also like to use it with Ollama. As far as I know, Ollama hasn't fixed this yet, but there is a workaround.
I can't see the original post, but any progress on this? I would also like to use it with Ollama. As far as I know, Ollama hasn't fixed this yet, but there is a workaround.
Why not just download them yourself, combine them, then import that?
@Nurb4000, that's the gist of the workaround. It's unfortunate Ollama doesn't support split GGUF files natively like it does for safetensors.