GGUF format
#43
by
celax
- opened
I need this model in GGUF format to use with Ollama. How can I get it? llama.cpp doesn't work with its architecture.
try following converting script: https://github.com/ggerganov/llama.cpp/blob/master/convert_hf_to_gguf.py