Can we add gguf In it?

#2
by ar08 - opened

Can we add gguf In it?

Llava Hugging Face org

@ar08 hey! I tried to convert it to GGUF but unfortunately couldn't because conversion scripts are tailored for llava models built on Llama and CLIP. I will work on that and modify the script for "llava-qwen" if I have enough bandwidth

An excellent model suitable for edge devices. Really looking forward to the GGUF version.

Sign up or log in to comment