Can we add gguf In it?
#2
by
ar08
- opened
Can we add gguf In it?
@ar08 hey! I tried to convert it to GGUF but unfortunately couldn't because conversion scripts are tailored for llava models built on Llama and CLIP. I will work on that and modify the script for "llava-qwen" if I have enough bandwidth
An excellent model suitable for edge devices. Really looking forward to the GGUF version.