| Original model: | |
| https://huggingface.co/AIRI-Institute/OmniFusion/tree/main/OmniMistral-v1_1 | |
| GGUF q5. | |
| There is only the text part of LLM in this model files. | |
| Visual part (projector) is not working. It needs to be converted to gguf seperately. | |
| Guide is here: but i didn't test it, and not sure that it will work: | |
| https://github.com/ggerganov/llama.cpp/tree/master/examples/llava#llava-15 |