mradermacher

/

ToriiGate-v0.4-7B-GGUF

like 0

I'm trying to run the ToriiGate-v0.4-7B.Q4_K_M.gguf using llama-qwen2vl-cli from llama.cpp(tag: b4869), but I keep getting this error:

key general.description not found in file
terminate called after throwing an instance of 'std::runtime_error'
  what():  Missing required key: general.description
Aborted (core dumped)

Here’s the command I used:

./llama-qwen2vl-cli -m ~/model/ToriiGate-v0.4-7B.Q4_K_M.gguf --mmproj ~/model/ToriiGate-v0.4-7B.Q4_K_M.gguf -ngl 29 --image ~/image.png -p "You need to write a long and very detailed caption for the picture."

Any insights or suggestions would be really appreciated. Let me know if you need any more info!
Thanks a lot!