Lyte/Qwen2-VL-2B-Instruct-GGUF

Inference:

./llama-qwen2vl-cli -m Q8_0.gguf --mmproj qwen2vl-vision.gguf -p "Describe this image." --image "demo.jpg"

Converted using this Colab Notebook:

Colab Notebook

Special Thanks to:

HimariO for the excellent work on enabling quantization for Qwen2-VL! PR on GitHub