GGUF llama.cpp quantized version of:

Recommended Prompt Format (ChatML)

<|im_start|>system 
Provide some context and/or instructions to the model.<|im_end|> 
<|im_start|>user 
The user’s message goes here<|im_end|> 
<|im_start|>assistant 
AI message goes here<|im_end|> 

Quant Version: b3933 with imatrix

Downloads last month
195
GGUF
Model size
7.61B params
Architecture
qwen2

2-bit

5-bit

8-bit

16-bit

32-bit

Inference Examples
Unable to determine this model's library. Check the docs .

Model tree for AI-Engine/MiniCPM-V-2_6-GGUF

Quantized
(6)
this model