This repo includes the GGUF versions of MiniCPM3-4B:

  • minicpm3-4b-fp16.gguf
  • minicpm3-4b-q4_k_m.gguf

For usage and more information, please check our GitHub repo.

Downloads last month
2,341
GGUF
Model size
4.07B params
Architecture
minicpm3

4-bit

Inference API
Unable to determine this model's library. Check the docs .

Model tree for openbmb/MiniCPM3-4B-GGUF

Quantized
(5)
this model
Quantizations
1 model

Collection including openbmb/MiniCPM3-4B-GGUF