Megac4ai-command-r-plus-gguf

These are quantized GGUF versions of nitky/Megac4ai-command-r-plus. Please check the original model for license and more details.

Results for non-English languages (Japanese)

Model Output Quality Notes
Megac4ai-command-r-plus-IQ3_XS.gguf Poor
Megac4ai-command-r-plus-IQ4_XS.gguf Average
Megac4ai-command-r-plus-Q4_K_M.gguf Good recommended
Megac4ai-command-r-plus-Q5_K_M.gguf Good
Megac4ai-command-r-plus-Q6_K.gguf Excellent recommended
Megac4ai-command-r-plus-Q8_0.gguf Excellent
Downloads last month
59
GGUF
Model size
160B params
Architecture
command-r

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The HF Inference API does not support text-generation models for gguf library.

Model tree for nitky/Megac4ai-command-r-plus-gguf

Quantized
(10)
this model