Megac4ai-command-r-plus-gguf
These are quantized GGUF versions of nitky/Megac4ai-command-r-plus. Please check the original model for license and more details.
Results for non-English languages (Japanese)
| Model | Output Quality | Notes |
|---|---|---|
| Megac4ai-command-r-plus-IQ3_XS.gguf | Poor | |
| Megac4ai-command-r-plus-IQ4_XS.gguf | Average | |
| Megac4ai-command-r-plus-Q4_K_M.gguf | Good | recommended |
| Megac4ai-command-r-plus-Q5_K_M.gguf | Good | |
| Megac4ai-command-r-plus-Q6_K.gguf | Excellent | recommended |
| Megac4ai-command-r-plus-Q8_0.gguf | Excellent |
- Downloads last month
- 202
Inference API (serverless) does not yet support gguf models for this pipeline type.
Model tree for nitky/Megac4ai-command-r-plus-gguf
Base model
CohereForAI/c4ai-command-r-plus