Note:

This repo hosts only a Q5_K_S iMatrix of Quantum Citrus 9B. GGUF quant is from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix. The additional files in this GGUF repo is for personal usage using Text Gen Webui with llamacpp_hf.

Downloads last month: 12

GGUF

Model size

8.99B params

Architecture

llama

5-bit

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for Clevyby/Quantum-Citrus-9B-32k-Q5_K_S-GGUF-iMatrix

ABX-AI/Cerebral-Infinity-7B

ABX-AI/Starfinite-Laymospice-v2-7B

Merge model

this model