Clevyby
/

Quantum-Citrus-9B-32k-Q5_K_S-GGUF-iMatrix

Text Generation

Not-For-All-Audiences

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Quantum-Citrus-9B-32k-Q5_K_S-GGUF-iMatrix

2 contributors

History: 1 commit

Clevyby's picture

ABX-AI's picture

Duplicate from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix

888f31f verified 5 months ago

.gitattributes

3.01 kB

Duplicate from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix 5 months ago
Quantum-Citrus-9B-IQ3_M-imat.gguf

4.06 GB
LFS

Duplicate from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix 5 months ago
Quantum-Citrus-9B-IQ3_S-imat.gguf

3.94 GB
LFS

Duplicate from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix 5 months ago
Quantum-Citrus-9B-IQ3_XXS-imat.gguf

3.5 GB
LFS

Duplicate from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix 5 months ago
Quantum-Citrus-9B-IQ4_NL-imat.gguf
5.11 GB
LFS

Duplicate from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix 5 months ago
Quantum-Citrus-9B-IQ4_XS-imat.gguf
4.84 GB
LFS

Duplicate from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix 5 months ago
Quantum-Citrus-9B-Q4_K_M-imat.gguf
5.42 GB
LFS

Duplicate from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix 5 months ago
Quantum-Citrus-9B-Q4_K_S-imat.gguf
5.13 GB
LFS

Duplicate from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix 5 months ago
Quantum-Citrus-9B-Q5_K_M-imat.gguf
6.36 GB
LFS

Duplicate from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix 5 months ago
Quantum-Citrus-9B-Q5_K_S-imat.gguf
6.2 GB
LFS

Duplicate from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix 5 months ago
Quantum-Citrus-9B-Q6_K-imat.gguf
7.37 GB
LFS

Duplicate from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix 5 months ago
README.md

5.62 kB

Duplicate from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix 5 months ago
imatrix.dat

6.24 MB
LFS

Duplicate from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix 5 months ago