1 contributor

History: 12 commits

Lewdiculous

ARM Q4_0_4_8 Q4_0_8_8

ef46bd1 verified 3 months ago

.gitattributes

3.01 kB

ARM Q4_0_4_8 Q4_0_8_8 3 months ago
ARM_MN-BackyardAI-Party-12B-v1-Q4_0_4_4-imat.gguf

7.07 GB
LFS

ARM Q4_0_4_4 3 months ago
ARM_MN-BackyardAI-Party-12B-v1-Q4_0_4_8-imat.gguf

7.07 GB
LFS

ARM Q4_0_4_8 Q4_0_8_8 3 months ago
ARM_MN-BackyardAI-Party-12B-v1-Q4_0_8_8-imat.gguf

7.07 GB
LFS

ARM Q4_0_4_8 Q4_0_8_8 3 months ago
MN-BackyardAI-Party-12B-v1-BF16.gguf

24.5 GB
LFS

Base Quants 45.6 GB 3 months ago
MN-BackyardAI-Party-12B-v1-F16.gguf

24.5 GB
LFS

Base Quants 45.6 GB 3 months ago
MN-BackyardAI-Party-12B-v1-IQ3_M-imat.gguf

5.72 GB
LFS

IQ3 Q3 31.8 GB 3 months ago
MN-BackyardAI-Party-12B-v1-IQ3_S-imat.gguf

5.56 GB
LFS

IQ3 Q3 31.8 GB 3 months ago
MN-BackyardAI-Party-12B-v1-IQ3_XS-imat.gguf

5.31 GB
LFS

IQ3 Q3 31.8 GB 3 months ago
MN-BackyardAI-Party-12B-v1-IQ3_XXS-imat.gguf

4.95 GB
LFS

IQ3 Q3 31.8 GB 3 months ago
MN-BackyardAI-Party-12B-v1-IQ4_XS-imat.gguf

6.74 GB
LFS

IQ4 Q4 19.8 GB 3 months ago
MN-BackyardAI-Party-12B-v1-Q3_K_L-imat.gguf

6.56 GB
LFS

IQ3 Q3 31.8 GB 3 months ago
MN-BackyardAI-Party-12B-v1-Q3_K_M-imat.gguf

6.08 GB
LFS

IQ3 Q3 31.8 GB 3 months ago
MN-BackyardAI-Party-12B-v1-Q4_K_M-imat.gguf

7.48 GB
LFS

IQ4 Q4 19.8 GB 3 months ago
MN-BackyardAI-Party-12B-v1-Q4_K_S-imat.gguf

7.12 GB
LFS

IQ4 Q4 19.8 GB 3 months ago
MN-BackyardAI-Party-12B-v1-Q5_K_M-imat.gguf

8.73 GB
LFS

Q5-Q8 37.5 GB 3 months ago
MN-BackyardAI-Party-12B-v1-Q5_K_S-imat.gguf

8.52 GB
LFS

Q5-Q8 37.5 GB 3 months ago
MN-BackyardAI-Party-12B-v1-Q6_K-imat.gguf

10.1 GB
LFS

Q5-Q8 37.5 GB 3 months ago
MN-BackyardAI-Party-12B-v1-Q8_0-imat.gguf

13 GB
LFS

Q5-Q8 37.5 GB 3 months ago
README.md

672 Bytes

Update README.md 3 months ago
imatrix-with-rp-v3.txt

306 kB

IQ3 Q3 31.8 GB 3 months ago
imatrix.dat

7.05 MB
LFS

IQ3 Q3 31.8 GB 3 months ago