Lewdiculous
/

MN-BackyardAI-Party-12B-v1-GGUF-IQ-ARM-Imatrix

Inference Endpoints

Model card Files Files and versions Community

MN-BackyardAI-Party-12B-v1-GGUF-IQ-ARM-Imatrix / .gitattributes

Commit History

ARM Q4_0_4_8 Q4_0_8_8

ef46bd1
verified

Lewdiculous commited on Oct 2, 2024

ARM Q4_0_4_4

91c909b
verified

Lewdiculous commited on Oct 2, 2024

Base Quants 45.6 GB

61c4e66
verified

Lewdiculous commited on Oct 2, 2024

Q5-Q8 37.5 GB

5024ff3
verified

Lewdiculous commited on Oct 2, 2024

IQ4 Q4 19.8 GB

a12b576
verified

Lewdiculous commited on Oct 2, 2024

IQ3 Q3 31.8 GB

2971c06
verified

Lewdiculous commited on Oct 2, 2024

initial commit

0578046
verified

Lewdiculous commited on Oct 2, 2024