bluuwhale
/

infinity-franken-GGUF-IQ-Imatrix

Inference Endpoints

Model card Files Files and versions Community

No model card

Downloads last month: 30

GGUF

Model size

10.7B params

Architecture

llama

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference API

Unable to determine this model's library. Check the docs .

Collection including bluuwhale/infinity-franken-GGUF-IQ-Imatrix

GGUF Quantize Model 🖥️

GGUF Model Quantize Weight • 5 items • Updated Aug 5 • 1