kromquant
/

L3.1-Siithamo-v0.3-8B-GGUFs

Inference Endpoints

Model card Files Files and versions Community

Edit model card

This repo only contains the Q8, Q6, Q5, & Q4 GGUF files of Siithamo v0.3

For the details of this model, please refer to the orginal model card here

Downloads last month: 67

GGUF

Model size

8.03B params

Architecture

llama

4-bit

5-bit

6-bit

8-bit

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Model tree for kromquant/L3.1-Siithamo-v0.3-8B-GGUFs

Base model

kromvault/L3.1-Siithamo-v0.3-8B

Quantized

this model

Spaces using kromquant/L3.1-Siithamo-v0.3-8B-GGUFs 3