mikudev
/

L3-8B-Stheno-v3.2-GPTQ

4-bit precision

Model card Files Files and versions Community

Original Model: https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2

Quantized with AutoGPTQ 128g wikitext2, using the script from https://aphrodite.pygmalion.chat/pages/quantization/quantization-methods.html#gptq

Downloads last month: 8

Safetensors

Model size

1.99B params

Tensor type

FP16

·

I32

·

Inference API

Unable to determine this model's library. Check the docs .

Model tree for mikudev/L3-8B-Stheno-v3.2-GPTQ

Base model

Sao10K/L3-8B-Stheno-v3.2

Quantized

(23)

this model