altomek
/

Llama-3.2-3B-Instruct-8bpw-EXL2

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

Llama-3.2-3B-Instruct

ExLlamav2 8 bpw quant of https://huggingface.co/alpindale/Llama-3.2-3B-Instruct

Downloads last month: 9

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for altomek/Llama-3.2-3B-Instruct-8bpw-EXL2

Base model

alpindale/Llama-3.2-3B-Instruct

Quantized

(5)

this model