altomek
/

Llama-3.2-3B-Instruct-GGUF

Text Generation

Model card Files Files and versions Community

Llama-3.2-3B-Instruct

Selected GGUF quants of https://huggingface.co/alpindale/Llama-3.2-3B-Instruct

Downloads last month: 41

GGUF

Model size

3.21B params

Architecture

llama

4-bit

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for altomek/Llama-3.2-3B-Instruct-GGUF

Base model

alpindale/Llama-3.2-3B-Instruct

Quantized

(5)

this model

Collection including altomek/Llama-3.2-3B-Instruct-GGUF

Quants for ARM

10 items • Updated Nov 19 • 1