Hugging Face's logo

andyroiiid
/
llama-3.2-3b-instruct-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community

Llama 3.2 3B Instruct GGUF model file 

python llama.cpp\convert_hf_to_gguf.py llama-3.2-3b-instruct --outfile llama-3.2-3b-instruct.gguf --outtype q8_0
Downloads last month
6
GGUF
Model size
3.21B params
Architecture
llama
View all files
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.