Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
unsloth
/
Llama-3.2-3B-Instruct-GGUF
like
27
Follow
Unsloth AI
936
Transformers
GGUF
English
llama-3
llama
meta
facebook
unsloth
Inference Endpoints
conversational
License:
llama3.2
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
main
Llama-3.2-3B-Instruct-GGUF
2 contributors
History:
6 commits
shimmyshimmer
Update README.md
02a17dd
verified
12 days ago
.gitattributes
2 kB
Upload folder using huggingface_hub
3 months ago
Llama-3.2-3B-Instruct-F16.gguf
6.43 GB
LFS
Upload folder using huggingface_hub
3 months ago
Llama-3.2-3B-Instruct-Q2_K.gguf
1.36 GB
LFS
Upload folder using huggingface_hub
3 months ago
Llama-3.2-3B-Instruct-Q3_K_M.gguf
1.69 GB
LFS
Upload folder using huggingface_hub
3 months ago
Llama-3.2-3B-Instruct-Q4_K_M.gguf
2.02 GB
LFS
Upload folder using huggingface_hub
3 months ago
Llama-3.2-3B-Instruct-Q5_K_M.gguf
2.32 GB
LFS
Upload folder using huggingface_hub
3 months ago
Llama-3.2-3B-Instruct-Q6_K.gguf
2.64 GB
LFS
Upload folder using huggingface_hub
3 months ago
Llama-3.2-3B-Instruct-Q8_0.gguf
3.42 GB
LFS
Upload folder using huggingface_hub
3 months ago
README.md
5.79 kB
Update README.md
12 days ago