Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3.2-3B-Apex-GGUF
like
3
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
Llama-3.2-3B-Apex-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
8ec019b711ee2d7aebe6fc37ef2b92e4ce28828b35cac6a84251296713b9494e
fc4e1d9
verified
about 2 months ago
.gitattributes
Safe
1.91 kB
8ec019b711ee2d7aebe6fc37ef2b92e4ce28828b35cac6a84251296713b9494e
about 2 months ago
Llama-3.2-3B-Apex-GGUF_imatrix.dat
2.99 MB
LFS
8ec019b711ee2d7aebe6fc37ef2b92e4ce28828b35cac6a84251296713b9494e
about 2 months ago
Llama-3.2-3B-Apex.Q5_K_M.gguf
Safe
2.59 GB
LFS
3e2893ad9182ffc3d26756db638978feb0f7c020f3659ad89d99db5085c59948
about 2 months ago
Llama-3.2-3B-Apex.Q5_K_S.gguf
Safe
2.54 GB
LFS
5a2f6ac9664a91fb3ea03b88f41a437d41deaf6b15aa4e56f66d63ff13ea4d2f
about 2 months ago
Llama-3.2-3B-Apex.Q6_K.gguf
Safe
2.97 GB
LFS
38a45e630e3a2d25399c2061fa34dbe90f339f789a3c2a345986a536a5ad2397
about 2 months ago
Llama-3.2-3B-Apex.Q8_0.gguf
Safe
3.84 GB
LFS
caee57d3c5b014e78a8b089a7cb71dc88b290dc9923a24e07be4ee4d4fd4a65e
about 2 months ago
Llama-3.2-3B-Apex.fp16.gguf
Safe
7.22 GB
LFS
cf9a7ecd56b642b93a01534518c08fd56b7df2c8d02f73b882aa447d3dac8b3c
about 2 months ago
README.md
Safe
2.96 kB
8ec019b711ee2d7aebe6fc37ef2b92e4ce28828b35cac6a84251296713b9494e
about 2 months ago