Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3.2-3B-Instruct-GGUF
like
10
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
febe3eb
Llama-3.2-3B-Instruct-GGUF
1 contributor
History:
15 commits
MaziyarPanahi
9588c40e331fb7c3e4cd10dc51f5ead7c6b58e92945bdf71952b57e20631a61d
febe3eb
verified
5 months ago
.gitattributes
2.63 kB
9588c40e331fb7c3e4cd10dc51f5ead7c6b58e92945bdf71952b57e20631a61d
5 months ago
Llama-3.2-3B-Instruct-GGUF_imatrix.dat
2.99 MB
LFS
cb5dfe77bc292db3e6c0c82aa49e147abffe4d482eca95e0660eaa1673cb49ff
5 months ago
Llama-3.2-3B-Instruct.IQ1_M.gguf
924 MB
LFS
cb5dfe77bc292db3e6c0c82aa49e147abffe4d482eca95e0660eaa1673cb49ff
5 months ago
Llama-3.2-3B-Instruct.IQ1_S.gguf
868 MB
LFS
cb5dfe77bc292db3e6c0c82aa49e147abffe4d482eca95e0660eaa1673cb49ff
5 months ago
Llama-3.2-3B-Instruct.IQ2_XS.gguf
1.1 GB
LFS
98b19ed60d36d7b7f1400fb11b73b20d056e0036b40c4e3fbc266dba2ad5d956
5 months ago
Llama-3.2-3B-Instruct.IQ3_XS.gguf
1.48 GB
LFS
b4b5db12a7f20c40678ca0116316cb9ceaac3ea0b3a50fa8af095eb5bbf8b7a9
5 months ago
Llama-3.2-3B-Instruct.IQ4_XS.gguf
1.83 GB
LFS
a58938953b780dd0e7a1745b23d215069ea6c006b1fe905878824299c952ab00
5 months ago
Llama-3.2-3B-Instruct.Q2_K.gguf
1.36 GB
LFS
3832590de20f79829a2efecac4a3e9e465ac6a752350e80e6436ee9dece841f5
5 months ago
Llama-3.2-3B-Instruct.Q3_K_L.gguf
1.82 GB
LFS
e36be80d3f0bdc09ff2dc3eca6facb41d31fac615161f5f3d39b00504528b3ac
5 months ago
Llama-3.2-3B-Instruct.Q3_K_M.gguf
1.69 GB
LFS
ddf8e7a805ae4b707b8076756227dec196dca5e00064e73c535196b1e38ab0e6
5 months ago
Llama-3.2-3B-Instruct.Q3_K_S.gguf
1.54 GB
LFS
13288067310e5db7f111b6f1ccd4bf138f5d684787d9dd3c05c92b5fe5b5b892
5 months ago
Llama-3.2-3B-Instruct.Q4_K_M.gguf
2.02 GB
LFS
6b7449993829467b62bde0aeabe6212bbe7fbc6946548025db0c5f0421ea647f
5 months ago
Llama-3.2-3B-Instruct.Q5_K_M.gguf
2.32 GB
LFS
ae37815b5122c05e447b52d2765056335243ac6520b3568f4060bc7aad91d94c
5 months ago
Llama-3.2-3B-Instruct.Q5_K_S.gguf
2.27 GB
LFS
94335bcbbee8152dd78ad6f413ddcfed59e02fe5c2d9bacc00e0d695e21107b6
5 months ago
Llama-3.2-3B-Instruct.Q6_K.gguf
2.64 GB
LFS
1e477f5397dad392376f3f8f7094a8bc0e8914a2f5186605b12106dc5f0582ee
5 months ago
Llama-3.2-3B-Instruct.Q8_0.gguf
3.42 GB
LFS
5c52f328533dc4e716feaeae014cff9fb805d5fa06f133e8f04168cad5ee8d6b
5 months ago
Llama-3.2-3B-Instruct.fp16.gguf
6.43 GB
LFS
9588c40e331fb7c3e4cd10dc51f5ead7c6b58e92945bdf71952b57e20631a61d
5 months ago
