Hugging Face's logo

gpustack
/
Llama-3.2-3B-Instruct-GGUF

Text Generation
Transformers
GGUF
PyTorch
facebook
meta
llama
llama-3
Inference Endpoints
conversational
Model card Files Community
gpustack commited on
Commit
e2f5491
•
1 Parent(s): ebe6daa

Upload folder using huggingface_hub

Browse files
Files changed (6) hide show
  1. Llama-3.2-3B-Instruct-FP16.gguf +3 -0
  2. Llama-3.2-3B-Instruct-Q4_0.gguf +3 -0
  3. Llama-3.2-3B-Instruct-Q4_K_M.gguf +3 -0
  4. Llama-3.2-3B-Instruct-Q5_0.gguf +3 -0
  5. Llama-3.2-3B-Instruct-Q5_K_M.gguf +3 -0
  6. Llama-3.2-3B-Instruct-Q8_0.gguf +3 -0
Llama-3.2-3B-Instruct-FP16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5ebe8fbb5ab5f05aaa056948668c5f7443df9d0883497f1d9c05f57fb8ea6cd
3
+ size 6433687840
Llama-3.2-3B-Instruct-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ca05ad7e6a633992262e682b04f4cd48f98a94ad3e1be6b87600ddeef1e4198
3
+ size 1917190432
Llama-3.2-3B-Instruct-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c70aee45d6ecbc695a1f3f7e93f179dc3e50799c1f02125eb80c2990e4ce4de2
3
+ size 2019377440
Llama-3.2-3B-Instruct-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6fb0c7100708dd38355b02fc28f7f6bbec1b8b15c92bf7c738b9b1df0947219a
3
+ size 2269511968
Llama-3.2-3B-Instruct-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96d9d9de3929b9a6e3395787a8a2cb73432bdb3f106aafbc21b125ec889408cf
3
+ size 2322153760
Llama-3.2-3B-Instruct-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1e32183822eb2a5dbfa733fc79a3a342658ba568e94f1824798bc859fe7046e
3
+ size 3421899040