Hugging Face's logo

MaziyarPanahi
/
calme-3.2-qwenloi-3b-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Community
3

Upload folder using huggingface_hub

#3
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/3
Discussion Files changed
+12
-0
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. calme-3.2-qwenloi-3b.Q2_K.gguf +3 -0
  3. calme-3.2-qwenloi-3b.Q4_K_M.gguf +3 -0
  4. calme-3.2-qwenloi-3b.Q4_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -37,3 +37,6 @@ calme-3.2-qwenloi-3b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
37
  calme-3.2-qwenloi-3b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
38
  calme-3.2-qwenloi-3b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
39
  calme-3.2-qwenloi-3b.fp16.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
37
  calme-3.2-qwenloi-3b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
38
  calme-3.2-qwenloi-3b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
39
  calme-3.2-qwenloi-3b.fp16.gguf filter=lfs diff=lfs merge=lfs -text
40
+ calme-3.2-qwenloi-3b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
41
+ calme-3.2-qwenloi-3b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ calme-3.2-qwenloi-3b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
calme-3.2-qwenloi-3b.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63f00a946c1609b8cd44c9b8b3616f40a332aaae1e0253b9f1a4bf610cde4552
3
+ size 1274756256
calme-3.2-qwenloi-3b.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:487653e10ce9c583fc7896fa3bc029de236a62669fa3d169d1af8da3a819e84f
3
+ size 1929903264
calme-3.2-qwenloi-3b.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc5513613fb1169a8e94f93a1abdbec08f5c34e02acdf35cb84302d1fd81145b
3
+ size 1834384544