Hugging Face's logo

larenspear
/
Yi-1.5-9B-Chat-GGUF

Transformers
GGUF
English
Inference Endpoints
conversational
Model card Files Community
larenspear commited on
Commit
f819e68
•
1 Parent(s): f31a550

GGUF Quantization

Browse files
Files changed (12) hide show
  1. yi-1.5-9b-chat-q2_k.gguf +3 -0
  2. yi-1.5-9b-chat-q3_k_l.gguf +3 -0
  3. yi-1.5-9b-chat-q3_k_m.gguf +3 -0
  4. yi-1.5-9b-chat-q3_k_s.gguf +3 -0
  5. yi-1.5-9b-chat-q4_0.gguf +3 -0
  6. yi-1.5-9b-chat-q4_k_m.gguf +3 -0
  7. yi-1.5-9b-chat-q4_k_s.gguf +3 -0
  8. yi-1.5-9b-chat-q5_0.gguf +3 -0
  9. yi-1.5-9b-chat-q5_k_m.gguf +3 -0
  10. yi-1.5-9b-chat-q5_k_s.gguf +3 -0
  11. yi-1.5-9b-chat-q6_k.gguf +3 -0
  12. yi-1.5-9b-chat-q8_0.gguf +3 -0
yi-1.5-9b-chat-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd406860b149686b207bfd6c710803df490f84b4588a827e46155486fe010e47
3
+ size 3354325344
yi-1.5-9b-chat-q3_k_l.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:545077fe72d8a657f35a78bdc818506fd7ea4fc2a15c388069c1d2b05e338a34
3
+ size 4690751840
yi-1.5-9b-chat-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9c49a1abcd45036193c3d45bb07079bd0e24bbc066240643ee848010e578f1b
3
+ size 4324405600
yi-1.5-9b-chat-q3_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4411a0e0bdf708995367cef1d9d14f3e2219d36d5661b20c7e34187ab102834
3
+ size 3899208032
yi-1.5-9b-chat-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2a7489d028e0e91974ce047ad403bf6374ab2d7f73afb0ed31f9ee8de9df3ab
3
+ size 5036994912
yi-1.5-9b-chat-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce6607916760462e39f5cb815db19f521293d4f6d630e01d17f7e8cdac5926e3
3
+ size 5328957792
yi-1.5-9b-chat-q4_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee88144a6fd50fe7b09e52d11b79e149db488f1f6a63a4b3af53d698ff902d8e
3
+ size 5071860064
yi-1.5-9b-chat-q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4653e76d946fd2fa23a3c1fdd47210dc04ec8b936bc5328b09092c91ab215bde
3
+ size 6107853152
yi-1.5-9b-chat-q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f8272cb5344554cef0099b231696b1fe5ef53fb3772d204b5e9b8d0db19c317
3
+ size 6258258272
yi-1.5-9b-chat-q5_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26cfbc052bbf23b5a371b4d2935679ea3e22803180e0f5700c2d728d0f962fae
3
+ size 6107853152
yi-1.5-9b-chat-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5ec40febedf0dfc882260585888ef904fdee5cf2f9c990d9d066c32f74b3ef8
3
+ size 7245640032
yi-1.5-9b-chat-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:568d0fb5e52a8bd3ba5bcb92b8908defb6a3f92198729ddf4b811f3c81f3d268
3
+ size 9383915872