Hugging Face's logo

larenspear
/
DeepSeek-V2-Lite-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
larenspear commited on
Commit
9f616ea
•
1 Parent(s): a729439

GGUF Quant

Browse files
Files changed (11) hide show
  1. deepseek-v2-lite-f16.gguf +3 -0
  2. deepseek-v2-lite-q2_k.gguf +3 -0
  3. deepseek-v2-lite-q3_k_l.gguf +3 -0
  4. deepseek-v2-lite-q3_k_m.gguf +3 -0
  5. deepseek-v2-lite-q3_k_s.gguf +3 -0
  6. deepseek-v2-lite-q4_k_m.gguf +3 -0
  7. deepseek-v2-lite-q4_k_s.gguf +3 -0
  8. deepseek-v2-lite-q5_k_m.gguf +3 -0
  9. deepseek-v2-lite-q5_k_s.gguf +3 -0
  10. deepseek-v2-lite-q6_k.gguf +3 -0
  11. deepseek-v2-lite-q8_0.gguf +3 -0
deepseek-v2-lite-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a94f2cf4f2d34de0b45a806359ba470f3f520bfd7907df3875887569d0020f1
3
+ size 31424033024
deepseek-v2-lite-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4191f56665a6d258f69b9db4295119a7e4db2c30f741960084df66e4eacd65d2
3
+ size 6430464256
deepseek-v2-lite-q3_k_l.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b81cbf1680000fa9c31fd458d677dc050404ead3ed6d3376812a7a6948df76c
3
+ size 8459398400
deepseek-v2-lite-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa15ff9718c5f8f29552b69b4cf25b1fc0d6fa473359313d27044692f4f24c0e
3
+ size 8126606592
deepseek-v2-lite-q3_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5820229b9e6b7b313cfa9106069ad2270d6c1c214eec48aa0e919d18cfce4c1b
3
+ size 7487663360
deepseek-v2-lite-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d445959f77957622074e9550e514eeee27d32fcdc55d624f2107f0121cc1331
3
+ size 10364416256
deepseek-v2-lite-q4_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb70d97b45ca56a716c822466352ef54152f8ee9a1a2e46edbd35bb811243861
3
+ size 9533608192
deepseek-v2-lite-q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ccf83d2f029d67a6590a6a1d8e5bebc359468cb251bb5d00b79b8cf3706ec51
3
+ size 11851313408
deepseek-v2-lite-q5_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cc54f163868e71d530cf7f22e2ff3f1d288dc7cd591412d60bcf4d6fdd41e83
3
+ size 11143057664
deepseek-v2-lite-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89c686ca557f194302ddca46651c84c3b7151adfadfecc8220732d20a5e53b2d
3
+ size 14066971904
deepseek-v2-lite-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0204c8fe50a4bb448a5b67498f195dd3910f00e1a870065c0ba048a9dcc0631e
3
+ size 16702517504