Hugging Face's logo

second-state
/
stablelm-2-zephyr-1.6b-GGUF

Text Generation
Transformers
GGUF
English
stablelm
causal-lm
Inference Endpoints
conversational
Model card Files Community
1
Xin Liu commited on
Commit
bdc47e8
•
1 Parent(s): 3594655

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (13) hide show
  1. .gitattributes +1 -0
  2. stablelm-2-zephyr-1_6b-Q2_K.gguf +3 -0
  3. stablelm-2-zephyr-1_6b-Q3_K_L.gguf +3 -0
  4. stablelm-2-zephyr-1_6b-Q3_K_M.gguf +3 -0
  5. stablelm-2-zephyr-1_6b-Q3_K_S.gguf +3 -0
  6. stablelm-2-zephyr-1_6b-Q4_0.gguf +3 -0
  7. stablelm-2-zephyr-1_6b-Q4_K_M.gguf +3 -0
  8. stablelm-2-zephyr-1_6b-Q4_K_S.gguf +3 -0
  9. stablelm-2-zephyr-1_6b-Q5_0.gguf +3 -0
  10. stablelm-2-zephyr-1_6b-Q5_K_M.gguf +3 -0
  11. stablelm-2-zephyr-1_6b-Q5_K_S.gguf +3 -0
  12. stablelm-2-zephyr-1_6b-Q6_K.gguf +3 -0
  13. stablelm-2-zephyr-1_6b-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
stablelm-2-zephyr-1_6b-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3fc3b72fc2873c454f76c5e3c44d9dc36110a842552088a13d0cae098b60073
3
+ size 694161408
stablelm-2-zephyr-1_6b-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0cf61040b65650ca51b5fb2b055d9047713218f9c80c706f1fc73ddfed72437c
3
+ size 914984960
stablelm-2-zephyr-1_6b-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ae1c62b589509bd3365c4c68be11f3e712a90b96b6d1e5010f9f60cfc7d9ddb
3
+ size 857706496
stablelm-2-zephyr-1_6b-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09807671c21288959fe1fb46825781d6868ad8d136970875bb5b84a53bdcb8f1
3
+ size 791711744
stablelm-2-zephyr-1_6b-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d017cc4a473ea30641f67d3d39010baf03180292e8394754c6fd66abe94e336
3
+ size 982781952
stablelm-2-zephyr-1_6b-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4224a8a08417e34d5a224efb1291491c4f5762b46aa012021adaf0a0578848e2
3
+ size 1031442432
stablelm-2-zephyr-1_6b-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93fc1293717f1b050b149240c23344bafd2eac297e9b9dc0f7f1618224de7594
3
+ size 989204480
stablelm-2-zephyr-1_6b-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e07aa4c5afd65fc82b2cecc2bc9ed29738ce562f626477a05bb50e824c09fc4
3
+ size 1162612736
stablelm-2-zephyr-1_6b-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f788077be1d940a0a8e94dfc4b1f9139b1e5e8bcd72410a45e8089fef19fad13
3
+ size 1187680256
stablelm-2-zephyr-1_6b-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21fbcb02bdf1cc1590518570e5a0605d975abd70bde0deb73d1e3478866439b8
3
+ size 1162612736
stablelm-2-zephyr-1_6b-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e22b34d6b6a9a36b0fb4b292d7b4c07e0a7423e661592950a7c50b07f11e20c5
3
+ size 1353682944
stablelm-2-zephyr-1_6b-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:682757fc426b1332b1880bfc73226d574d9404276d8133aea16aa73845e64d44
3
+ size 1751879680