add Q3 and Q2 quantization
Browse files
h2o-danube2-1.8b-chat-Q2_K.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c3f2376ba5411b207baff396b9eb8eb5bb8c028dc72c1a619f29fda22de8591b
|
| 3 |
+
size 710696032
|
h2o-danube2-1.8b-chat-Q3_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:018911f498cd8b1ac859cb4f4e12decf00b685013de8c1e1da18831b7b880304
|
| 3 |
+
size 905158752
|