Adding Q5_K_M, Q5_K_S, Q6_K, Q8_0 quantization

Files changed (5) hide show

.gitattributes CHANGED Viewed

@@ -43,3 +43,7 @@ Luna-AI-Llama2-Uncensored-ggmlv3.Q4_K_M filter=lfs diff=lfs merge=lfs -text
 Luna-AI-Llama2-Uncensored-ggmlv3.Q4_K_S filter=lfs diff=lfs merge=lfs -text
 Luna-AI-Llama2-Uncensored-ggmlv3.Q5_0 filter=lfs diff=lfs merge=lfs -text
 Luna-AI-Llama2-Uncensored-ggmlv3.Q5_1 filter=lfs diff=lfs merge=lfs -text

 Luna-AI-Llama2-Uncensored-ggmlv3.Q4_K_S filter=lfs diff=lfs merge=lfs -text
 Luna-AI-Llama2-Uncensored-ggmlv3.Q5_0 filter=lfs diff=lfs merge=lfs -text
 Luna-AI-Llama2-Uncensored-ggmlv3.Q5_1 filter=lfs diff=lfs merge=lfs -text
+Luna-AI-Llama2-Uncensored-ggmlv3.Q5_K_M filter=lfs diff=lfs merge=lfs -text
+Luna-AI-Llama2-Uncensored-ggmlv3.Q5_K_S filter=lfs diff=lfs merge=lfs -text
+Luna-AI-Llama2-Uncensored-ggmlv3.Q6_K filter=lfs diff=lfs merge=lfs -text
+Luna-AI-Llama2-Uncensored-ggmlv3.Q8_0 filter=lfs diff=lfs merge=lfs -text

Luna-AI-Llama2-Uncensored-ggmlv3.Q5_K_M ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:28070d9fdc36b5ed711a5a626749631852e3701ed2681e49637aa869e73567e3
+size 4782867072

Luna-AI-Llama2-Uncensored-ggmlv3.Q5_K_S ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:a6f3df30ea7eee40e9a7d0cd90fe24d1c8e8d1783e9903a2e3640cb35e74ead3
+size 4651401856

Luna-AI-Llama2-Uncensored-ggmlv3.Q6_K ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:b2c7204dab34d2a481af734dc9fe5a3ae5c768abb517ab95ea3773e6b23f1d34
+size 5528904320

Luna-AI-Llama2-Uncensored-ggmlv3.Q8_0 ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:3656974db0bf68b11d8568c652ef66f73d554d908e8dcd345ec7f04abbae66a5
+size 7129055872