Hugging Face's logo

Araki
/
airoboros-33b-gpt4-1.4.1-PI-8192-GGML

Text Generation
llama
ggml
Model card Files Community
Araki commited on
Commit
98e1cb5
•
1 Parent(s): 6cff6cf

Adding Q5_K_M, Q5_K_S, Q6_K, Q8_0 quantization

Browse files
Files changed (4) hide show
  1. airoboros-33b-gpt4-1.4.1-PI-8192-fp16-GGML-Q5_K_M.bin +3 -0
  2. airoboros-33b-gpt4-1.4.1-PI-8192-fp16-GGML-Q5_K_S.bin +3 -0
  3. airoboros-33b-gpt4-1.4.1-PI-8192-fp16-GGML-Q6_K.bin +3 -0
  4. airoboros-33b-gpt4-1.4.1-PI-8192-fp16-GGML-Q8_0.bin +3 -0
airoboros-33b-gpt4-1.4.1-PI-8192-fp16-GGML-Q5_K_M.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27ddb9d6227bee5fa0a44b0d5178530b926a6bcec1eee17323ea7a0d634dddaa
3
+ size 23046827392
airoboros-33b-gpt4-1.4.1-PI-8192-fp16-GGML-Q5_K_S.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f332ee3cf08d045511036fb9e8346c5fbab6619ace1d93af6dd3f68aa97d0aa1
3
+ size 22395071872
airoboros-33b-gpt4-1.4.1-PI-8192-fp16-GGML-Q6_K.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a108889cede08b75260b186168360bd50344b3ba5b7d31408a682bb98c0e686
3
+ size 26686927232
airoboros-33b-gpt4-1.4.1-PI-8192-fp16-GGML-Q8_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb5be2f17a55456621d6d47a4ceeff80114d14a6a1c6912ce1ec21ba7ca4c335
3
+ size 34513251712