Hugging Face's logo

MaziyarPanahi
/
Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
mixtral
Mixture of Experts
conversational
Model card Files Community
37

Upload folder using huggingface_hub

#1
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+20
-0
Files changed (6) hide show
  1. .gitattributes +5 -0
  2. Mixtral-8x22B-Instruct-v0.1.Q2_K-00001-of-00005.gguf +3 -0
  3. Mixtral-8x22B-Instruct-v0.1.Q2_K-00002-of-00005.gguf +3 -0
  4. Mixtral-8x22B-Instruct-v0.1.Q2_K-00003-of-00005.gguf +3 -0
  5. Mixtral-8x22B-Instruct-v0.1.Q2_K-00004-of-00005.gguf +3 -0
  6. Mixtral-8x22B-Instruct-v0.1.Q2_K-00005-of-00005.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Mixtral-8x22B-Instruct-v0.1.Q2_K-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Mixtral-8x22B-Instruct-v0.1.Q2_K-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Mixtral-8x22B-Instruct-v0.1.Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Mixtral-8x22B-Instruct-v0.1.Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Mixtral-8x22B-Instruct-v0.1.Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Mixtral-8x22B-Instruct-v0.1.Q2_K-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0516cca4db59c19dff69a464146f054e4a5e7fadacbc941238706deda0cccb77
3
+ size 11845299520
Mixtral-8x22B-Instruct-v0.1.Q2_K-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1fb498ce4bb61e042bad83356dd72b18b7f82369a21cef3bbe01180bf4268d48
3
+ size 12023718048
Mixtral-8x22B-Instruct-v0.1.Q2_K-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eef493a4dbcb39f8ddc075014481c4ddaaaa783d4c78442d810aee693d7e1108
3
+ size 11432517760
Mixtral-8x22B-Instruct-v0.1.Q2_K-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b115600584fed1df10906b42363dc0a325d548fc1efc770aa91b7fc866d28110
3
+ size 12022440096
Mixtral-8x22B-Instruct-v0.1.Q2_K-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce5e55ff2e33645b488c794f3c1d7bac2c773d2e5df8be637b8514d4600c8d0c
3
+ size 4784631104