Hugging Face's logo

MaziyarPanahi
/
Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
mixtral
Mixture of Experts
conversational
Model card Files Community
37
MaziyarPanahi commited on
Commit
2de77f6
•
1 Parent(s): 1be6ac1

Upload folder using huggingface_hub (#26)

Browse files

- cd137a1e12e269c678c5839e07196040327aff01baac24223c0575bfdc240f04 (857fbe89cdd7c832aa978bb9ea0fdd6182b76c06)
- 8f421b8a0c8e656451dc7b947e1d9d3b4420f5c7bd8eb1f40fbf96f5af552b5e (d77428aa07834c399eed97a78962073d86075153)
- 25d24503142c888a0924002010e42d264dcd16e704c2a8b60603d7265e26eee6 (e76453e8d724c4ddc588b4ae894f5138126dd4fe)
- eff6d59f6d960be7290b9bef87a69bb220cd366c838f165d378d7a5f64bce0ec (10cf9982561acdb2be32fbf8334981478bc78018)
- 01bde06e2394dce7636cf472c42046eaecde4ce3bfabc898a42939020ea6ba24 (5ef64c889485364f613653b3e12b64e3733343e9)
- b5b78311829088c798cb57f839706939711548e9f0a5a0c9c8ef4d65478823e2 (584a75ac83767ea6b42da719bba2cfd6f5626cd6)
- f3a6bda3e3e41c61c2d020ff08486543186cda56a0e948aef932a5094c7547b7 (08fbe25d7e0bb1f1a7cb7d69534814abedde4777)
- 011637140ddf721151b24169973c0a4e36e4b4cfd1f2ec5dd49c50672219834c (7832f5fe9aed65fc084f89d61da8e9462fe24156)
- 29d50529356a24fcd8ba54ea5715cb5a62aa985518a4deb348c0b1916408565d (b2b72ee4a02431f629657b4ee25eb4804049f702)

Files changed (7) hide show
  1. .gitattributes +6 -0
  2. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00001-of-00003.gguf +3 -0
  3. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00002-of-00003.gguf +3 -0
  4. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00003-of-00003.gguf +3 -0
  5. Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00001-of-00003.gguf +3 -0
  6. Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00002-of-00003.gguf +3 -0
  7. Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00003-of-00003.gguf +3 -0
.gitattributes CHANGED
@@ -61,3 +61,9 @@ Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00005-of-00005.gguf filter=lfs diff=lfs merge
61
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
62
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
63
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
61
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
62
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
63
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
64
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
65
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
66
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
67
+ Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
68
+ Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
69
+ Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00001-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da22b5c47cd340265b8eba3663523d48082b3e60963c8150505f50d5c9e294ff
3
+ size 20945968960
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00002-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e43f053deeee2ddf9ab313987f3916e6ff63081341d8f299d1d6311212d1428
3
+ size 20330263232
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00003-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc313417d29a437eb4fc6ec80a9c31b198b61a2938b44482ee25e36620ad3b7a
3
+ size 16957892928
Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00001-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b54432611482438535e26a2f303ca7a74c388cd45f9bd222afb17c20521a220
3
+ size 21962825536
Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00002-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa051be48897b8d0f495795994c048f8d696f07905dddfb75fd60e02578491ea
3
+ size 21875602112
Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00003-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe530500dde151f7b59f38f8d39e2391567e2161ffbda336c230b403cc61d91a
3
+ size 17665681728