Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
MixTAO-7Bx2-MoE-v8.1-GGUF
like
11
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mixtral
Mixture of Experts
Eval Results
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
6
Train
Deploy
Use this model
ee32184
MixTAO-7Bx2-MoE-v8.1-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
2355ae8e7a0ba17ec52cee2cef055d7b734660c12a9a04ce6e280baaba228a2a
ee32184
verified
4 months ago
.gitattributes
2.21 kB
2355ae8e7a0ba17ec52cee2cef055d7b734660c12a9a04ce6e280baaba228a2a
4 months ago
MixTAO-7Bx2-MoE-v8.1.IQ4_XS.gguf
6.98 GB
LFS
4b28163765d2a5c315bdcaa3301cf38dfb14b26e7c5e99ecf78f794edd8dab34
4 months ago
MixTAO-7Bx2-MoE-v8.1.Q2_K.gguf
4.76 GB
LFS
8d47b9c5385a2dc8eb2c9be88206ebfb69b1dc76bd096d796762c6bfb82a5421
4 months ago
MixTAO-7Bx2-MoE-v8.1.Q3_K_L.gguf
6.73 GB
LFS
fbbc5d324ce0fc2bc49486dfc969642c072e64ccb8fc450d227eed2ed9448812
4 months ago
MixTAO-7Bx2-MoE-v8.1.Q3_K_M.gguf
6.21 GB
LFS
7d30544dc3151f94fdae758f7419c7aaba7fe15a33a4e8c65dd7850e0509163c
4 months ago
MixTAO-7Bx2-MoE-v8.1.Q3_K_S.gguf
5.59 GB
LFS
0766c80af2c1e979e3f375d47d4b610b71f3c27965eb2e35df8045b317d028d0
4 months ago
MixTAO-7Bx2-MoE-v8.1.Q4_K_M.gguf
7.78 GB
LFS
df6980b19c542d1f4aa9ce99aab0868c87960a86a60cc05dc216cc74edd4ae16
4 months ago
MixTAO-7Bx2-MoE-v8.1.Q4_K_S.gguf
7.34 GB
LFS
e22ffe20f3f05897cc8e8726393131eff2c1610063097d4aa3cafdbce94cc5e3
4 months ago
MixTAO-7Bx2-MoE-v8.1.Q5_K_M.gguf
9.13 GB
LFS
618422b7621542d1f15b046ecf2fd8aee34991ac9d9cc37f88ccd29033d65979
4 months ago
MixTAO-7Bx2-MoE-v8.1.Q5_K_S.gguf
8.87 GB
LFS
0bb16db9c90beb884d963ecbb13cf8cc871bd9c0a402f65108e105c357854358
4 months ago
MixTAO-7Bx2-MoE-v8.1.Q6_K.gguf
10.6 GB
LFS
2355ae8e7a0ba17ec52cee2cef055d7b734660c12a9a04ce6e280baaba228a2a
4 months ago
