Artefact2
/

Mixtral-8x7B-Instruct-v0.1-GGUF

Inference Endpoints

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-GGUF

1 contributor

History: 8 commits

Artefact2's picture

Upload Mixtral-8x7B-Instruct-v0.1-IQ3_XXS.gguf with huggingface_hub

b1f92f9 verified 12 months ago

.gitattributes
2.04 kB

Upload Mixtral-8x7B-Instruct-v0.1-IQ3_XXS.gguf with huggingface_hub 12 months ago
Mixtral-8x7B-Instruct-v0.1-IQ3_XXS.gguf

18.2 GB
LFS

Upload Mixtral-8x7B-Instruct-v0.1-IQ3_XXS.gguf with huggingface_hub 12 months ago
Mixtral-8x7B-Instruct-v0.1-Q4_K_M.gguf

28.4 GB
LFS

Upload Mixtral-8x7B-Instruct-v0.1-Q4_K_M.gguf with huggingface_hub 12 months ago
Mixtral-8x7B-Instruct-v0.1-Q4_K_S.gguf

26.7 GB
LFS

Upload Mixtral-8x7B-Instruct-v0.1-Q4_K_S.gguf with huggingface_hub 12 months ago
Mixtral-8x7B-Instruct-v0.1-Q5_K_M.gguf

33.2 GB
LFS

Upload Mixtral-8x7B-Instruct-v0.1-Q5_K_M.gguf with huggingface_hub 12 months ago
Mixtral-8x7B-Instruct-v0.1-Q5_K_S.gguf
32.2 GB
LFS

Upload Mixtral-8x7B-Instruct-v0.1-Q5_K_S.gguf with huggingface_hub 12 months ago
Mixtral-8x7B-Instruct-v0.1-Q6_K.gguf
38.4 GB
LFS

Upload Mixtral-8x7B-Instruct-v0.1-Q6_K.gguf with huggingface_hub 12 months ago
Mixtral-8x7B-Instruct-v0.1-imatrix.dat

25.7 MB
LFS

Upload Mixtral-8x7B-Instruct-v0.1-imatrix.dat with huggingface_hub 12 months ago