Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mistral-Small-Instruct-2409-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
2
Train
Use this model
b29eea7
Mistral-Small-Instruct-2409-GGUF
1 contributor
History:
9 commits
MaziyarPanahi
6b10d62a7b97013fa426776ce5d0e301a7734fab3414c84acd449950488f0d49
b29eea7
verified
about 1 month ago
.gitattributes
Safe
2.81 kB
Upload folder using huggingface_hub (#1)
5 months ago
Mistral-Small-Instruct-2409-GGUF_imatrix.dat
11.9 MB
LFS
Upload folder using huggingface_hub (#1)
5 months ago
Mistral-Small-Instruct-2409.IQ1_M.gguf
Safe
5.27 GB
LFS
Upload folder using huggingface_hub (#1)
5 months ago
Mistral-Small-Instruct-2409.IQ1_S.gguf
Safe
4.83 GB
LFS
Upload folder using huggingface_hub (#1)
5 months ago
Mistral-Small-Instruct-2409.IQ2_XS.gguf
Safe
6.65 GB
LFS
Upload folder using huggingface_hub (#1)
5 months ago
Mistral-Small-Instruct-2409.IQ3_XS.gguf
Safe
9.18 GB
LFS
Upload folder using huggingface_hub (#1)
5 months ago
Mistral-Small-Instruct-2409.IQ4_XS.gguf
Safe
11.9 GB
LFS
Upload folder using huggingface_hub (#1)
5 months ago
Mistral-Small-Instruct-2409.Q2_K.gguf
Safe
8.27 GB
LFS
0d28c3482790df1284f9e2e7e1fbf8f7a364619ab1593ed5528eb75d7a77b92d
about 1 month ago
Mistral-Small-Instruct-2409.Q3_K_L.gguf
Safe
11.7 GB
LFS
346eb1d1d5ae2b7b964d8b5a9a97538e1675c1e6304ef9d599995f977a57f427
about 1 month ago
Mistral-Small-Instruct-2409.Q3_K_M.gguf
Safe
10.8 GB
LFS
ad5a361c29248d05bbe2fda452fef26f8b5eedbd55d7be788122767140a6ccd8
about 1 month ago
Mistral-Small-Instruct-2409.Q3_K_S.gguf
Safe
9.64 GB
LFS
f15b7abc9e09613cf7931447a8a74469c1ca8a36d13f05cfd4428872db89c631
about 1 month ago
Mistral-Small-Instruct-2409.Q4_K_M.gguf
Safe
13.3 GB
LFS
40ae70d9124b6e3da01a72a8d3070d8c5895845e781ce319d30d8536c6372ad8
about 1 month ago
Mistral-Small-Instruct-2409.Q4_K_S.gguf
Safe
12.7 GB
LFS
6b10d62a7b97013fa426776ce5d0e301a7734fab3414c84acd449950488f0d49
about 1 month ago
Mistral-Small-Instruct-2409.Q5_K_M.gguf
Safe
15.7 GB
LFS
Upload folder using huggingface_hub (#1)
5 months ago
Mistral-Small-Instruct-2409.Q5_K_S.gguf
Safe
15.3 GB
LFS
Upload folder using huggingface_hub (#1)
5 months ago
Mistral-Small-Instruct-2409.Q6_K.gguf
Safe
18.3 GB
LFS
Upload folder using huggingface_hub (#1)
5 months ago
Mistral-Small-Instruct-2409.Q8_0.gguf
Safe
23.6 GB
LFS
Upload folder using huggingface_hub (#1)
5 months ago
Mistral-Small-Instruct-2409.fp16.gguf
Safe
44.5 GB
LFS
Upload folder using huggingface_hub (#1)
5 months ago
README.md
Safe
3.06 kB
Upload folder using huggingface_hub (#1)
5 months ago
config.json
Safe
31 Bytes
Upload folder using huggingface_hub
5 months ago
