Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mistral-Small-Instruct-2409-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
2
Train
Use this model
refs/pr/2
Mistral-Small-Instruct-2409-GGUF
1 contributor
History:
15 commits
MaziyarPanahi
0fb3638a70ba88651162de04335877d10f2b800836e839c209839ef27eff54e6
6020b0d
verified
19 days ago
.gitattributes
Safe
2.81 kB
Upload folder using huggingface_hub (#1)
4 months ago
Mistral-Small-Instruct-2409-GGUF_imatrix.dat
11.9 MB
LFS
Upload folder using huggingface_hub (#1)
4 months ago
Mistral-Small-Instruct-2409.IQ1_M.gguf
Safe
5.27 GB
LFS
Upload folder using huggingface_hub (#1)
4 months ago
Mistral-Small-Instruct-2409.IQ1_S.gguf
Safe
4.83 GB
LFS
Upload folder using huggingface_hub (#1)
4 months ago
Mistral-Small-Instruct-2409.IQ2_XS.gguf
Safe
6.65 GB
LFS
Upload folder using huggingface_hub (#1)
4 months ago
Mistral-Small-Instruct-2409.IQ3_XS.gguf
Safe
9.18 GB
LFS
Upload folder using huggingface_hub (#1)
4 months ago
Mistral-Small-Instruct-2409.IQ4_XS.gguf
Safe
11.9 GB
LFS
Upload folder using huggingface_hub (#1)
4 months ago
Mistral-Small-Instruct-2409.Q2_K.gguf
Safe
8.27 GB
LFS
0d28c3482790df1284f9e2e7e1fbf8f7a364619ab1593ed5528eb75d7a77b92d
19 days ago
Mistral-Small-Instruct-2409.Q3_K_L.gguf
Safe
11.7 GB
LFS
346eb1d1d5ae2b7b964d8b5a9a97538e1675c1e6304ef9d599995f977a57f427
19 days ago
Mistral-Small-Instruct-2409.Q3_K_M.gguf
Safe
10.8 GB
LFS
ad5a361c29248d05bbe2fda452fef26f8b5eedbd55d7be788122767140a6ccd8
19 days ago
Mistral-Small-Instruct-2409.Q3_K_S.gguf
Safe
9.64 GB
LFS
f15b7abc9e09613cf7931447a8a74469c1ca8a36d13f05cfd4428872db89c631
19 days ago
Mistral-Small-Instruct-2409.Q4_K_M.gguf
Safe
13.3 GB
LFS
40ae70d9124b6e3da01a72a8d3070d8c5895845e781ce319d30d8536c6372ad8
19 days ago
Mistral-Small-Instruct-2409.Q4_K_S.gguf
Safe
12.7 GB
LFS
6b10d62a7b97013fa426776ce5d0e301a7734fab3414c84acd449950488f0d49
19 days ago
Mistral-Small-Instruct-2409.Q5_K_M.gguf
Safe
15.7 GB
LFS
9063e603d56a619f37bd57820de4b7e3b798fc50f3c10f0f69f012a01cc0e8c5
19 days ago
Mistral-Small-Instruct-2409.Q5_K_S.gguf
Safe
15.3 GB
LFS
743142d8bc7697065359f49e94ed56b82c20cf554c94696b9c1b7f39bf016e2f
19 days ago
Mistral-Small-Instruct-2409.Q6_K.gguf
Safe
18.3 GB
LFS
730837680b5daa7ba323b133e86385d1b1d3fddb34baaa2ef661caeb6dc755a2
19 days ago
Mistral-Small-Instruct-2409.Q8_0.gguf
Safe
23.6 GB
LFS
49615bc4e346873eb97fb8af927ab46fd54527ef2727d3a03dfdd989b327516d
19 days ago
Mistral-Small-Instruct-2409.fp16.gguf
Safe
44.5 GB
LFS
ad66f7a94507d943161a679e50a16cb1f1d6bdaf7f3f7e2eb4e6d16a3daed49a
19 days ago
README.md
Safe
3.04 kB
0fb3638a70ba88651162de04335877d10f2b800836e839c209839ef27eff54e6
19 days ago
config.json
Safe
31 Bytes
Upload folder using huggingface_hub
4 months ago
