Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
hermes42
/
Mistral-7B-Instruct-v0.3-imatrix-GGUF
like
4
Text Generation
GGUF
nlp
code
imatrix
Inference Endpoints
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
f2fe421
Mistral-7B-Instruct-v0.3-imatrix-GGUF
1 contributor
History:
18 commits
hermes42
Upload Mistral-7B-Instruct-v0.3-Q2_K_S.gguf with huggingface_hub
f2fe421
verified
5 months ago
.gitattributes
2.6 kB
Upload Mistral-7B-Instruct-v0.3-Q2_K_S.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-IQ1_M.gguf
1.76 GB
LFS
Upload Mistral-7B-Instruct-v0.3-IQ1_M.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-IQ1_S.gguf
1.62 GB
LFS
Upload Mistral-7B-Instruct-v0.3-IQ1_S.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-IQ2_M.gguf
2.5 GB
LFS
Upload Mistral-7B-Instruct-v0.3-IQ2_M.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-IQ2_S.gguf
2.31 GB
LFS
Upload Mistral-7B-Instruct-v0.3-IQ2_S.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-IQ2_XS.gguf
2.2 GB
LFS
Upload Mistral-7B-Instruct-v0.3-IQ2_XS.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-IQ2_XXS.gguf
1.99 GB
LFS
Upload Mistral-7B-Instruct-v0.3-IQ2_XXS.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-Q2_K.gguf
2.72 GB
LFS
Upload Mistral-7B-Instruct-v0.3-Q2_K.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-Q2_K_S.gguf
2.53 GB
LFS
Upload Mistral-7B-Instruct-v0.3-Q2_K_S.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-Q4_0.gguf
4.13 GB
LFS
Upload Mistral-7B-Instruct-v0.3-Q4_0.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-Q4_1.gguf
4.56 GB
LFS
Upload Mistral-7B-Instruct-v0.3-Q4_1.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-Q5_0.gguf
5.02 GB
LFS
Upload Mistral-7B-Instruct-v0.3-Q5_0.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-Q5_1.gguf
5.45 GB
LFS
Upload Mistral-7B-Instruct-v0.3-Q5_1.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-bf16.gguf
14.5 GB
LFS
Upload Mistral-7B-Instruct-v0.3-bf16.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-f32.gguf
29 GB
LFS
Upload Mistral-7B-Instruct-v0.3-f32.gguf with huggingface_hub
5 months ago
Mistral-7B-Instruct-v0.3-imatrix.dat
4.99 MB
LFS
Upload Mistral-7B-Instruct-v0.3-imatrix.dat with huggingface_hub
5 months ago
README.md
6.02 kB
Upload README.md with huggingface_hub
5 months ago
group_10_merged.txt
162 kB
Upload group_10_merged.txt with huggingface_hub
5 months ago