Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
hermes42
/
Mistral-7B-Instruct-v0.3-imatrix-GGUF
like
4
Text Generation
GGUF
nlp
code
imatrix
Inference Endpoints
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
8b5ebdb
Mistral-7B-Instruct-v0.3-imatrix-GGUF
1 contributor
History:
20 commits
hermes42
Upload Mistral-7B-Instruct-v0.3-IQ3_S.gguf with huggingface_hub
8b5ebdb
verified
8 months ago
.gitattributes
Safe
2.74 kB
Upload Mistral-7B-Instruct-v0.3-IQ3_S.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-IQ1_M.gguf
Safe
1.76 GB
LFS
Upload Mistral-7B-Instruct-v0.3-IQ1_M.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-IQ1_S.gguf
Safe
1.62 GB
LFS
Upload Mistral-7B-Instruct-v0.3-IQ1_S.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-IQ2_M.gguf
Safe
2.5 GB
LFS
Upload Mistral-7B-Instruct-v0.3-IQ2_M.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-IQ2_S.gguf
Safe
2.31 GB
LFS
Upload Mistral-7B-Instruct-v0.3-IQ2_S.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-IQ2_XS.gguf
Safe
2.2 GB
LFS
Upload Mistral-7B-Instruct-v0.3-IQ2_XS.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-IQ2_XXS.gguf
Safe
1.99 GB
LFS
Upload Mistral-7B-Instruct-v0.3-IQ2_XXS.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-IQ3_M.gguf
Safe
3.29 GB
LFS
Upload Mistral-7B-Instruct-v0.3-IQ3_M.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-IQ3_S.gguf
Safe
3.19 GB
LFS
Upload Mistral-7B-Instruct-v0.3-IQ3_S.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-Q2_K.gguf
Safe
2.72 GB
LFS
Upload Mistral-7B-Instruct-v0.3-Q2_K.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-Q2_K_S.gguf
Safe
2.53 GB
LFS
Upload Mistral-7B-Instruct-v0.3-Q2_K_S.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-Q4_0.gguf
Safe
4.13 GB
LFS
Upload Mistral-7B-Instruct-v0.3-Q4_0.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-Q4_1.gguf
Safe
4.56 GB
LFS
Upload Mistral-7B-Instruct-v0.3-Q4_1.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-Q5_0.gguf
Safe
5.02 GB
LFS
Upload Mistral-7B-Instruct-v0.3-Q5_0.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-Q5_1.gguf
Safe
5.45 GB
LFS
Upload Mistral-7B-Instruct-v0.3-Q5_1.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-bf16.gguf
Safe
14.5 GB
LFS
Upload Mistral-7B-Instruct-v0.3-bf16.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-f32.gguf
Safe
29 GB
LFS
Upload Mistral-7B-Instruct-v0.3-f32.gguf with huggingface_hub
8 months ago
Mistral-7B-Instruct-v0.3-imatrix.dat
Safe
4.99 MB
LFS
Upload Mistral-7B-Instruct-v0.3-imatrix.dat with huggingface_hub
8 months ago
README.md
Safe
6.02 kB
Upload README.md with huggingface_hub
8 months ago
group_10_merged.txt
Safe
162 kB
Upload group_10_merged.txt with huggingface_hub
8 months ago