Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Calme-7B-Instruct-v0.1.1-GGUF
like
7
Text Generation
Transformers
GGUF
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Generated from Trainer
7b
calme
conversational
dataset:mlabonne/chatml-OpenHermes2.5-dpo-binarized-alpha
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
8396508
Calme-7B-Instruct-v0.1.1-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
c9639609f5c7be1d1d46a141b40ba5ad8a14f2fb3ac7e9c79d152504dc2c99c6
8396508
verified
7 months ago
.gitattributes
2.25 kB
c9639609f5c7be1d1d46a141b40ba5ad8a14f2fb3ac7e9c79d152504dc2c99c6
7 months ago
Calme-7B-Instruct-v0.1.1.IQ4_XS.gguf
3.94 GB
LFS
4df273bad522d3c9676d18eee3df1e1af97f997b525602a0a20fdf89bcd1728e
7 months ago
Calme-7B-Instruct-v0.1.1.Q2_K.gguf
2.72 GB
LFS
3be2416cd8d45b84702fb8af66b3b094b35200253bd3df1180da6be28aaf9ba1
7 months ago
Calme-7B-Instruct-v0.1.1.Q3_K_L.gguf
3.82 GB
LFS
8a8013ffc3a72736167ca5a39ebd0b6e7c77208d838324a4a39fb6d2aad5914b
7 months ago
Calme-7B-Instruct-v0.1.1.Q3_K_M.gguf
3.52 GB
LFS
6f1f80e6863e928385edf205d3d9b22c3c3d87265dec54507a71638d8d617880
7 months ago
Calme-7B-Instruct-v0.1.1.Q3_K_S.gguf
3.16 GB
LFS
42974adb4e3bdb467f8ea1f9816eb7108efb6bb6f8b32ef01bd24a3567a646ec
7 months ago
Calme-7B-Instruct-v0.1.1.Q4_K_M.gguf
4.37 GB
LFS
562cd46ecf786fa307b93ceb0e16e3d392e10d3f1c26a5b079575d14e73ec7aa
7 months ago
Calme-7B-Instruct-v0.1.1.Q4_K_S.gguf
4.14 GB
LFS
05bb9f742fac8ace558a32c67577011b634229da8e28a7a44db08e4a80bf54d4
7 months ago
Calme-7B-Instruct-v0.1.1.Q5_K_M.gguf
5.13 GB
LFS
af098e68a73e2e132b8cd3d459262806013ad151f63de594da3f95be91f69729
7 months ago
Calme-7B-Instruct-v0.1.1.Q5_K_S.gguf
5 GB
LFS
326832fda7a2c93ee59b88b808999c5df1b0b60cb286102915ed6b6e58a926ab
7 months ago
Calme-7B-Instruct-v0.1.1.Q6_K.gguf
5.94 GB
LFS
c9639609f5c7be1d1d46a141b40ba5ad8a14f2fb3ac7e9c79d152504dc2c99c6
7 months ago