Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment27Inex12-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Experiment27Inex12-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
d881956369bfab69cd998834721372012c18c1cdac48b165566858e1c7ac0872
706e310
verified
10 months ago
.gitattributes
Safe
2.29 kB
02ed2e457a29c87ef19fc9c1ff1686c487964f7f5650c5b056212aea5e99c74d
10 months ago
Experiment27Inex12-7B.IQ3_XS.gguf
Safe
3.02 GB
LFS
05a5fe972530b404ba4e286f21369760f82a4cf7f12c4703b638eec15f2a5f04
10 months ago
Experiment27Inex12-7B.IQ4_XS.gguf
Safe
3.94 GB
LFS
f81beb674bad5c23463c33a4a473fe8185066f9bc06ca6b6941005a0518974ca
10 months ago
Experiment27Inex12-7B.Q2_K.gguf
Safe
2.72 GB
LFS
ab9112d05b4657353203f66c675aaecddad685a9f25829575b86e7d7e6e6c007
10 months ago
Experiment27Inex12-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
9380f7aa3dce2c75f6a801df470d29686a8946c026c5a328cd1daf2825e593ec
10 months ago
Experiment27Inex12-7B.Q3_K_M.gguf
Safe
3.52 GB
LFS
34e8fd9b061cef122ef7044a53e070df57112e7ab9cf9c2b50783d0dfacd25ac
10 months ago
Experiment27Inex12-7B.Q3_K_S.gguf
Safe
3.16 GB
LFS
41870adb984891c0d6eaf91b195eef97220e75579447d965bf2cba040a0d39a8
10 months ago
Experiment27Inex12-7B.Q4_K_M.gguf
Safe
4.37 GB
LFS
2f6be2f98059164a4300d7e1ec290e8a047dc59b817463c83a887c693482e3c0
10 months ago
Experiment27Inex12-7B.Q4_K_S.gguf
Safe
4.14 GB
LFS
a1bf906dec5c1ee78aacf56c5d27f85e3a951b7c462431702a8a399074b12cd5
10 months ago
Experiment27Inex12-7B.Q5_K_M.gguf
5.13 GB
LFS
4bcda7f309f43bf843fcf09fde104e9a5b218d0113d1630b80f8b863c13cc74c
10 months ago
Experiment27Inex12-7B.Q5_K_S.gguf
5 GB
LFS
09dcea6fe6d5717865c3e05ed333e59639dce0b3c36cfb00629a6f1c057d3511
10 months ago
Experiment27Inex12-7B.Q6_K.gguf
5.94 GB
LFS
02ed2e457a29c87ef19fc9c1ff1686c487964f7f5650c5b056212aea5e99c74d
10 months ago
README.md
Safe
11 kB
d881956369bfab69cd998834721372012c18c1cdac48b165566858e1c7ac0872
10 months ago
