Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Inex12T3qm7xp-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Inex12T3qm7xp-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
9112b32216577d09d2910e08383bdeb312de2f4883f5b0165c5539a2b688bb2b
97a75a2
verified
about 2 months ago
.gitattributes
2.23 kB
c2c18a269c84bbd31f4b830b89e2f331ca76fcc7ef597d231ff2bb617e2192c7
about 2 months ago
Inex12T3qm7xp-7B.Q2_K.gguf
2.72 GB
LFS
8fb2800f444df1bff4e5bb8e9134453ca4adbdfa27a997092c96964ee638df3d
about 2 months ago
Inex12T3qm7xp-7B.Q3_K_L.gguf
3.82 GB
LFS
a4fa50a29efd93b5eb56cbba3bf83b3ee492a608907bf2764dc81fae50aa098a
about 2 months ago
Inex12T3qm7xp-7B.Q3_K_M.gguf
3.52 GB
LFS
1267888221d6680b36276f4b0cb00d6677a9bc0c1cf674ec3bb53f09e1835c2d
about 2 months ago
Inex12T3qm7xp-7B.Q3_K_S.gguf
3.16 GB
LFS
5c54f32a03394d9fe8e329b7553e18d1e3942dbcb780164e788ce6f6cdc2895b
about 2 months ago
Inex12T3qm7xp-7B.Q4_K_M.gguf
4.37 GB
LFS
2e8a5830f5a578d67bdc96dbf03301a981884bd40d6d20c0530552c0b06d9149
about 2 months ago
Inex12T3qm7xp-7B.Q4_K_S.gguf
4.14 GB
LFS
1c37ae6ae96e00da04601682d98d49db92178a7d20a38cff97ab803a8694fc54
about 2 months ago
Inex12T3qm7xp-7B.Q5_K_M.gguf
5.13 GB
LFS
164f430561b2990b13473568e0ceafea76923e988e81f025b3e62b47b22be1f5
about 2 months ago
Inex12T3qm7xp-7B.Q5_K_S.gguf
5 GB
LFS
c964c44298c9d6b5f31086e8e0afe56bae971f167d5dc0ee8e7225dbd5fe696d
about 2 months ago
Inex12T3qm7xp-7B.Q6_K.gguf
5.94 GB
LFS
fea2dff6d2dee09115808f98991a6055d4c66335e0d24f6f7734ecfbf69473d1
about 2 months ago
Inex12T3qm7xp-7B.Q8_0.gguf
7.7 GB
LFS
6f108d9831ba3f4a7b8e352111196ffd7932963b1acdf2228498e4f2f6839aeb
about 2 months ago
Inex12T3qm7xp-7B.fp16.gguf
14.5 GB
LFS
c2c18a269c84bbd31f4b830b89e2f331ca76fcc7ef597d231ff2bb617e2192c7
about 2 months ago
README.md
3.18 kB
9112b32216577d09d2910e08383bdeb312de2f4883f5b0165c5539a2b688bb2b
about 2 months ago
