Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Inex12T3qm7xp-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
6ef1026
Inex12T3qm7xp-7B-GGUF
1 contributor
History:
9 commits
MaziyarPanahi
c964c44298c9d6b5f31086e8e0afe56bae971f167d5dc0ee8e7225dbd5fe696d
6ef1026
verified
6 months ago
.gitattributes
2.04 kB
c964c44298c9d6b5f31086e8e0afe56bae971f167d5dc0ee8e7225dbd5fe696d
6 months ago
Inex12T3qm7xp-7B.Q2_K.gguf
2.72 GB
LFS
8fb2800f444df1bff4e5bb8e9134453ca4adbdfa27a997092c96964ee638df3d
6 months ago
Inex12T3qm7xp-7B.Q3_K_L.gguf
3.82 GB
LFS
a4fa50a29efd93b5eb56cbba3bf83b3ee492a608907bf2764dc81fae50aa098a
6 months ago
Inex12T3qm7xp-7B.Q3_K_M.gguf
3.52 GB
LFS
1267888221d6680b36276f4b0cb00d6677a9bc0c1cf674ec3bb53f09e1835c2d
6 months ago
Inex12T3qm7xp-7B.Q3_K_S.gguf
3.16 GB
LFS
5c54f32a03394d9fe8e329b7553e18d1e3942dbcb780164e788ce6f6cdc2895b
6 months ago
Inex12T3qm7xp-7B.Q4_K_M.gguf
4.37 GB
LFS
2e8a5830f5a578d67bdc96dbf03301a981884bd40d6d20c0530552c0b06d9149
6 months ago
Inex12T3qm7xp-7B.Q4_K_S.gguf
4.14 GB
LFS
1c37ae6ae96e00da04601682d98d49db92178a7d20a38cff97ab803a8694fc54
6 months ago
Inex12T3qm7xp-7B.Q5_K_M.gguf
5.13 GB
LFS
164f430561b2990b13473568e0ceafea76923e988e81f025b3e62b47b22be1f5
6 months ago
Inex12T3qm7xp-7B.Q5_K_S.gguf
5 GB
LFS
c964c44298c9d6b5f31086e8e0afe56bae971f167d5dc0ee8e7225dbd5fe696d
6 months ago
