Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
T3qm7Shadow-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
0f508e6
T3qm7Shadow-7B-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
a46c58b6f26d5b6afba10ae4dc166fd1387e536a6abb0c3990e146b82fb2f323
0f508e6
verified
7 months ago
.gitattributes
1.96 kB
a46c58b6f26d5b6afba10ae4dc166fd1387e536a6abb0c3990e146b82fb2f323
7 months ago
T3qm7Shadow-7B.Q2_K.gguf
2.72 GB
LFS
fe6e782ba766650da99941c51f8e45c18770197a3891487b47562662af6b8267
7 months ago
T3qm7Shadow-7B.Q3_K_L.gguf
3.82 GB
LFS
e1327b7e4cb59972fd2a97820a4ffccf6be0f2674b86f59d77a95334cd503bea
7 months ago
T3qm7Shadow-7B.Q3_K_M.gguf
3.52 GB
LFS
41da95c0159c680525e6295ceba014e3d4e34fcb561e3cb7882027a07bcaa193
7 months ago
T3qm7Shadow-7B.Q3_K_S.gguf
3.16 GB
LFS
1a09ab4bff85fb69a24a708c849087296c97003356117d19aced783ff374f006
7 months ago
T3qm7Shadow-7B.Q4_K_M.gguf
4.37 GB
LFS
119d56e792e22e4d773a6de080d538e3bf85fe79e09de43257392352d549e724
7 months ago
T3qm7Shadow-7B.Q4_K_S.gguf
4.14 GB
LFS
dc851476f724c6143b6ed3a1bef29663b819416b597208b163274fd202c15a64
7 months ago
T3qm7Shadow-7B.Q5_K_M.gguf
5.13 GB
LFS
a46c58b6f26d5b6afba10ae4dc166fd1387e536a6abb0c3990e146b82fb2f323
7 months ago