Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
T3qm7Shadow-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
9f9176c
T3qm7Shadow-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
f024f3258d63fe3312e975318e3771ba7b90b0645117b1080d64d72a76f71142
9f9176c
verified
7 months ago
.gitattributes
Safe
2.2 kB
f024f3258d63fe3312e975318e3771ba7b90b0645117b1080d64d72a76f71142
7 months ago
T3qm7Shadow-7B.Q2_K.gguf
Safe
2.72 GB
LFS
fe6e782ba766650da99941c51f8e45c18770197a3891487b47562662af6b8267
7 months ago
T3qm7Shadow-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
e1327b7e4cb59972fd2a97820a4ffccf6be0f2674b86f59d77a95334cd503bea
7 months ago
T3qm7Shadow-7B.Q3_K_M.gguf
Safe
3.52 GB
LFS
41da95c0159c680525e6295ceba014e3d4e34fcb561e3cb7882027a07bcaa193
7 months ago
T3qm7Shadow-7B.Q3_K_S.gguf
Safe
3.16 GB
LFS
1a09ab4bff85fb69a24a708c849087296c97003356117d19aced783ff374f006
7 months ago
T3qm7Shadow-7B.Q4_K_M.gguf
Safe
4.37 GB
LFS
119d56e792e22e4d773a6de080d538e3bf85fe79e09de43257392352d549e724
7 months ago
T3qm7Shadow-7B.Q4_K_S.gguf
Safe
4.14 GB
LFS
dc851476f724c6143b6ed3a1bef29663b819416b597208b163274fd202c15a64
7 months ago
T3qm7Shadow-7B.Q5_K_M.gguf
Safe
5.13 GB
LFS
a46c58b6f26d5b6afba10ae4dc166fd1387e536a6abb0c3990e146b82fb2f323
7 months ago
T3qm7Shadow-7B.Q5_K_S.gguf
Safe
5 GB
LFS
ef90948d269603863fc954a1740bc2b5719f7a0be246bb05b0886fb092e334ea
7 months ago
T3qm7Shadow-7B.Q6_K.gguf
Safe
5.94 GB
LFS
3758744a4e11dc43f15001e12d6e62593f01d208dcb0bd3b94301483970aef10
7 months ago
T3qm7Shadow-7B.Q8_0.gguf
Safe
7.7 GB
LFS
4e96e442c185fe7c40eef5e25c85492539c392b1555cd481fc2f82d3e6ed36f6
7 months ago
T3qm7Shadow-7B.fp16.gguf
Safe
14.5 GB
LFS
f024f3258d63fe3312e975318e3771ba7b90b0645117b1080d64d72a76f71142
7 months ago
