Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
YamShadow-7B-GGUF
like
1
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
ce2825b
YamShadow-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
6100a5677b5de35be01ff6cf746586bda409cce89e439412113c69a99b1a08de
ce2825b
verified
9 months ago
.gitattributes
2.19 kB
6100a5677b5de35be01ff6cf746586bda409cce89e439412113c69a99b1a08de
9 months ago
YamShadow-7B.IQ3_XS.gguf
3.02 GB
LFS
5e0ea98eb89efc1e37245969503cd7a3b0c7bd0c6878cfdfd5239cc90bf2fbf4
9 months ago
YamShadow-7B.IQ4_XS.gguf
3.94 GB
LFS
a143605f8437d67386354279d1495194e61d6f4e0b30d873a9ac96bf1c18f548
9 months ago
YamShadow-7B.Q2_K.gguf
2.72 GB
LFS
98849a568854c3e2be96de1735c13b19114791b706bb6e39349bd86cf426d49d
9 months ago
YamShadow-7B.Q3_K_L.gguf
3.82 GB
LFS
c202f179f9885325cda87fbe53637de7f9c95692756620b5dccd85b3df8606af
9 months ago
YamShadow-7B.Q3_K_M.gguf
3.52 GB
LFS
934dcb7a69702a5958957ea8c44142e1eed93385e187c371c88b0b601c034b50
9 months ago
YamShadow-7B.Q3_K_S.gguf
3.16 GB
LFS
4d1836da9fed3cd0369abe833eaba32b4472e0b9fdc2482f182e7811f3990990
9 months ago
YamShadow-7B.Q4_K_M.gguf
4.37 GB
LFS
25ecbbea3f585d5c9733e58e1f3cb858252c2c3690782be3b3b91fc82229c6e3
9 months ago
YamShadow-7B.Q4_K_S.gguf
4.14 GB
LFS
3de321f72a69bf031c81e44b7593822a39cb25bc7bc32f4b8c84e1301b3abaa5
9 months ago
YamShadow-7B.Q5_K_M.gguf
5.13 GB
LFS
4b278031b2c823e75b4fa8d84f94bdd17648f7ba2549f87b04f854409f663188
9 months ago
YamShadow-7B.Q5_K_S.gguf
5 GB
LFS
d5fe14f9bc94a6ff4f7054f4cf934382c182b7648b2489f23d84f9c72d239166
9 months ago
YamShadow-7B.Q6_K.gguf
5.94 GB
LFS
6100a5677b5de35be01ff6cf746586bda409cce89e439412113c69a99b1a08de
9 months ago
