Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
ShadowYam-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
079a5e9
ShadowYam-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
4a8b4d5994e31cec3df455235f737de09490b75692ec7a29f25c87e638f31898
079a5e9
verified
4 months ago
.gitattributes
2.19 kB
4a8b4d5994e31cec3df455235f737de09490b75692ec7a29f25c87e638f31898
4 months ago
ShadowYam-7B.IQ3_XS.gguf
3.02 GB
LFS
96ea8b36cf4a1cba5333d545140cd98cb8c5106fc4ce4dd98ddff3e068b466a8
4 months ago
ShadowYam-7B.IQ4_XS.gguf
3.94 GB
LFS
1ff1b43d7d0dcf77d0433ce14e4e1ae72cf830f61aedbe7a280731f910bfd9a3
4 months ago
ShadowYam-7B.Q2_K.gguf
2.72 GB
LFS
2159b564c32a1c11ebafb59703b24554042b26102c922137dd68666a3562029c
4 months ago
ShadowYam-7B.Q3_K_L.gguf
3.82 GB
LFS
71f3f75a49bd4028cff0afb09fc8dbe47f7bf02e68fd54995e955908383379c7
4 months ago
ShadowYam-7B.Q3_K_M.gguf
3.52 GB
LFS
fdb9137ae049f4aebb11d2396b4d748a067b5f24ba03db9055b7601df8633535
4 months ago
ShadowYam-7B.Q3_K_S.gguf
3.16 GB
LFS
2908ede47b23d46d4019b9ffd4af61b125f43da130bcada14d380f25a507124c
4 months ago
ShadowYam-7B.Q4_K_M.gguf
4.37 GB
LFS
d5ba7bcbba8a91fb0c6ff9c16d582173ef62cb59d4577485eb1d7524ccf994b9
4 months ago
ShadowYam-7B.Q4_K_S.gguf
4.14 GB
LFS
855ba63f042f95606f70b4cfdbdb2afb237efc5543bc313c6767ee1bd70de006
4 months ago
ShadowYam-7B.Q5_K_M.gguf
5.13 GB
LFS
4f493d94bde580a4b477734bbee70a0ab94a1a0c263d71f5ef1839b8d7ca3aec
4 months ago
ShadowYam-7B.Q5_K_S.gguf
5 GB
LFS
3d59526cc46ab219db7a690e480570f84a11b98de0b1e84fae9cd3512d4cb89c
4 months ago
ShadowYam-7B.Q6_K.gguf
5.94 GB
LFS
4a8b4d5994e31cec3df455235f737de09490b75692ec7a29f25c87e638f31898
4 months ago
