Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Yamshadowexperiment28T3qm7xp-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
2b86b4d
Yamshadowexperiment28T3qm7xp-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
eddf07fb966ce6795eb19ac5fe5f1872a2ec90d8c36eafe35d4d8f64aa33deb5
2b86b4d
verified
6 months ago
.gitattributes
2.39 kB
8ec80acfabcc3c5e2bad746da74f7e2d30f04d9fa3002df0f9aca00377b5a900
6 months ago
README.md
3.3 kB
eddf07fb966ce6795eb19ac5fe5f1872a2ec90d8c36eafe35d4d8f64aa33deb5
6 months ago
Yamshadowexperiment28T3qm7xp-7B.Q2_K.gguf
2.72 GB
LFS
440ab7e293e6afa0d4eccc6cff0f44bba91430552d912cf0602805222bac63cb
6 months ago
Yamshadowexperiment28T3qm7xp-7B.Q3_K_L.gguf
3.82 GB
LFS
0e96e3ec12b6537cf3ba2058ea967a257a2267e4e61d406a17f961d3bb4d8451
6 months ago
Yamshadowexperiment28T3qm7xp-7B.Q3_K_M.gguf
3.52 GB
LFS
bf42176c1f18adc30f1c9445c1f74793fd3bdf2e9a20aa319ebf38324fdce579
6 months ago
Yamshadowexperiment28T3qm7xp-7B.Q3_K_S.gguf
3.16 GB
LFS
0fe9fa279cc84fc6e21b553df92658bf9181b46e72d32fd600bfe29c094aa0b1
6 months ago
Yamshadowexperiment28T3qm7xp-7B.Q4_K_M.gguf
4.37 GB
LFS
555686227c6961a0e44dfd0ba257bb40f9bd2991d99d35b289195bba9b3a9002
6 months ago
Yamshadowexperiment28T3qm7xp-7B.Q4_K_S.gguf
4.14 GB
LFS
b9d4c99ad26ed087bf602e401ac0823e57ddc9ff9ebdba2e827e74f4cb4a6123
6 months ago
Yamshadowexperiment28T3qm7xp-7B.Q5_K_M.gguf
5.13 GB
LFS
443453db5cf400b4d124ef2acb16dc933a41a35931393133bf82a6ce0bfe5a83
6 months ago
Yamshadowexperiment28T3qm7xp-7B.Q5_K_S.gguf
5 GB
LFS
e1fdff5090efcf79c66684825fae6eca7d31b896840e7d08793e89d88426ba6b
6 months ago
Yamshadowexperiment28T3qm7xp-7B.Q6_K.gguf
5.94 GB
LFS
39872b469fb6fa5f56ee5acfa2d33f4156ad997c2d5c92e2678f24c55caeffc4
6 months ago
Yamshadowexperiment28T3qm7xp-7B.Q8_0.gguf
7.7 GB
LFS
bc80cc7021eea78541d3078b1c4f50ccc51df342e3c1f80cc2e7d261d7870287
6 months ago
Yamshadowexperiment28T3qm7xp-7B.fp16.gguf
14.5 GB
LFS
8ec80acfabcc3c5e2bad746da74f7e2d30f04d9fa3002df0f9aca00377b5a900
6 months ago