Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment26Alloyingotneoy-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
d03d72a
Experiment26Alloyingotneoy-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
7067b40f130c48ed295dedd6267b10af241397a84ef3a27af08c5596e3ea13c6
d03d72a
verified
7 months ago
.gitattributes
2.37 kB
850b6ee5fa054628ac8e5a8af69c8e1710a24e4dde5d8e5f7f2ae1a4a64e391b
7 months ago
Experiment26Alloyingotneoy-7B.IQ3_XS.gguf
3.02 GB
LFS
1b82931ea9fbbe7541136c62779e9597f6647f5f8b5699c5b1737fbc01c72c07
7 months ago
Experiment26Alloyingotneoy-7B.IQ4_XS.gguf
3.94 GB
LFS
fe06681c9be71ad470708f806f3b5dcb0ffd32bde6148da1a15b6af25e76a251
7 months ago
Experiment26Alloyingotneoy-7B.Q2_K.gguf
2.72 GB
LFS
88e5a370ab43bc8090f8284379c9bbe08205a59d1dc1e6804a22ede90f203633
7 months ago
Experiment26Alloyingotneoy-7B.Q3_K_L.gguf
3.82 GB
LFS
378b6b24bd04d6cd01fddb42fde0ea374b3b5387c2d1ca11f1cbb76c3a5e21e7
7 months ago
Experiment26Alloyingotneoy-7B.Q3_K_M.gguf
3.52 GB
LFS
157b25f7978cfac2f9f142e608a47523a560d2003b1edb23c5c7a002af4f21b9
7 months ago
Experiment26Alloyingotneoy-7B.Q3_K_S.gguf
3.16 GB
LFS
c355da303829a3896f1be01fee93817cc6748a719138a7bbc0c80d1b8a3b4e1f
7 months ago
Experiment26Alloyingotneoy-7B.Q4_K_M.gguf
4.37 GB
LFS
b3718d9e90432f9bb87b106fb0950ec2bf4ff0e8b3ac9e457f5563ff27d92511
7 months ago
Experiment26Alloyingotneoy-7B.Q4_K_S.gguf
4.14 GB
LFS
dc0961117752d5acca7c927e6da30b37ecb71e7efa22ddb1bc32aa3a93eb6a26
7 months ago
Experiment26Alloyingotneoy-7B.Q5_K_M.gguf
5.13 GB
LFS
19c8b53ba7f90227afe9a53bf693eb1d1ec1533bd017bb24626b3594a730d7cf
7 months ago
Experiment26Alloyingotneoy-7B.Q5_K_S.gguf
5 GB
LFS
7ec2b88d773249d3b4a4b55a5390199ab1226d953334478bfe73be6265e17008
7 months ago
Experiment26Alloyingotneoy-7B.Q6_K.gguf
5.94 GB
LFS
850b6ee5fa054628ac8e5a8af69c8e1710a24e4dde5d8e5f7f2ae1a4a64e391b
7 months ago
README.md
11.2 kB
7067b40f130c48ed295dedd6267b10af241397a84ef3a27af08c5596e3ea13c6
7 months ago
