Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
AlloyingotneoyExperiment28-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
ae37f6f
AlloyingotneoyExperiment28-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
a9e43db90c2e6a87c391cbfdf81b863fca39aca5e1aa8feb70d6b6bdf31a5285
ae37f6f
verified
9 months ago
.gitattributes
Safe
2.37 kB
a9e43db90c2e6a87c391cbfdf81b863fca39aca5e1aa8feb70d6b6bdf31a5285
9 months ago
AlloyingotneoyExperiment28-7B.IQ3_XS.gguf
Safe
3.02 GB
LFS
cd65cd4263f02bb36c9699376f7fa62696e5a0062db457c1287a983d335bcd91
9 months ago
AlloyingotneoyExperiment28-7B.IQ4_XS.gguf
Safe
3.94 GB
LFS
6f88ea4df689c08096cb71cfc17abd0ec2abd5c4e4403a8352e87db70b661544
9 months ago
AlloyingotneoyExperiment28-7B.Q2_K.gguf
Safe
2.72 GB
LFS
02a64846b7022eeabbf84870d09d2722512d1de9e74e1574543753c6da5785b0
9 months ago
AlloyingotneoyExperiment28-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
c9d4df212b8e58667d34a31db63bbeb77daffbf651a4faf0d85cc06616313b06
9 months ago
AlloyingotneoyExperiment28-7B.Q3_K_M.gguf
Safe
3.52 GB
LFS
51ccc1749c46d72f9fb29901cf7961ea6ec44b598060dab27e97042b32ca2ab6
9 months ago
AlloyingotneoyExperiment28-7B.Q3_K_S.gguf
Safe
3.16 GB
LFS
e40cb1ed3679a4759ae07feed1f935ba9dbd3cda1d500fd22ec09315ceb4e95c
9 months ago
AlloyingotneoyExperiment28-7B.Q4_K_M.gguf
Safe
4.37 GB
LFS
05690b59617e43a0a3e0723f0bb0cbf0b35ab48706d49bdee563baf2942fd40a
9 months ago
AlloyingotneoyExperiment28-7B.Q4_K_S.gguf
Safe
4.14 GB
LFS
dc5749bd4caff537176d96dba59affa76f0ce6e67a78ef3126c7275748e0e982
9 months ago
AlloyingotneoyExperiment28-7B.Q5_K_M.gguf
Safe
5.13 GB
LFS
110197ce0f1aa9353338fe35c31e752b7c65b944050ae64ae3f266a69d17f67f
9 months ago
AlloyingotneoyExperiment28-7B.Q5_K_S.gguf
Safe
5 GB
LFS
8f15c9e73de6a6746c51c159f88b0d18aac9d8811a2da102f89f355d8d8cb3ea
9 months ago
AlloyingotneoyExperiment28-7B.Q6_K.gguf
Safe
5.94 GB
LFS
a9e43db90c2e6a87c391cbfdf81b863fca39aca5e1aa8feb70d6b6bdf31a5285
9 months ago
