Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment26Experiment26-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Experiment26Experiment26-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
29b816f28a40dcfdf5943d6bf4f1f26e07a6b3bbe1ed1d8a034a1ecb56037306
73e3c98
verified
3 months ago
.gitattributes
2.35 kB
fddeab88d5fc0dcf52d2adf160ab675538fae8dc0ee70045c0d1f9ca8b1a448b
3 months ago
Experiment26Experiment26-7B.IQ3_XS.gguf
3.02 GB
LFS
a195198308e1e1500e609d98ec70443ba2ab480fc9053e6bf04f782b97b1a627
3 months ago
Experiment26Experiment26-7B.IQ4_XS.gguf
3.94 GB
LFS
255c1f8eb19a4e16b398a3863c832f5631178953e38c6e4a7179b8180f52d4c5
3 months ago
Experiment26Experiment26-7B.Q2_K.gguf
2.72 GB
LFS
d32c50b1b8ea77b8217023105a0f68244d86eb87bb0646b25aca33900ed16abd
3 months ago
Experiment26Experiment26-7B.Q3_K_L.gguf
3.82 GB
LFS
8b1a471b6df7dc934f7fe98833dcac8089a77fff017cb6e34a780e52038a3ba4
3 months ago
Experiment26Experiment26-7B.Q3_K_M.gguf
3.52 GB
LFS
e57fbe603c2b6cc9d79ae1fc13bb44c56f64c2833240af09a8bc834a84c93f64
3 months ago
Experiment26Experiment26-7B.Q3_K_S.gguf
3.16 GB
LFS
d296f4e5e6f9b5718d100521ab65298767ba37e18c24ef598a33389bda04260c
3 months ago
Experiment26Experiment26-7B.Q4_K_M.gguf
4.37 GB
LFS
30f38e9a6eef70d820419cf3c26dd2b047c95ee5230f75296bcce34e7dc3a8e5
3 months ago
Experiment26Experiment26-7B.Q4_K_S.gguf
4.14 GB
LFS
62cc46c8ccf643365e1e3d0ecdd7d7a1d4c3b817d387f718557fb68c032c796f
3 months ago
Experiment26Experiment26-7B.Q5_K_M.gguf
5.13 GB
LFS
8491d36098fc6f29a0245fd2ea294c8565f71e69308b84fa632e8ba7f82ef624
3 months ago
Experiment26Experiment26-7B.Q5_K_S.gguf
5 GB
LFS
fa1ac102450d4990904bd0769e4cc72bac8f801826bb35ee79f40cf715ffd57a
3 months ago
Experiment26Experiment26-7B.Q6_K.gguf
5.94 GB
LFS
fddeab88d5fc0dcf52d2adf160ab675538fae8dc0ee70045c0d1f9ca8b1a448b
3 months ago
README.md
11.2 kB
29b816f28a40dcfdf5943d6bf4f1f26e07a6b3bbe1ed1d8a034a1ecb56037306
3 months ago
