Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
T3qm7xExperiment28-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
T3qm7xExperiment28-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
d0877e94cedeebb2335747b48b217a3120b22ae3342b0827befe89be18c7f312
45acf1c
verified
8 months ago
.gitattributes
2.29 kB
966452a4f7854c825caabc378b88b73233a31eca244886cea4c4adea29bbb3a7
8 months ago
README.md
11 kB
d0877e94cedeebb2335747b48b217a3120b22ae3342b0827befe89be18c7f312
8 months ago
T3qm7xExperiment28-7B.IQ3_XS.gguf
3.02 GB
LFS
fbe289ee7f171c2f41628e9736e9ebeb7841c6eb8fbaa60fb914a9adb58d9ed4
8 months ago
T3qm7xExperiment28-7B.IQ4_XS.gguf
3.94 GB
LFS
f65749973a1fd0648021ab547a390d651b34c434965691444286ad9b1612682c
8 months ago
T3qm7xExperiment28-7B.Q2_K.gguf
2.72 GB
LFS
4a7630313098185352d905fa2a04de3bac4c6638157f67cbbccbeccb0e54a202
8 months ago
T3qm7xExperiment28-7B.Q3_K_L.gguf
3.82 GB
LFS
d2e738a33dbe66eac642c26c25e04fe80a1763f5a895142de4e988c2222f6012
8 months ago
T3qm7xExperiment28-7B.Q3_K_M.gguf
3.52 GB
LFS
74e3e6162b4b879e65426f13709592c584ebf6a926ca38c43e393c8cfce50fc8
8 months ago
T3qm7xExperiment28-7B.Q3_K_S.gguf
3.16 GB
LFS
f1de5335f912114e869151c11bf96b38a40d3db3c535502fb189d3d0dd5369fc
8 months ago
T3qm7xExperiment28-7B.Q4_K_M.gguf
4.37 GB
LFS
063ece06fd70f55922dd60fca3c75a0e09c2b889d16d76c6646c1ad62c239eae
8 months ago
T3qm7xExperiment28-7B.Q4_K_S.gguf
4.14 GB
LFS
40e7530cad2d22fcac42908d814a84ccd72d354f5bc9570b410907f56b19f306
8 months ago
T3qm7xExperiment28-7B.Q5_K_M.gguf
5.13 GB
LFS
66e44156703c5c813716099911c12bd743db5937304cb13ddb60acbef4bf1e66
8 months ago
T3qm7xExperiment28-7B.Q5_K_S.gguf
5 GB
LFS
0b9e69fb3973b2e5890394364178bac4ced7b5139055400b206591dd990dbe59
8 months ago
T3qm7xExperiment28-7B.Q6_K.gguf
5.94 GB
LFS
966452a4f7854c825caabc378b88b73233a31eca244886cea4c4adea29bbb3a7
8 months ago
