Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
MeliodasT3qm7-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
52120f0
MeliodasT3qm7-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
34a6083c6baf627122743376c15c067b39ce18f7c7b6ab75af5cac8948fce650
52120f0
verified
3 months ago
.gitattributes
2.23 kB
34a6083c6baf627122743376c15c067b39ce18f7c7b6ab75af5cac8948fce650
3 months ago
MeliodasT3qm7-7B.IQ3_XS.gguf
3.02 GB
LFS
24d60c278e0948bdda88d72f0caed74e8f0c102de2d9151dd6fc4a6dd8f80113
3 months ago
MeliodasT3qm7-7B.IQ4_XS.gguf
3.94 GB
LFS
666e68ed1ab89de20f6279dfa35b2bca64d6793b2e8bdbc7e4fb4e1330c4a4a9
3 months ago
MeliodasT3qm7-7B.Q2_K.gguf
2.72 GB
LFS
c7d852fbe76622e99e6e0533170001516f0117a79e0efb6bef4d9e71be67e2bd
3 months ago
MeliodasT3qm7-7B.Q3_K_L.gguf
3.82 GB
LFS
21acc2cffa7aba42b116bb77d1ec263f32b928aba0906258a6259cbc9ab10a22
3 months ago
MeliodasT3qm7-7B.Q3_K_M.gguf
3.52 GB
LFS
27eb148354b110b3ede90c5d5b8ba0a7e6546bc0c085328ac1beb7214a7003c2
3 months ago
MeliodasT3qm7-7B.Q3_K_S.gguf
3.16 GB
LFS
73eb855450b519e4a09f51ec1c54a69202120c8e9c367ea17aef72dc414bb3a2
3 months ago
MeliodasT3qm7-7B.Q4_K_M.gguf
4.37 GB
LFS
0dbb09214f822867c7e7db845d8a12f1de38540b4e35b473cd6b7166c526e780
3 months ago
MeliodasT3qm7-7B.Q4_K_S.gguf
4.14 GB
LFS
327a3a5756e14713ec458ca8a849edc1bba984b77d598858689a6860be30d871
3 months ago
MeliodasT3qm7-7B.Q5_K_M.gguf
5.13 GB
LFS
e3a8a0bb786fbfa8c26390e6749b99d0487120ba2347f2f6e54f876cc6c2853d
3 months ago
MeliodasT3qm7-7B.Q5_K_S.gguf
5 GB
LFS
20d047f2776a144c852115860e273c73f1f0ba0fc67985d837231968afb8b103
3 months ago
MeliodasT3qm7-7B.Q6_K.gguf
5.94 GB
LFS
34a6083c6baf627122743376c15c067b39ce18f7c7b6ab75af5cac8948fce650
3 months ago
