Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
qwen2.5-7b-cabs-v0.4-i1-GGUF
like
1
Transformers
GGUF
English
Merge
Inference Endpoints
imatrix
conversational
License:
mit
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
da7e6fb
qwen2.5-7b-cabs-v0.4-i1-GGUF
1 contributor
History:
24 commits
mradermacher
uploaded from kaos
da7e6fb
verified
16 days ago
.gitattributes
Safe
3.09 kB
uploaded from kaos
16 days ago
README.md
Safe
234 Bytes
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-IQ1_M.gguf
2.04 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-IQ1_S.gguf
1.9 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-IQ2_M.gguf
2.78 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-IQ2_S.gguf
2.6 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-IQ2_XS.gguf
2.47 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-IQ2_XXS.gguf
2.27 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-IQ3_M.gguf
3.57 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-IQ3_XS.gguf
3.35 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-IQ3_XXS.gguf
3.11 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-IQ4_NL.gguf
4.44 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-IQ4_XS.gguf
4.22 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-Q2_K.gguf
3.02 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-Q2_K_S.gguf
2.83 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-Q3_K_L.gguf
4.09 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-Q3_K_M.gguf
3.81 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-Q3_K_S.gguf
3.49 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-Q4_0.gguf
4.44 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-Q4_K_M.gguf
4.68 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-Q4_K_S.gguf
4.46 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-Q5_K_M.gguf
5.44 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-Q5_K_S.gguf
5.32 GB
LFS
uploaded from kaos
16 days ago
qwen2.5-7b-cabs-v0.4.i1-Q6_K.gguf
6.25 GB
LFS
uploaded from kaos
16 days ago