Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2.5-3B-RP-Mix-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
Qwen2.5-3B-RP-Mix-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
0e91e4aaf3562fa5676cb3aee6b3c539999d2cd3a0ef9410c4afee31c03fd266
8089ea0
verified
2 months ago
.gitattributes
Safe
1.91 kB
0e91e4aaf3562fa5676cb3aee6b3c539999d2cd3a0ef9410c4afee31c03fd266
2 months ago
Qwen2.5-3B-RP-Mix-GGUF_imatrix.dat
3.36 MB
LFS
0e91e4aaf3562fa5676cb3aee6b3c539999d2cd3a0ef9410c4afee31c03fd266
2 months ago
Qwen2.5-3B-RP-Mix.Q5_K_M.gguf
Safe
2.44 GB
LFS
a90f6d28a391d22966054858694526a4fdd663aaf516c8db8cb041fbb715afd1
2 months ago
Qwen2.5-3B-RP-Mix.Q5_K_S.gguf
Safe
2.38 GB
LFS
554055e0e99a3042edec49c599dc4dcac79c25783a26e6c424bf0df58989793e
2 months ago
Qwen2.5-3B-RP-Mix.Q6_K.gguf
Safe
2.79 GB
LFS
d2de47dfad5cf789370b1fcf9af8e5ae0af04f5876b7d41d1707a77753164bed
2 months ago
Qwen2.5-3B-RP-Mix.Q8_0.gguf
Safe
3.62 GB
LFS
e59d08a32b667e65b0f3787bf9e2fb35d9a39fadbee0e9dbbd38ca45d960e316
2 months ago
Qwen2.5-3B-RP-Mix.fp16.gguf
Safe
6.8 GB
LFS
dad9f9dcfc3516ca7098589c468a62eb300486bfbc87f507b3191aa14f11a382
2 months ago
README.md
Safe
2.96 kB
0e91e4aaf3562fa5676cb3aee6b3c539999d2cd3a0ef9410c4afee31c03fd266
2 months ago
