Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2.5-Coder-7B-Instruct-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
Qwen2.5-Coder-7B-Instruct-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
9115f52adc8c4edf8f45981e5f54e2638277ce34777be90baf3be2a14e22d9be
601bf74
verified
4 months ago
.gitattributes
Safe
1.96 kB
9115f52adc8c4edf8f45981e5f54e2638277ce34777be90baf3be2a14e22d9be
4 months ago
Qwen2.5-Coder-7B-Instruct-GGUF_imatrix.dat
4.54 MB
LFS
9115f52adc8c4edf8f45981e5f54e2638277ce34777be90baf3be2a14e22d9be
4 months ago
Qwen2.5-Coder-7B-Instruct.Q5_K_M.gguf
5.44 GB
LFS
e20ccdda0f4548bb0e81aeb9b207b5b0314b07f0f52f5e6e01cd3ae2782b6156
4 months ago
Qwen2.5-Coder-7B-Instruct.Q5_K_S.gguf
5.32 GB
LFS
17c41d74f21592797e3d5b31a011f1086442c7c896aab6f76a32ce5f13f2766d
4 months ago
Qwen2.5-Coder-7B-Instruct.Q6_K.gguf
6.25 GB
LFS
3b7b77fa829ceb38f65c8b19cc2b837028a7c98f54dd57e0914cf20f7dafe439
4 months ago
Qwen2.5-Coder-7B-Instruct.Q8_0.gguf
8.1 GB
LFS
0b834ed521238e1aeeab5cce5f7f51200359c3475536a35cf8232a3e8d1467f0
4 months ago
Qwen2.5-Coder-7B-Instruct.fp16.gguf
15.2 GB
LFS
eab7a2ba6f88b7eec9ae70f6745e22000c5e49d3dfa082eaab9f111f9bd4050c
4 months ago
README.md
Safe
3 kB
9115f52adc8c4edf8f45981e5f54e2638277ce34777be90baf3be2a14e22d9be
4 months ago
