Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Qwen
/
Qwen2.5-7B-Instruct-GGUF
like
36
Follow
Qwen
3,700
Text Generation
GGUF
English
chat
Inference Endpoints
conversational
arxiv:
2407.10671
License:
apache-2.0
Model card
Files
Files and versions
Community
2
Deploy
Use this model
74ef91e
Qwen2.5-7B-Instruct-GGUF
2 contributors
History:
3 commits
jklj077
Update README.md
74ef91e
verified
2 months ago
.gitattributes
Safe
1.56 kB
upload weights
2 months ago
LICENSE
Safe
11.3 kB
update README & LICENSE
2 months ago
README.md
Safe
5.63 kB
Update README.md
2 months ago
qwen2.5-7b-instruct-q2_k.gguf
Safe
3.02 GB
LFS
upload weights
2 months ago
qwen2.5-7b-instruct-q3_k_m.gguf
Safe
3.81 GB
LFS
upload weights
2 months ago
qwen2.5-7b-instruct-q4_0-00001-of-00002.gguf
Safe
3.98 GB
LFS
upload weights
2 months ago
qwen2.5-7b-instruct-q4_0-00002-of-00002.gguf
Safe
448 MB
LFS
upload weights
2 months ago
qwen2.5-7b-instruct-q4_k_m-00001-of-00002.gguf
Safe
3.99 GB
LFS
upload weights
2 months ago
qwen2.5-7b-instruct-q4_k_m-00002-of-00002.gguf
Safe
690 MB
LFS
upload weights
2 months ago
qwen2.5-7b-instruct-q5_0-00001-of-00002.gguf
Safe
4 GB
LFS
upload weights
2 months ago
qwen2.5-7b-instruct-q5_0-00002-of-00002.gguf
Safe
1.31 GB
LFS
upload weights
2 months ago
qwen2.5-7b-instruct-q5_k_m-00001-of-00002.gguf
Safe
3.99 GB
LFS
upload weights
2 months ago
qwen2.5-7b-instruct-q5_k_m-00002-of-00002.gguf
Safe
1.45 GB
LFS
upload weights
2 months ago
qwen2.5-7b-instruct-q6_k-00001-of-00002.gguf
Safe
3.95 GB
LFS
upload weights
2 months ago
qwen2.5-7b-instruct-q6_k-00002-of-00002.gguf
Safe
2.3 GB
LFS
upload weights
2 months ago
qwen2.5-7b-instruct-q8_0-00001-of-00003.gguf
Safe
3.98 GB
LFS
upload weights
2 months ago
qwen2.5-7b-instruct-q8_0-00002-of-00003.gguf
Safe
3.94 GB
LFS
upload weights
2 months ago
qwen2.5-7b-instruct-q8_0-00003-of-00003.gguf
Safe
176 MB
LFS
upload weights
2 months ago
