Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Qwen
/
Qwen2.5-0.5B-Instruct-GGUF
like
26
Follow
Qwen
7k
Text Generation
GGUF
English
chat
Inference Endpoints
conversational
arxiv:
2407.10671
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
872f8a9
Qwen2.5-0.5B-Instruct-GGUF
2 contributors
History:
3 commits
feihu.hf
update config.json
872f8a9
3 months ago
.gitattributes
Safe
1.56 kB
upload weights
3 months ago
LICENSE
Safe
11.3 kB
update README & LICENSE
3 months ago
README.md
Safe
5.49 kB
update config.json
3 months ago
qwen2.5-0.5b-instruct-q2_k.gguf
Safe
415 MB
LFS
upload weights
3 months ago
qwen2.5-0.5b-instruct-q3_k_m.gguf
Safe
432 MB
LFS
upload weights
3 months ago
qwen2.5-0.5b-instruct-q4_0.gguf
Safe
429 MB
LFS
upload weights
3 months ago
qwen2.5-0.5b-instruct-q4_k_m.gguf
Safe
491 MB
LFS
upload weights
3 months ago
qwen2.5-0.5b-instruct-q5_0.gguf
Safe
490 MB
LFS
upload weights
3 months ago
qwen2.5-0.5b-instruct-q5_k_m.gguf
Safe
522 MB
LFS
upload weights
3 months ago
qwen2.5-0.5b-instruct-q6_k.gguf
Safe
650 MB
LFS
upload weights
3 months ago
qwen2.5-0.5b-instruct-q8_0.gguf
Safe
676 MB
LFS
upload weights
3 months ago
