neopolita
/

qwen2.5-14b-gguf

Inference Endpoints

Model card Files Files and versions Community

qwen2.5-14b-gguf

1 contributor

History: 9 commits

neopolita's picture

Upload qwen2.5-14b_q8_0.gguf with huggingface_hub

82b0c44 verified 4 months ago

.gitattributes

1.93 kB

Upload qwen2.5-14b_q8_0.gguf with huggingface_hub 4 months ago
README.md

1.39 kB

Upload README.md with huggingface_hub 4 months ago
ggml-model-f16.gguf

29.5 GB
LFS

Upload ggml-model-f16.gguf with huggingface_hub 4 months ago
qwen2.5-14b_q2_k.gguf

5.77 GB
LFS

Upload qwen2.5-14b_q2_k.gguf with huggingface_hub 4 months ago
qwen2.5-14b_q3_k_m.gguf
7.34 GB
LFS

Upload qwen2.5-14b_q3_k_m.gguf with huggingface_hub 4 months ago
qwen2.5-14b_q4_k_m.gguf
8.99 GB
LFS

Upload qwen2.5-14b_q4_k_m.gguf with huggingface_hub 4 months ago
qwen2.5-14b_q5_k_m.gguf
10.5 GB
LFS

Upload qwen2.5-14b_q5_k_m.gguf with huggingface_hub 4 months ago
qwen2.5-14b_q6_k.gguf
12.1 GB
LFS

Upload qwen2.5-14b_q6_k.gguf with huggingface_hub 4 months ago
qwen2.5-14b_q8_0.gguf
15.7 GB
LFS

Upload qwen2.5-14b_q8_0.gguf with huggingface_hub 4 months ago