neopolita
/

qwen2-7b-instruct-gguf

Inference Endpoints

Model card Files Files and versions Community

qwen2-7b-instruct-gguf

1 contributor

History: 7 commits

neopolita's picture

Upload qwen2-7b-instruct_q5_k_m.gguf with huggingface_hub

bc61626 verified 5 months ago

.gitattributes

1.84 kB

Upload qwen2-7b-instruct_q5_k_m.gguf with huggingface_hub 5 months ago
README.md

1.41 kB

Upload README.md with huggingface_hub 5 months ago
ggml-model-f16.gguf

15.2 GB
LFS

Upload ggml-model-f16.gguf with huggingface_hub 5 months ago
qwen2-7b-instruct_q2_k.gguf

3.02 GB
LFS

Upload qwen2-7b-instruct_q2_k.gguf with huggingface_hub 5 months ago
qwen2-7b-instruct_q3_k_m.gguf

3.81 GB
LFS

Upload qwen2-7b-instruct_q3_k_m.gguf with huggingface_hub 5 months ago
qwen2-7b-instruct_q4_k_m.gguf

4.68 GB
LFS

Upload qwen2-7b-instruct_q4_k_m.gguf with huggingface_hub 5 months ago
qwen2-7b-instruct_q5_k_m.gguf

5.44 GB
LFS

Upload qwen2-7b-instruct_q5_k_m.gguf with huggingface_hub 5 months ago