neopolita
/

yi-9b-gguf

Inference Endpoints

Model card Files Files and versions Community

1 contributor

History: 13 commits

neopolita's picture

Upload yi-9b_q6_k.gguf with huggingface_hub

2236722 verified 8 months ago

.gitattributes

2.11 kB

Upload yi-9b_q6_k.gguf with huggingface_hub 8 months ago
README.md

1.38 kB

Upload README.md with huggingface_hub 8 months ago
yi-9b_q2_k.gguf

3.35 GB
LFS

Upload yi-9b_q2_k.gguf with huggingface_hub 8 months ago
yi-9b_q3_k_l.gguf

4.69 GB
LFS

Upload yi-9b_q3_k_l.gguf with huggingface_hub 8 months ago
yi-9b_q3_k_m.gguf

4.32 GB
LFS

Upload yi-9b_q3_k_m.gguf with huggingface_hub 8 months ago
yi-9b_q3_k_s.gguf

3.9 GB
LFS

Upload yi-9b_q3_k_s.gguf with huggingface_hub 8 months ago
yi-9b_q4_0.gguf

5.04 GB
LFS

Upload yi-9b_q4_0.gguf with huggingface_hub 8 months ago
yi-9b_q4_k_m.gguf

5.33 GB
LFS

Upload yi-9b_q4_k_m.gguf with huggingface_hub 8 months ago
yi-9b_q4_k_s.gguf

5.07 GB
LFS

Upload yi-9b_q4_k_s.gguf with huggingface_hub 8 months ago
yi-9b_q5_0.gguf

6.11 GB
LFS

Upload yi-9b_q5_0.gguf with huggingface_hub 8 months ago
yi-9b_q5_k_m.gguf

6.26 GB
LFS

Upload yi-9b_q5_k_m.gguf with huggingface_hub 8 months ago
yi-9b_q5_k_s.gguf

6.11 GB
LFS

Upload yi-9b_q5_k_s.gguf with huggingface_hub 8 months ago
yi-9b_q6_k.gguf

7.25 GB
LFS

Upload yi-9b_q6_k.gguf with huggingface_hub 8 months ago