neopolita
/

rakutenai-7b-chat-gguf

Inference Endpoints

Model card Files Files and versions Community

rakutenai-7b-chat-gguf

1 contributor

History: 8 commits

neopolita's picture

Upload rakutenai-7b-chat_q8_0.gguf with huggingface_hub

5910a50 verified 7 months ago

.gitattributes

1.91 kB

Upload rakutenai-7b-chat_q8_0.gguf with huggingface_hub 7 months ago
README.md

1.42 kB

Upload README.md with huggingface_hub 7 months ago
rakutenai-7b-chat_q2_k.gguf

2.79 GB
LFS

Upload rakutenai-7b-chat_q2_k.gguf with huggingface_hub 7 months ago
rakutenai-7b-chat_q3_k_m.gguf

3.6 GB
LFS

Upload rakutenai-7b-chat_q3_k_m.gguf with huggingface_hub 7 months ago
rakutenai-7b-chat_q4_k_m.gguf

4.46 GB
LFS

Upload rakutenai-7b-chat_q4_k_m.gguf with huggingface_hub 7 months ago
rakutenai-7b-chat_q5_k_m.gguf

5.23 GB
LFS

Upload rakutenai-7b-chat_q5_k_m.gguf with huggingface_hub 7 months ago
rakutenai-7b-chat_q6_k.gguf

6.05 GB
LFS

Upload rakutenai-7b-chat_q6_k.gguf with huggingface_hub 7 months ago
rakutenai-7b-chat_q8_0.gguf

7.84 GB
LFS

Upload rakutenai-7b-chat_q8_0.gguf with huggingface_hub 7 months ago