mmnga
/

QwQ-32B-Preview-gguf

Inference Endpoints

Model card Files Files and versions Community

QwQ-32B-Preview-gguf

1 contributor

History: 13 commits

mmnga's picture

Upload QwQ-32B-Preview-IQ3_XXS.gguf with huggingface_hub

405e068 verified about 2 months ago

.gitattributes

2.22 kB

Upload QwQ-32B-Preview-IQ3_XXS.gguf with huggingface_hub about 2 months ago
QwQ-32B-Preview-IQ1_M.gguf

7.93 GB
LFS

Upload QwQ-32B-Preview-IQ1_M.gguf with huggingface_hub about 2 months ago
QwQ-32B-Preview-IQ1_S.gguf

7.27 GB
LFS

Upload QwQ-32B-Preview-IQ1_S.gguf with huggingface_hub about 2 months ago
QwQ-32B-Preview-IQ2_M.gguf

11.3 GB
LFS

Upload QwQ-32B-Preview-IQ2_M.gguf with huggingface_hub about 2 months ago
QwQ-32B-Preview-IQ2_S.gguf

10.4 GB
LFS

Upload QwQ-32B-Preview-IQ2_S.gguf with huggingface_hub about 2 months ago
QwQ-32B-Preview-IQ2_XS.gguf

9.96 GB
LFS

Upload QwQ-32B-Preview-IQ2_XS.gguf with huggingface_hub about 2 months ago
QwQ-32B-Preview-IQ2_XXS.gguf

9.03 GB
LFS

Upload QwQ-32B-Preview-IQ2_XXS.gguf with huggingface_hub about 2 months ago
QwQ-32B-Preview-IQ3_XXS.gguf

12.8 GB
LFS

Upload QwQ-32B-Preview-IQ3_XXS.gguf with huggingface_hub about 2 months ago
QwQ-32B-Preview-IQ4_NL.gguf

18.7 GB
LFS

Upload QwQ-32B-Preview-IQ4_NL.gguf with huggingface_hub about 2 months ago
QwQ-32B-Preview-IQ4_XS.gguf

17.7 GB
LFS

Upload QwQ-32B-Preview-IQ4_XS.gguf with huggingface_hub about 2 months ago
QwQ-32B-Preview-Q4_K_M.gguf

19.9 GB
LFS

Upload QwQ-32B-Preview-Q4_K_M.gguf with huggingface_hub about 2 months ago
QwQ-32B-Preview-Q5_K_M.gguf

23.3 GB
LFS

Upload QwQ-32B-Preview-Q5_K_M.gguf with huggingface_hub about 2 months ago
README.md

657 Bytes

Upload README.md with huggingface_hub about 2 months ago