pmysl
/

c4ai-command-r-plus-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

c4ai-command-r-plus-GGUF / imatrix

1 contributor

History: 17 commits

pmysl's picture

BPE pre-tokenization for IQ4_NL variant

44ff853 5 months ago

command-r-plus-IQ1_M.gguf

25.2 GB
LFS

Add chat template to IQ1_M variant 7 months ago
command-r-plus-IQ1_S.gguf

23.2 GB
LFS

Add chat template to IQ1_S variant 7 months ago
command-r-plus-IQ2_M.gguf

36 GB
LFS

Add chat template to IQ2_M variant 7 months ago
command-r-plus-IQ2_S.gguf

33.3 GB
LFS

Add chat template to IQ2_S variant 7 months ago
command-r-plus-IQ2_XS.gguf

31.6 GB
LFS

Add chat template to IQ2_XS variant 7 months ago
command-r-plus-IQ2_XXS.gguf

28.6 GB
LFS

Add chat template to IQ2_XXS variant 7 months ago
command-r-plus-IQ3_M.gguf

47.7 GB
LFS

Add chat template to IQ3_M variant 7 months ago
command-r-plus-IQ3_S.gguf

46 GB
LFS

Add chat template to IQ3_S variant 7 months ago
command-r-plus-IQ3_XS.gguf

43.6 GB
LFS

Add chat template to IQ3_XS variant 7 months ago
command-r-plus-IQ3_XXS.gguf

40.7 GB
LFS

Add chat template to IQ3_XXS variant 7 months ago
command-r-plus-IQ4_NL-00001-of-00002.gguf

31.8 GB
LFS

BPE pre-tokenization for IQ4_NL variant 5 months ago
command-r-plus-IQ4_NL-00002-of-00002.gguf

27.5 GB
LFS

Add imatrix variants 7 months ago
command-r-plus-IQ4_XS-00001-of-00002.gguf

30.2 GB
LFS

BPE pre-tokenization for IQ4_XS variant 5 months ago
command-r-plus-IQ4_XS-00002-of-00002.gguf

26 GB
LFS

Add imatrix variants 7 months ago
command-r-plus-Q2_K_S.gguf

36.6 GB
LFS

BPE pre-tokenization for Q2_K_S variant 5 months ago
command-r-plus-f16-c2048-groups_merged-imatrix.dat

27.5 MB
LFS

Add imatrix variants 7 months ago