c4ai-command-r-plus-GGUF / imatrix

1 contributor

History: 27 commits

pmysl

BPE pre-tokenization for IQ1_M variant

2eaa2b3 9 months ago

command-r-plus-IQ1_M.gguf

25.2 GB
LFS

BPE pre-tokenization for IQ1_M variant 9 months ago
command-r-plus-IQ1_S.gguf

23.2 GB
LFS

BPE pre-tokenization for IQ1_S variant 9 months ago
command-r-plus-IQ2_M.gguf

36 GB
LFS

BPE pre-tokenization for IQ2_M variant 9 months ago
command-r-plus-IQ2_S.gguf

33.3 GB
LFS

BPE pre-tokenization for IQ2_S variant 9 months ago
command-r-plus-IQ2_XS.gguf

31.6 GB
LFS

BPE pre-tokenization for IQ2_XS variant 9 months ago
command-r-plus-IQ2_XXS.gguf

28.6 GB
LFS

BPE pre-tokenization for IQ2_XXS variant 9 months ago
command-r-plus-IQ3_M.gguf

47.7 GB
LFS

BPE pre-tokenization for IQ3_M variant 9 months ago
command-r-plus-IQ3_S.gguf

46 GB
LFS

BPE pre-tokenization for IQ3_S variant 9 months ago
command-r-plus-IQ3_XS.gguf

43.6 GB
LFS

BPE pre-tokenization for IQ3_XS variant 9 months ago
command-r-plus-IQ3_XXS.gguf

40.7 GB
LFS

BPE pre-tokenization for IQ3_XXS variant 9 months ago
command-r-plus-IQ4_NL-00001-of-00002.gguf

31.8 GB
LFS

BPE pre-tokenization for IQ4_NL variant 9 months ago
command-r-plus-IQ4_NL-00002-of-00002.gguf

27.5 GB
LFS

Add imatrix variants 11 months ago
command-r-plus-IQ4_XS-00001-of-00002.gguf

30.2 GB
LFS

BPE pre-tokenization for IQ4_XS variant 9 months ago
command-r-plus-IQ4_XS-00002-of-00002.gguf

26 GB
LFS

Add imatrix variants 11 months ago
command-r-plus-Q2_K_S.gguf

36.6 GB
LFS

BPE pre-tokenization for Q2_K_S variant 9 months ago
command-r-plus-f16-c2048-groups_merged-imatrix.dat

27.5 MB
LFS

Add imatrix variants 11 months ago