mradermacher
/

CantoneseLLMChat-v0.5-GGUF

Inference Endpoints

Model card Files Files and versions Community

CantoneseLLMChat-v0.5-GGUF

1 contributor

History: 21 commits

mradermacher's picture

auto-patch README.md

628cf79 verified 4 months ago

.gitattributes

2.56 kB

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.IQ3_M.gguf

2.82 GB
LFS

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.IQ3_S.gguf

2.72 GB
LFS

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.IQ3_XS.gguf

2.59 GB
LFS

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.IQ4_XS.gguf

3.34 GB
LFS

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.Q2_K.gguf

2.34 GB
LFS

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.Q3_K_L.gguf

3.24 GB
LFS

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.Q3_K_M.gguf

3 GB
LFS

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.Q3_K_S.gguf

2.71 GB
LFS

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.Q4_K_M.gguf

3.68 GB
LFS

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.Q4_K_S.gguf

3.51 GB
LFS

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.Q5_K_M.gguf

4.31 GB
LFS

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.Q5_K_S.gguf

4.21 GB
LFS

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.Q6_K.gguf

4.98 GB
LFS

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.Q8_0.gguf

6.45 GB
LFS

uploaded from nethype/db1 4 months ago
CantoneseLLMChat-v0.5.f16.gguf

12.1 GB
LFS

uploaded from nethype/db1 4 months ago
README.md

3.89 kB

auto-patch README.md 4 months ago