mradermacher
/

sixtyoneeighty-7b-chat-GGUF

Inference Endpoints

Model card Files Files and versions Community

sixtyoneeighty-7b-chat-GGUF

1 contributor

History: 22 commits

mradermacher's picture

auto-patch README.md

121236d verified 20 days ago

.gitattributes

2.51 kB

uploaded from nethype/leia 9 months ago
README.md

3.75 kB

auto-patch README.md 20 days ago
sixtyoneeighty-7b-chat.IQ3_M.gguf
3.28 GB
LFS

uploaded from nethype/leia 9 months ago
sixtyoneeighty-7b-chat.IQ3_S.gguf
3.18 GB
LFS

uploaded from nethype/leia 9 months ago
sixtyoneeighty-7b-chat.IQ3_XS.gguf
3.02 GB
LFS

uploaded from nethype/leia 9 months ago
sixtyoneeighty-7b-chat.IQ4_XS.gguf
3.94 GB
LFS

uploaded from nethype/leia 9 months ago
sixtyoneeighty-7b-chat.Q2_K.gguf
2.72 GB
LFS

uploaded from nethype/leia 9 months ago
sixtyoneeighty-7b-chat.Q3_K_L.gguf
3.82 GB
LFS

uploaded from nethype/leia 9 months ago
sixtyoneeighty-7b-chat.Q3_K_M.gguf
3.52 GB
LFS

uploaded from nethype/leia 9 months ago
sixtyoneeighty-7b-chat.Q3_K_S.gguf
3.16 GB
LFS

uploaded from nethype/leia 9 months ago
sixtyoneeighty-7b-chat.Q4_K_M.gguf
4.37 GB
LFS

uploaded from nethype/leia 9 months ago
sixtyoneeighty-7b-chat.Q4_K_S.gguf
4.14 GB
LFS

uploaded from nethype/leia 9 months ago
sixtyoneeighty-7b-chat.Q5_K_M.gguf
5.13 GB
LFS

uploaded from nethype/leia 9 months ago
sixtyoneeighty-7b-chat.Q5_K_S.gguf
5 GB
LFS

uploaded from nethype/leia 9 months ago
sixtyoneeighty-7b-chat.Q6_K.gguf
5.94 GB
LFS

uploaded from nethype/leia 9 months ago
sixtyoneeighty-7b-chat.Q8_0.gguf
7.7 GB
LFS

uploaded from nethype/leia 9 months ago