dranger003
/

bagel-34b-v0.4-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

bagel-34b-v0.4-iMat.GGUF

2 contributors

History: 13 commits

dranger003's picture

Upload ggml-bagel-34b-v0.4-q8_0.gguf

d8e74bb verified 9 months ago

.gitattributes

1.93 kB

Upload ggml-bagel-34b-v0.4-iq2_xs.gguf 9 months ago
README.md

982 Bytes

Update README.md 9 months ago
ggml-bagel-34b-v0.4-iq2_xs.gguf

10.3 GB
LFS

Upload ggml-bagel-34b-v0.4-iq2_xs.gguf 9 months ago
ggml-bagel-34b-v0.4-iq2_xxs.gguf

9.31 GB
LFS

Upload ggml-bagel-34b-v0.4-iq2_xxs.gguf 9 months ago
ggml-bagel-34b-v0.4-iq3_xxs.gguf

13.7 GB
LFS

Upload 4 files 9 months ago
ggml-bagel-34b-v0.4-q4_k_m.gguf

20.7 GB
LFS

Upload 4 files 9 months ago
ggml-bagel-34b-v0.4-q8_0-imatrix.dat

15.3 MB
LFS

Upload 4 files 9 months ago
ggml-bagel-34b-v0.4-q8_0.gguf

36.5 GB
LFS

Upload ggml-bagel-34b-v0.4-q8_0.gguf 9 months ago