MaziyarPanahi
/

Meta-Llama-3.1-8B-GGUF

Text Generation

4-bit precision

8-bit precision

Model card Files Files and versions Community

Meta-Llama-3.1-8B-GGUF

1 contributor

History: 6 commits

MaziyarPanahi's picture

303bc61df766197c4a5ad57955512d201d8117e49ea8fb43e00805cb48624902

1d8041f verified about 2 months ago

.gitattributes

1.84 kB

303bc61df766197c4a5ad57955512d201d8117e49ea8fb43e00805cb48624902 about 2 months ago
Meta-Llama-3.1-8B.Q5_K_M.gguf

5.73 GB
LFS

81ca716b3431c5366a0509641015212d92cf4a1089c7d5a1594d1a21ff1103dd about 2 months ago
Meta-Llama-3.1-8B.Q5_K_S.gguf

5.6 GB
LFS

f418a8107350365fea9be7f315b3a014e4e670731c5cc9a4d04ab787a680eb5a about 2 months ago
Meta-Llama-3.1-8B.Q6_K.gguf

6.6 GB
LFS

b0d59769df8e02d0738c2f99d901e83ecda0ba3c154844f5627918f349d7b46f about 2 months ago
Meta-Llama-3.1-8B.Q8_0.gguf

8.54 GB
LFS

410670ab0148515f794eb44cbd06d2ecc52df21354dcdd251771401b75385559 about 2 months ago
Meta-Llama-3.1-8B.fp16.gguf

16.1 GB
LFS

303bc61df766197c4a5ad57955512d201d8117e49ea8fb43e00805cb48624902 about 2 months ago