PrunaAI
/

Meta-Llama-3-70B-GGUF-smashed

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3-70B-GGUF-smashed

2 contributors

History: 11 commits

johnrachwanpruna's picture

johnrachwanpruna

Upload Meta-Llama-3-70B.Q5_K_M.gguf with huggingface_hub

e924c5f verified 5 months ago

.gitattributes

2.24 kB

Upload Meta-Llama-3-70B.Q5_K_M.gguf with huggingface_hub 5 months ago
Meta-Llama-3-70B.IQ3_S.gguf
30.9 GB
LFS

Upload Meta-Llama-3-70B.IQ3_S.gguf with huggingface_hub 5 months ago
Meta-Llama-3-70B.IQ4_NL.gguf
40.3 GB
LFS

Upload Meta-Llama-3-70B.IQ4_NL.gguf with huggingface_hub 5 months ago
Meta-Llama-3-70B.Q3_K_L.gguf
37.1 GB
LFS

Upload Meta-Llama-3-70B.Q3_K_L.gguf with huggingface_hub 5 months ago
Meta-Llama-3-70B.Q4_0.gguf
40 GB
LFS

Upload Meta-Llama-3-70B.Q4_0.gguf with huggingface_hub 5 months ago
Meta-Llama-3-70B.Q4_K_M.gguf
42.5 GB
LFS

Upload Meta-Llama-3-70B.Q4_K_M.gguf with huggingface_hub 5 months ago
Meta-Llama-3-70B.Q5_K_M.gguf
50 GB
LFS

Upload Meta-Llama-3-70B.Q5_K_M.gguf with huggingface_hub 5 months ago
Meta-Llama-3-70B.Q8_0.gguf-00001-of-00006.gguf
13.9 GB
LFS

Upload Meta-Llama-3-70B.Q8_0.gguf-00001-of-00006.gguf with huggingface_hub 5 months ago
Meta-Llama-3-70B.Q8_0.gguf-00002-of-00006.gguf
13.2 GB
LFS

Upload Meta-Llama-3-70B.Q8_0.gguf-00002-of-00006.gguf with huggingface_hub 5 months ago
Meta-Llama-3-70B.fp16.bin-00003-of-00006.gguf
24.4 GB
LFS

Upload Meta-Llama-3-70B.fp16.bin-00003-of-00006.gguf with huggingface_hub 5 months ago
Meta-Llama-3-70B.fp16.bin-00005-of-00006.gguf
24.1 GB
LFS

Upload Meta-Llama-3-70B.fp16.bin-00005-of-00006.gguf with huggingface_hub 5 months ago