afg1
/

llama3.1-70b

Inference Endpoints

Model card Files Files and versions Community

1 contributor

History: 7 commits

afg1's picture

Upload llama3.1-70B-Q6_K-00001-of-00002.gguf with huggingface_hub

1f01505 verified 6 months ago

.gitattributes

1.93 kB

Upload llama3.1-70B-Q6_K-00001-of-00002.gguf with huggingface_hub 6 months ago
llama3.1-70B-F16-00001-of-00003.gguf

49.9 GB
LFS

Upload llama3.1-70B-F16-00001-of-00003.gguf with huggingface_hub 6 months ago
llama3.1-70B-F16-00002-of-00003.gguf

49.8 GB
LFS

Upload llama3.1-70B-F16-00002-of-00003.gguf with huggingface_hub 6 months ago
llama3.1-70B-F16-00003-of-00003.gguf

41.5 GB
LFS

Upload llama3.1-70B-F16-00003-of-00003.gguf with huggingface_hub 6 months ago
llama3.1-70B-Q2_K.gguf

26.4 GB
LFS

Upload llama3.1-70B-Q2_K.gguf with huggingface_hub 6 months ago
llama3.1-70B-Q4_K_M.gguf

42.5 GB
LFS

Upload llama3.1-70B-Q4_K_M.gguf with huggingface_hub 6 months ago
llama3.1-70B-Q6_K-00001-of-00002.gguf

29.8 GB
LFS

Upload llama3.1-70B-Q6_K-00001-of-00002.gguf with huggingface_hub 6 months ago