mlx-community
/

Meta-Llama-3.1-405B-Instruct-8bit

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Meta-Llama-3.1-405B-Instruct-8bit

1 contributor

History: 10 commits

IntuitIntel's picture

703576ceb5f5dc386da89ec6a744297b1b5398840f32e65311f257fd8316425d

68fbf3d verified 19 days ago

.gitattributes

1.52 kB

initial commit 19 days ago
README.md

29 Bytes

initial commit 19 days ago
model-00001-of-00085.safetensors

4.69 GB
LFS

a4400452ee8421a1c3a5ee15d7875c52938caf35644b3e0f1aee117e37de0a91 19 days ago
model-00002-of-00085.safetensors

4.92 GB
LFS

cf05e1eb4ae76d45cabb5144f8bb8115d66002727e99bb3deb23662ca0950f35 19 days ago
model-00003-of-00085.safetensors

5.24 GB
LFS

d1b0b3305937d6287a328f8419c64e2ae8e7011886568b89a09e389063657ac6 19 days ago
model-00004-of-00085.safetensors

4.92 GB
LFS

e105b79835520804cb0a3d4761afe0ebcbb69bc0a3e2d9ef9bff520d113f6517 19 days ago
model-00005-of-00085.safetensors

5.24 GB
LFS

5b628a58a2fe9f210f07369df690cdf8ce61038527572b534db6b2ed26392617 19 days ago
model-00006-of-00085.safetensors

4.92 GB
LFS

c4d3d3da789d4d89ecf92ac30867f057968b6c3ecfe1d731d6a0304d78f93432 19 days ago
model-00007-of-00085.safetensors

5.24 GB
LFS

6b6479c34e0f4f7cec79c36187e0205999742e700c8eb9e4e58c42a3a081cbc1 19 days ago
model-00008-of-00085.safetensors

4.92 GB
LFS

200a601acd80fcba73c8d71142d9e10831540fbf4aba1cc6bcb722c09a6f5cd7 19 days ago
model-00009-of-00085.safetensors

5.24 GB
LFS

703576ceb5f5dc386da89ec6a744297b1b5398840f32e65311f257fd8316425d 19 days ago