mrhendrey
/

Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Llama-3.1-8B-Instruct-quantized.w8a8 / model-00002-of-00002.safetensors

mrhendrey's picture

Upload LlamaForCausalLM

d4e9d8b verified 14 days ago

4.08 GB

This file is stored with Git LFS . It is too big to display, but you can still download it.

Git LFS Details

SHA256: c71be3926ac4794b519558333effe84412650921dba1b0187dbce2cd3995b532
Pointer size: 135 Bytes
Size of remote file: 4.08 GB

Raw pointer file

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.