llmixer
/

Meta-Llama-3-70B-Instruct-8.0bpw-h8-exl2

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Meta-Llama-3-70B-Instruct-8.0bpw-h8-exl2 / output-00006-of-00009.safetensors

Commit History

Re-quant with exllamav2 0.0.19, fixed EOS token ID

4c6717f
verified

llmixer commited on Apr 19

Model upload

7ceba9c
verified

llmixer commited on Apr 18