Hugging Face's logo

neuralmagic
/
Meta-Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation
Safetensors
llama
int4
vllm
conversational
compressed-tensors
Model card Files Community
4
Meta-Llama-3.1-405B-Instruct-quantized.w4a16
  • 3 contributors
 History: 10 commits
mgoin's picture
mgoin
Updated compression_config to quantization_config
d0c9cb9 verified