Hugging Face's logo

hugging-quants
/
Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation
Transformers
Safetensors
llama
llama-3.1
meta
autoawq
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community
21
Meta-Llama-3.1-405B-Instruct-AWQ-INT4
  • 7 contributors
 History: 51 commits
AshtonIsNotHere's picture
AshtonIsNotHere
Fix eos_token and model_max_length in tokenizer_config
265cf09 verified