Hugging Face's logo

neuralmagic
/
Meta-Llama-3.1-8B-Instruct-quantized.w8a16

Text Generation
Transformers
Safetensors
llama
int8
vllm
conversational
text-generation-inference
Inference Endpoints
compressed-tensors
Model card Files Community
3
Meta-Llama-3.1-8B-Instruct-quantized.w8a16

Commit History

Update README.md
38e03ba
verified

alexmarques commited on

Update README.md
9233f20
verified

alexmarques commited on

Updated compression_config to quantization_config
7fa8878
verified

mgoin commited on

Update README.md
dcf5b96
verified

alexmarques commited on

Update README.md
6ef48df
verified

alexmarques commited on

Upload tokenizer.json with huggingface_hub
c265f0f
verified

alexmarques commited on

Update README.md
2eb1501
verified

alexmarques commited on

Upload tokenizer_config.json with huggingface_hub
91597e9
verified

alexmarques commited on

Update README.md
3237147
verified

alexmarques commited on

Update README.md
0586d92
verified

alexmarques commited on

Update README.md
895d636
verified

alexmarques commited on

Update README.md
d635de5
verified

alexmarques commited on

Update README.md
69291a3
verified

alexmarques commited on

Update README.md
caf66fe
verified

alexmarques commited on

Update README.md
3927ba7
verified

alexmarques commited on

Update README.md
0cfcb53
verified

alexmarques commited on

Update README.md
7e4ac27
verified

alexmarques commited on

Update README.md
44b6153
verified

alexmarques commited on

Update README.md
edc122e
verified

alexmarques commited on

Create README.md
8b65aea
verified

alexmarques commited on

Upload folder using huggingface_hub
b892d70
verified

alexmarques commited on

initial commit
c08f05e
verified

alexmarques commited on