Hugging Face's logo

neuralmagic
/
Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation
Transformers
Safetensors
llama
int4
vllm
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
2
Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Commit History

Update README.md
41b1c47
verified

nm-research commited on

Update README.md
a7c0994
verified

alexmarques commited on

Update README.md
b8dfdce
verified

alexmarques commited on

Update README.md
72eb322
verified

alexmarques commited on

Update README.md
153436a
verified

alexmarques commited on

Update README.md
764531e
verified

alexmarques commited on

Update README.md
5b554e0
verified

alexmarques commited on

Upload tokenizer.json with huggingface_hub
1455f0f
verified

alexmarques commited on

Update README.md
8f210e8
verified

alexmarques commited on

Update README.md
ee2cc51
verified

alexmarques commited on

Upload tokenizer_config.json with huggingface_hub
2886071
verified

alexmarques commited on

Update README.md
45a8720
verified

alexmarques commited on

Update README.md
8ecfb5a
verified

alexmarques commited on

Upload folder using huggingface_hub
46cdbb6
verified

alexmarques commited on

Update README.md
c8857c0
verified

alexmarques commited on

Update README.md
0dbc179
verified

abhinavnmagic commited on

Update README.md
34fbd4c
verified

alexmarques commited on

Create README.md
14bf365
verified

abhinavnmagic commited on

Upload folder using huggingface_hub
822ee82
verified

abhinavnmagic commited on

initial commit
e838ba6
verified

abhinavnmagic commited on