Hugging Face's logo

neuralmagic
/
Meta-Llama-3-70B-Instruct-FP8

Text Generation
Transformers
Safetensors
English
llama
fp8
vllm
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
3
New discussion

How to run Meta-Llama-3-70B-Instruct-FP8 using several devices?

5
#3 opened 5 months ago by Fertel