Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
neuralmagic
/
Meta-Llama-3.1-70B-Instruct-FP8
like
32
Follow
Neural Magic
198
Text Generation
Transformers
Safetensors
8 languages
llama
fp8
vllm
conversational
text-generation-inference
Inference Endpoints
compressed-tensors
License:
llama3.1
Model card
Files
Files and versions
Community
4
Train
Deploy
Use this model
d42cb9d
Meta-Llama-3.1-70B-Instruct-FP8
/
generation_config.json
Commit History
Upload folder using huggingface_hub
9f5dfe3
verified
Lin-K76
commited on
Jul 26
Upload folder using huggingface_hub
c1c4b1f
verified
Lin-K76
commited on
Jul 26
Upload folder using huggingface_hub
9c6c7f5
verified
Lin-K76
commited on
Jul 23