Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
neuralmagic
/
Meta-Llama-3.1-70B-Instruct-FP8
like
32
Follow
Neural Magic
196
Text Generation
Transformers
Safetensors
8 languages
llama
fp8
vllm
conversational
text-generation-inference
Inference Endpoints
compressed-tensors
License:
llama3.1
Model card
Files
Files and versions
Community
4
Train
Deploy
Use this model
08b31c0
Meta-Llama-3.1-70B-Instruct-FP8
Commit History
Updated compression_config to quantization_config
08b31c0
verified
mgoin
commited on
Oct 9
Update README.md
02ba52a
verified
Lin-K76
commited on
Aug 23
Upload folder using huggingface_hub
4b76cb0
verified
Lin-K76
commited on
Aug 22
Update README.md
090502b
verified
alexmarques
commited on
Aug 13
Update README.md
d42cb9d
verified
alexmarques
commited on
Jul 30
Update README.md
df81133
verified
Lin-K76
commited on
Jul 27
Update README.md
9b9e9a8
verified
Lin-K76
commited on
Jul 26
Update README.md
53de35d
verified
Lin-K76
commited on
Jul 26
Upload folder using huggingface_hub
9f5dfe3
verified
Lin-K76
commited on
Jul 26
Upload folder using huggingface_hub
c1c4b1f
verified
Lin-K76
commited on
Jul 26
Update README.md
ff92b7d
verified
Lin-K76
commited on
Jul 25
Update README.md
9e40799
verified
Lin-K76
commited on
Jul 25
Create README.md
62a997c
verified
Lin-K76
commited on
Jul 24
Upload folder using huggingface_hub
9c6c7f5
verified
Lin-K76
commited on
Jul 23
initial commit
3ee5b28
verified
Lin-K76
commited on
Jul 23