Efficient-ML
/

LLaMA-3-8B-SmoothQuant-8bit-8bit

Text Generation

text-generation-inference

Model card Files Files and versions Community

No model card

Downloads last month: 17

Safetensors

Model size

8.03B params

Tensor type

FP16

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including Efficient-ML/LLaMA-3-8B-SmoothQuant-8bit-8bit

LLaMA3-Quantization

This is the official quantized models collection of “How Good Are Low-bit Quantized LLaMA3 Models? An Empirical Study” • 9 items • Updated Apr 23, 2024 • 4