Efficient-ML
/

LLaMA-3-8B-SmoothQuant-8bit-8bit

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

I am wondering if the pretrained weights uploaded here is actually int8

#1

by jpyo0803 - opened Jul 23

Jul 23

I think what is uploaded here is float16?

Thanks in advance!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment