legendhasit
/

falcon-7b-instruct-8bit

Text Generation

RefinedWebModel

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

Method to get 8bit quantized model

#1 opened over 1 year ago by