Hugging Face's logo

abwabai
/
madlad400-3b-mt-8bit

Text2Text Generation
Transformers
Safetensors
t5
text-generation-inference
Inference Endpoints
8-bit precision
bitsandbytes
Model card Files Community
Edit model card

Model Card for madlad400-3b-mt-8bit

馃毃 This model is a 8-bit quantized version of Google's madlad400-3b-mt using bitsandbytes. You can find the unquantized version of madlad400-3b-mt here.

Downloads last month
3
Safetensors
Model size
2.94B params
Tensor type
F32
路
FP16
路
I8
路
Inference Examples
Text2Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.