v000000
/

L3-11.5B-DuS-MoonRoot-bnb-4bit

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Edit model card

v000000/L3-11.5B-DuS-MoonRoot-bnb-4bit

This model was converted to 4-bit quantization using bitsandbytes from v000000/L3-11.5B-DuS-MoonRoot. Refer to the original model card for more details on the model.

Downloads last month: 41

Safetensors

Model size

6.45B params

Tensor type

F32

·

FP16

·

U8

·

Quantized from