gabrielmbmb
/

Genstruct-7B-AWQ

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Edit model card

Genstruct 7B - AWQ

This is a quantized version of NousResearch/Genstruct-7B built using AutoAWQ. For more information, please refer to the original model repo.

Downloads last month: 6

Safetensors

Model size

1.2B params

Tensor type

I32

·

FP16

·

Quantized from