mahihossain666
/

llama-2-70b-hf-quantized-4bits-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Quantized to 4bit precision using AutoGPTQ

Downloads last month: 9

Safetensors

Model size

9.7B params

Tensor type

I32

·

FP16

·

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.

Dataset used to train mahihossain666/llama-2-70b-hf-quantized-4bits-GPTQ