ktoprakucar/gte-Qwen2-1.5B-instruct-Q8-GPTQ

This is the 8-bit quantized version of Alibaba-NLP/gte-Qwen2-1.5B-instruct by following the example from the AutoGPTQ repository.

Safetensors

Model size

807M params

Tensor type

I32

FP16

Inference Examples

Inference API (serverless) does not yet support transformers models for this pipeline type.

Model tree for ktoprakucar/gte-Qwen2-1.5B-instruct-Q8-GPTQ

Base model

Quantized

(12)

this model