Model Description

This is a 8bit GPTQ quantization of Llasa-1B by the HKUSTAudio team. I tested using a script written by GitHub user nivibilla, linked below. The tests were successful, and this quantized model produced very decent results.

Model Sources

Downloads last month
96
Safetensors
Model size
650M params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for AgeOfAlgorithms/Llasa-1b-GPTQ-8bit

Quantized
(3)
this model