zhenxuan
/

llava-v1.6-mistral-7b-awq

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

llava-v1.6-mistral-7b-awq / README.md

zhenxuan's picture

Update README.md

849ab0c verified 30 days ago

|

raw history blame contribute delete

No virus

171 Bytes

metadata

license: apache-2.0

The model is quantized using https://github.com/WanBenLe/AutoAWQ-with-llava-v1.6.git

The source model is llava-hf/llava-v1.6-mistral-7b-hf