README.md

metadata

title: VPTQ demo
emoji: 🚀
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 4.36.1
app_file: app.py
pinned: true
license: mit
short_description: Vector Post-Training Quantization (VPTQ) Demo

An example chatbot using VPTQ, huggingface community.