AQLM+PV
Collection
Official AQLM quantizations for "PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression": https://arxiv.org/abs/2405.14852
•
25 items
•
Updated
•
19
Vladimir
galqiwi
AI & ML interests
None yet
Recent Activity
updated
a model
17 days ago
ISTA-DASLab/Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16
updated
a model
22 days ago
galqiwi/llama-3.1-aqlm-pv-2x8-f32-int8-and-nf4-emb
New activity
22 days ago
ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16:Need example of model usage
Organizations
