Collection of AQLM quantized models from the paper "Quantizing Large Language Models for Code Generation: A Differentiated Replication"
-
Quantizing Large Language Models for Code Generation: A Differentiated Replication
Paper • 2503.07103 • Published • 6 -
Devy1/CodeLlama-7b-hf-AQLM-8bit-rnd-4x15
Text Generation • Updated • 8 -
Devy1/CodeLlama-7b-hf-AQLM-4bit-rnd-2x15
Text Generation • Updated • 9 -
Devy1/CodeLlama-7b-hf-AQLM-3bit-rnd-2x12
Text Generation • Updated • 10