Quantizing Large Language Models for Code Generation: A Differentiated Replication
Paper
•
2503.07103
•
Published
•
6
Quantization for Code Generation
Collection of AQLM quantized models from the paper "Quantizing Large Language Models for Code Generation: A Differentiated Replication"
-
-
Devy1/CodeLlama-7b-hf-AQLM-8bit-rnd-4x15
Text Generation • Updated • 8 -
Devy1/CodeLlama-7b-hf-AQLM-4bit-rnd-2x15
Text Generation • Updated • 9 -
Devy1/CodeLlama-7b-hf-AQLM-3bit-rnd-2x12
Text Generation • Updated • 10 -
Devy1/CodeLlama-7b-hf-AQLM-3bit-rnd-finetuned-2x12
Text Generation • Updated • 7 -
Devy1/CodeLlama-7b-hf-AQLM-2bit-rnd-1x15
Text Generation • Updated • 7 -
Devy1/CodeLlama-7b-hf-AQLM-2bit-rnd-finetuned-1x15
Text Generation • Updated • 7 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-8bit-rnd-4x15
Text Generation • Updated • 11 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-4bit-rnd-2x15
Text Generation • Updated • 8 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-rnd-2x12
Text Generation • Updated • 12 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-rnd-finetuned-2x12
Text Generation • Updated • 8 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-rnd-1x15
Text Generation • Updated • 12 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-rnd-finetuned-1x15
Text Generation • Updated • 11 -
Devy1/CodeLlama-7b-hf-AQLM-8bit-mixed-4x15
Text Generation • Updated • 10 -
Devy1/CodeLlama-7b-hf-AQLM-8bit-code-4x15
Text Generation • Updated • 9 -
Devy1/CodeLlama-7b-hf-AQLM-4bit-mixed-2x15
Text Generation • Updated • 9 -
Devy1/CodeLlama-7b-hf-AQLM-4bit-code-2x15
Text Generation • Updated • 7 -
Devy1/CodeLlama-7b-hf-AQLM-3bit-mixed-2x12
Text Generation • Updated • 5 -
Devy1/CodeLlama-7b-hf-AQLM-3bit-mixed-finetuned-2x12
Text Generation • Updated • 8 -
Devy1/CodeLlama-7b-hf-AQLM-3bit-code-2x12
Text Generation • Updated • 7 -
Devy1/CodeLlama-7b-hf-AQLM-3bit-code-finetuned-2x12
Text Generation • Updated • 13 -
Devy1/CodeLlama-7b-hf-AQLM-2bit-code-1x15
Text Generation • Updated • 9 -
Devy1/CodeLlama-7b-hf-AQLM-2bit-code-finetuned-1x15
Text Generation • Updated • 6 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-8bit-mixed-4x15
Text Generation • Updated • 9 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-8bit-code-4x15
Text Generation • Updated • 7 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-4bit-mixed-2x15
Text Generation • Updated • 9 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-4bit-code-2x15
Text Generation • Updated • 11 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-mixed-2x12
Text Generation • Updated • 4 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-mixed-finetuned-2x12
Text Generation • Updated • 8 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-code-2x12
Text Generation • Updated • 12 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-code-finetuned-2x12
Text Generation • Updated • 7 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-code-1x15
Text Generation • Updated • 6 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-code-finetuned-1x15
Text Generation • Updated • 5 -
Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-1x15
Text Generation • Updated • 10 -
Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-finetuned-1x15
Text Generation • Updated • 8 -
Devy1/CodeLlama-13b-hf-AQLM-2bit-mixed-1x15
Text Generation • Updated • 7 -
Devy1/CodeLlama-13b-hf-AQLM-2bit-mixed-finetuned-1x15
Text Generation • Updated • 9 -
Devy1/CodeLlama-34b-hf-AQLM-2bit-mixed-1x15
Text Generation • Updated • 10 -
Devy1/CodeLlama-34b-hf-AQLM-2bit-mixed-finetuned-1x15
Text Generation • Updated • 8 -
Devy1/DeepSeek-Coder-1.3b-base-AQLM-2bit-mixed-1x14
Text Generation • Updated • 8 -
Devy1/DeepSeek-Coder-1.3b-base-AQLM-2bit-mixed-finetuned-1x14
Text Generation • Updated • 34 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-mixed-1x15
Text Generation • Updated • 11 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-mixed-finetuned-1x15
Text Generation • Updated • 11 -
Devy1/DeepSeek-Coder-33b-base-AQLM-2bit-mixed-1x15
Text Generation • Updated • 11 -
Devy1/DeepSeek-Coder-33b-base-AQLM-2bit-mixed-finetuned-1x15
Text Generation • Updated • 12