EfficientQAT (BitBLAS format) - a ChenMnZ Collection

ChenMnZ 's Collections

EfficientQAT(w/o E2E-FT)

EfficientQAT(GPTQ format)

EfficientQAT (BitBLAS format)

EfficientQAT (BitBLAS format)

updated Jul 22

EfficientQAT quantized models with BitBLAS data format.

ChenMnZ/Llama-2-7b-EfficientQAT-w4g128-BitBLAS

Text Generation • Updated Jul 22 • 3
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w4g128-BitBLAS

Text Generation • Updated Jul 22 • 4
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g64-BitBLAS

Text Generation • Updated Jul 22 • 2
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g128-BitBLAS

Text Generation • Updated Jul 22 • 6
ChenMnZ/Llama-3-8b-EfficientQAT-w4g128-BitBLAS

Text Generation • Updated Jul 22 • 5
ChenMnZ/Llama-3-8b-EfficientQAT-w2g64-BitBLAS

Text Generation • Updated Jul 22 • 4
ChenMnZ/Llama-3-8b-EfficientQAT-w2g128-BitBLAS

Text Generation • Updated Jul 22 • 4
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w4g128-BitBLAS

Text Generation • Updated Jul 22 • 2
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g64-BitBLAS

Text Generation • Updated Jul 22 • 3
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g128-BitBLAS

Text Generation • Updated Jul 22 • 6
ChenMnZ/Llama-3-70b-EfficientQAT-w4g128-BitBLAS

Text Generation • Updated Jul 22 • 6
ChenMnZ/Llama-3-70b-EfficientQAT-w2g64-BitBLAS

Text Generation • Updated Jul 22 • 4
ChenMnZ/Llama-3-70b-EfficientQAT-w2g128-BitBLAS

Text Generation • Updated Jul 22 • 4
ChenMnZ/Llama-2-7b-EfficientQAT-w2g64-BitBLAS

Text Generation • Updated Jul 22 • 4
ChenMnZ/Llama-2-7b-EfficientQAT-w2g128-BitBLAS

Text Generation • Updated Jul 22 • 2
ChenMnZ/Llama-2-70b-EfficientQAT-w4g128-BitBLAS

Text Generation • Updated Jul 22 • 2
ChenMnZ/Llama-2-70b-EfficientQAT-w2g128-BitBLAS

Text Generation • Updated Jul 22 • 3
ChenMnZ/Llama-2-13b-EfficientQAT-w4g128-BitBLAS

Text Generation • Updated Jul 22 • 4
ChenMnZ/Llama-2-13b-EfficientQAT-w2g64-BitBLAS

Text Generation • Updated Jul 22 • 2
ChenMnZ/Llama-2-13b-EfficientQAT-w2g128-BitBLAS

Text Generation • Updated Jul 22 • 4