view article Article Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA May 24, 2023 โข 100
view article Article A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes Aug 17, 2022 โข 66
view article Article Introduction to Quantization cooked in ๐ค with ๐๐งโ๐ณ By merve โข Aug 25, 2023 โข 22
view article Article ๐ค PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware Feb 10, 2023 โข 43
view article Article Overview of natively supported quantization schemes in ๐ค Transformers Sep 12, 2023 โข 11