Article
A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes
•
75
Bal Narendra Sapa
bnsapa
AI & ML interests
None yet
Recent Activity
liked
a model
about 1 month ago
deepseek-ai/DeepSeek-R1-Distill-Qwen-32B
liked
a model
about 1 month ago
deepseek-ai/Janus-Pro-7B
liked
a model
about 1 month ago
deepseek-ai/DeepSeek-V3
Organizations
None yet
bnsapa's activity
upvoted
3
articles
7 months ago
Article
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
•
123
Article
Llama 3.1 - 405B, 70B & 8B with multilinguality and long context
•
228