16 6 187

Sourab Mangrulkar

smangrul

https://www.linkedin.com/in/sourab-m/

pacman100

AI & ML interests

Machine Learning, Deep Learning, Natural Language Processing, Natural Language Generation, Computer Vision, Reinforcement Learning

Recent Activity

liked a model 19 days ago

meta-llama/Llama-3.2-11B-Vision-Instruct

updated a Space about 1 month ago

smangrul/PEFT-Docs-QA-Chatbot

View all activity

Articles

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

May 24, 2023

• 100

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Mar 9, 2023

• 34

🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware

Feb 10, 2023

• 44

Accelerate Large Model Training using DeepSpeed

Jun 28, 2022

• 3

Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel

May 2, 2022

• 2

Organizations

smangrul's activity

upvoted a collection 6 months ago

Phi-3

Collection

Phi-3 family of small language and multi-modal models. Language models are available in short- and long-context lengths. • 26 items • Updated Nov 14 • 534

upvoted 3 articles 8 months ago

Article

Welcome Llama 3 - Meta's new open LLM

Apr 18

• 281

Article

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

Apr 15

• 170

Article

DS-MoE: Making MoE Models More Efficient and Less Memory-Intensive

•

Apr 9

• 29

upvoted a collection 8 months ago

Meta Llama 3

Collection

This collection hosts the transformers and original repos of the Meta Llama 3 and Llama Guard 2 releases • 5 items • Updated 16 days ago • 695

upvoted a collection about 1 year ago

PEFT papers

Collection

A collection of methods that have been implemented in the 🤗 PEFT library • 12 items • Updated Jan 30 • 23

Sourab Mangrulkar

AI & ML interests

Recent Activity

Articles

GaLore: Advancing Large Model Training on Consumer-grade Hardware

🤗 PEFT welcomes new merging methods

Mixture of Experts Explained

Personal Copilot: Train Your Own Coding Assistant

Fine-tuning Llama 2 70B using PyTorch FSDP

The Falcon has landed in the Hugging Face ecosystem

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware

Accelerate Large Model Training using DeepSpeed

Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel

Organizations

smangrul's activity

Welcome Llama 3 - Meta's new open LLM

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

DS-MoE: Making MoE Models More Efficient and Less Memory-Intensive