Sourab Mangrulkar

smangrul's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

liked a model 19 days ago

meta-llama/Llama-3.2-11B-Vision-Instruct

Image-Text-to-Text • Updated 19 days ago • 2.82M • • 1.14k

updated a Space about 1 month ago

Running

10

📚

PEFT Docs QA Chatbot

liked a model 3 months ago

BlinkDL/rwkv-4-pile-169m

Text Generation • Updated Mar 13, 2023 • 10

liked 2 models 4 months ago

meta-llama/Llama-3.1-8B-Instruct

Text Generation • Updated Sep 25 • 4.64M • • 3.31k

microsoft/Phi-3.5-mini-instruct

Text Generation • Updated Sep 18 • 585k • • 707

liked a model 5 months ago

microsoft/Phi-3-mini-128k-instruct

Text Generation • Updated Aug 20 • 778k • 1.62k

liked a model 6 months ago

microsoft/Phi-3-mini-4k-instruct

Text Generation • Updated Sep 20 • 626k • • 1.09k

upvoted a collection 6 months ago

Phi-3

Collection

Phi-3 family of small language and multi-modal models. Language models are available in short- and long-context lengths. • 26 items • Updated Nov 14 • 534

liked a dataset 8 months ago

internlm/Agent-FLAN

Preview • Updated Mar 20 • 102 • 67

liked a Space 8 months ago

Running

88

🐠

Nexus Function Calling Leaderboard

liked a model 8 months ago

gorilla-llm/gorilla-openfunctions-v2

Text Generation • Updated Apr 18 • 600 • 217

liked a dataset 8 months ago

smangrul/hug_stack

Viewer • Updated Feb 2 • 6.58k • 162 • 3

updated a model 8 months ago

smangrul/peft-lora-whisper-largev2-cv11-mr-t4-colab

Updated Apr 23 • 3 • 1

liked a model 8 months ago

smangrul/falcon-180B-chat-asst-ds-lora

Updated Oct 2, 2023 • 2 • 1

posted an update 8 months ago

view post

Post

3291

Unlocking the Power of locally running Llama-3 8B Model Agents with Chat-UI! 🔥🚀✨

I'm thrilled to share my hackathon-style side project:
1. Finetuning Llama-8B for function calling using PEFT QLoRA as the instruct Llama-3 model doesn't support this. The colab notebook for it is here: https://lnkd.in/ggJMzqh2. 🛠️
2. Finetuned model along with the 4-bit quants here: https://lnkd.in/gNpFKY6V ✨
3. Clone Hugging Face https://lnkd.in/gKBKuUBQ and make it compatible for function calling by building upon the PR https://lnkd.in/gnqFuAd4 for my model and local inferencing usecase using Ollama. This was a steep learning curve wherein I stayed awake the whole night to get it working. 💪🏽
4. Above, I used SerpAPI for web browsing and Mongo DB Atlas free tier for persistence of conversations and assistant configs. 🔎
5. More work is required to switch between using tools and responding directly wherein I see the model breaks. 🧐

How cool is this wherein we are approaching experience akin to ChatGPT while using local hosted agent model running on your laptop! 💻

• 
• 1 reply

·

🤯

9

9

🔥

8

8

+

Reply

updated a model 8 months ago

smangrul/llama-3-8B-instruct-function-calling

Updated Apr 21 • 45 • 28

liked a model 8 months ago

smangrul/llama-3-8B-instruct-function-calling

Updated Apr 21 • 45 • 28

upvoted an article 8 months ago

view article

Article

Welcome Llama 3 - Meta's new open LLM

Apr 18

• 281

liked 2 models 8 months ago

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated about 1 month ago • 45.3k • 131

meta-llama/Meta-Llama-3-8B-Instruct

Text Generation • Updated Sep 27 • 1.89M • • 3.71k