Shiv Kumar

Shivkumar27

AI & ML interests

None yet

Recent Activity

new activity 26 days ago

Qwen/Qwen2.5-72B-Instruct:Inference API Body Structure

replied to dhuynh95's post 7 months ago

🌊 Released #LaVague, fullly open-source AI pipeline to turn natural language into browser actions! In less than 150 lines of code (RAG with local embedding + Zephyr-7b-Gemma locally or Mixtral on HF Inference API), it generates #Selenium code from user query. In this GIF you can see it follow user instructions to command a browser to browse HF website! Try it on Colab: colab.research.google.com/github/dhuynh95/LaVague/blob/main/LaVague.ipynb GitHub: github.com/dhuynh95/LaVague Pretty exciting how it becomes possible to create an AI assistant that could perform actions for us, such as logging on gov accounts, fill forms, or pull personal information! It was quite fun to hack in the weekend using open-source tools, from @huggingface local embedding with transformers for local inference or HF Inference API, to RAG with @llama_index, through @MistralAI Mixtral model! Some challenges: to make it run on Colab for the #GPU Poors, I first resorted to @huggingface Inference API with Mixtral as it was the only model good enough (gemma-7b did not make it and refused to produce code). But after some experimentations, I managed to make it work a local Zephyr-7b-Gemma so that people could run this assistant fully locally! Because I used an off-the-shelf model, I had to improve performance with few-shot learning and Chain Of Thought, which managed to generate appropriate code! I hope this project will herald a new dawn where transparent, private and local AI assistants help automate menial but critical tasks, such as helping fill taxes, book accomodation, or research information for us.

new activity 7 months ago

google/gemma-2b-it:Inference API Parameters

View all activity

Organizations

None yet

Shivkumar27's activity

New activity in Qwen/Qwen2.5-72B-Instruct 26 days ago

Inference API Body Structure

#28 opened 28 days ago by

Shivkumar27

replied to dhuynh95's post 7 months ago

Hi @dhuynh95 ,
I tried opening the google colab notebook link but it is saying that notebook not found.
Can you please provide me the updated link for this. It would be really helpful.

Thanks & Regards,
Shiv Kumar

New activity in google/gemma-2b-it 7 months ago

Inference API Parameters

#47 opened 7 months ago by

Shivkumar27

New activity in mistralai/Mistral-7B-Instruct-v0.2 10 months ago

Inference API

#65 opened 10 months ago by

Shivkumar27

New activity in Omnibus/google-gemma 10 months ago

Inference API

#3 opened 10 months ago by

Shivkumar27