Nicola Procopio

nickprock

AI & ML interests

Digital Health Semantic Search - Vector Search

Recent Activity

Organizations

fastai X Hugging Face Group 2022's profile picture EuroPython 2022's profile picture

nickprock's activity

reacted to merve's post with ❀️ 11 days ago
view post
Post
3834
there's a new multimodal retrieval model in town 🀠
LlamaIndex released vdr-2b-multi-v1
> uses 70% less image tokens, yet outperforming other dse-qwen2 based models
> 3x faster inference with less VRAM πŸ’¨
> shrinkable with matryoshka πŸͺ†
> can do cross-lingual retrieval!
Collection: llamaindex/visual-document-retrieval-678151d19d2758f78ce910e1 (with models and datasets)
Demo: llamaindex/multimodal_vdr_demo
Learn more from their blog post here https://huggingface.co/blog/vdr-2b-multilingual πŸ“–
reacted to anakin87's post with πŸ”₯ 7 months ago
view post
Post
1649
🌌 Creating adventures with local LLMs

What if πŸ€”... Homer Simpson met Spider-Man and they went on a quest for donuts? 🍩
Or if Fred Astaire and Corporal Hicks teamed up to fight xenomorphs? πŸ‘Ύ

In the words of Karpathy, LLMs are dream machines...
they seem specially made to simulate these wild scenarios!

π„π±π©πžπ«π’π¦πžπ§π­π’π§π  𝐰𝐒𝐭𝐑 𝐭𝐑𝐒𝐬 𝐒𝐝𝐞𝐚 πŸ‘‡
Nous Research / @teknium recently released NousResearch/CharacterCodex:
a massive dataset with information on 16k characters, both fictional and real.
I couldn't wait to play it...

After a few attempts, I found that combining the information in this dataset with a good model (like meta-llama/Meta-Llama-3-8B-Instruct) opens the doors to a myriad of chat adventures.

πŸ› οΈ Stack:
πŸ”ΉHaystack for orchestration πŸ—οΈ
πŸ”Ήllamafile πŸ¦™πŸ—‚οΈ to run our model locally.

πŸ““ Check out the notebook: https://t.ly/y6jrZ
(includes a bonus πŸ•΅οΈ Mystery Character Quiz)