Ari Jankelowitz

ajankelo

AI & ML interests

None yet

Recent Activity

liked a model about 2 months ago

reacted to jxm's post with ❤️ about 2 months ago

New state-of-the-art BERT-size retrieval model: *cde-small-v2* 🥳🍾 Hi everyone! We at Cornell are releasing a new retrieval model this week. It uses the contextual embeddings framework, is based on ModernBERT backbone, and gets state-of-the-art results on the MTEB benchmark for its model size (140M parameters). cde-small-v2 gets an average score of 65.6 across the 56 datasets and sees improvements from our previous model in *every* task domain (retrieval, classification, etc.). We made a lot of changes to make this model work. First of all, ModernBERT has a better tokenizer, which probably helped this work out-of-the-box. We also followed the principles from the CDE paper and used harder clusters and better hard-negative filtering, which showed a small performance improvement. And we made a few small changes that have been shown to work on the larger models: we disabled weight decay, masked out the prefix tokens during pooling, and added a residual connection from the first-stage to the second-stage for better gradient flow. We're still looking for a computer sponsor to help us scale CDE to larger models. Since it's now state-of-the-art at the 100M parameter scale, it seems to be a reasonable bet that we could train a state-of-the-art large model if we had the GPUs. If you're interested in helping with this, please reach out! Here's a link to the model: https://huggingface.co/jxm/cde-small-v2 And here's a link to the paper: https://huggingface.co/papers/2410.02525

liked a dataset 3 months ago

zenml/llmops-database

View all activity

Organizations

ajankelo's activity

liked a model about 2 months ago

jxm/cde-small-v2

Feature Extraction • Updated Feb 3 • 3.88k • 78

liked a dataset 3 months ago

zenml/llmops-database

Viewer • Updated 6 days ago • 590 • 1.12k • 18

liked a Space 4 months ago

Gradio Lipsync Wav2lip

👄

Generate lip-synced video from video/image and audio

liked a model 4 months ago

unum-cloud/uform3-image-text-multilingual-base

Feature Extraction • Updated Dec 19, 2024 • 1.11k • 12

liked a Space 5 months ago

2.04k

F5-TTS

🗣

F5-TTS & E2-TTS: Zero-Shot Voice Cloning (Unofficial Demo)

liked a model about 1 year ago

microsoft/phi-2

Text Generation • Updated Apr 29, 2024 • 372k • • 3.29k

liked a model over 1 year ago

Salesforce/instructblip-flan-t5-xl

Image-Text-to-Text • Updated Feb 3 • 16.7k • 29

liked 2 Spaces almost 2 years ago

12.8k

Open LLM Leaderboard

🏆

Track, rank and evaluate open LLMs and chatbots

Sales QA Bot 2

📈

liked a model almost 2 years ago

Salesforce/blip-image-captioning-base

Image-to-Text • Updated Feb 3 • 5.92M • • 647

liked a Space almost 2 years ago

DePlot+LLM (multimodal chain-of-thought reasoning on plots)

🏢

liked a Space about 2 years ago

353

Deep Reinforcement Learning Leaderboard

🚀

liked a model about 2 years ago

EleutherAI/gpt-j-6b

Text Generation • Updated Jun 21, 2023 • 276k • 1.49k

liked a dataset over 2 years ago

GroNLP/ik-nlp-22_winemag

Viewer • Updated Feb 13, 2022 • 80.5k • 390 • 6

liked a model over 2 years ago

sentence-transformers/clip-ViT-B-32

liked 2 Spaces over 2 years ago

OFA

🌍

Zero Shot Image Classification

💻

liked a model over 2 years ago

hoaiht/CLIP-ViT-H-14-laion2B-s32B-b79K

Updated Nov 9, 2022 • 34 • 2

liked 2 Spaces over 2 years ago

22k Image Classification

🌖

Glip Zeroshot Demo

⚡