Peter Szemraj PRO

pszemraj

AI & ML interests

metallic intuition

Recent Activity

Organizations

Stacked Summaries's profile picture Analytics Club at ETH Zürich's profile picture ml4pubmed's profile picture Gradio-Blocks-Party's profile picture OneFrame's profile picture postbot's profile picture Ontocord's M*DEL's profile picture BEEspoke Data's profile picture Sablo AI's profile picture memecaps's profile picture Hugging Face Discord Community's profile picture

pszemraj's activity

reacted to MoritzLaurer's post with 👍 1 day ago
view post
Post
1560
Quite excited by the ModernBERT release! 0.15/0.4B small, 2T modern pre-training data and tokenizer with code, 8k context window, great efficient model for embeddings & classification!

This will probably be the basis for many future SOTA encoders! And I can finally stop using DeBERTav3 from 2021 :D

Congrats @answerdotai , @LightOnIO and collaborators like @tomaarsen !

Paper and models here 👇https://huggingface.co/collections/answerdotai/modernbert-67627ad707a4acbf33c41deb
New activity in AtlaAI/judge-arena 3 days ago