1 13 280

Jay P

jayomb

AI & ML interests

None yet

Recent Activity

liked a dataset about 8 hours ago

xywang1/OpenCharacter

upvoted a paper about 13 hours ago

SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model

liked a dataset about 16 hours ago

nothingiisreal/Reddit-Dirty-And-WritingPrompts

View all activity

Organizations

jayomb's activity

upvoted a paper about 13 hours ago

SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model

Paper • 2502.02737 • Published 12 days ago • 170

upvoted a paper 6 days ago

Training Language Models for Social Deduction with Multi-Agent Reinforcement Learning

Paper • 2502.06060 • Published 7 days ago • 29

upvoted a collection 18 days ago

cool datasets

Collection

133 items • Updated 7 minutes ago • 14

upvoted a paper about 1 month ago

Were RNNs All We Needed?

Paper • 2410.01201 • Published Oct 2, 2024 • 51

upvoted a collection 9 months ago

abliterated-v3

Collection

Latest gen of the abliterated models I've produced • 17 items • Updated Jun 3, 2024 • 110

upvoted 2 papers 9 months ago

LoRA Learns Less and Forgets Less

Paper • 2405.09673 • Published May 15, 2024 • 88

Piccolo2: General Text Embedding with Multi-task Hybrid Loss Training

Paper • 2405.06932 • Published May 11, 2024 • 20

upvoted an article 10 months ago

Article

Fine-tune Llama 3 with ORPO

•

Apr 22, 2024

• 233

upvoted 2 papers 10 months ago

Why do small language models underperform? Studying Language Model Saturation via the Softmax Bottleneck

Paper • 2404.07647 • Published Apr 11, 2024 • 4

Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence

Paper • 2404.05892 • Published Apr 8, 2024 • 33

upvoted a collection 11 months ago

OpenCulture

Collection

A multilingual dataset of public domain books and newspapers. • 27 items • Updated Nov 6, 2024 • 123

upvoted 2 papers 12 months ago

Knowledge Fusion of Large Language Models

Paper • 2401.10491 • Published Jan 19, 2024 • 5

StructLM: Towards Building Generalist Models for Structured Knowledge Grounding

Paper • 2402.16671 • Published Feb 26, 2024 • 27