Finally, a Replacement for BERT: Introducing ModernBERT
•
309
Raja Biswas
rbiswasfc
AI & ML interests
NLP, Generative AI
Recent Activity
upvoted
a
paper
2 days ago
No More Adam: Learning Rate Scaling at Initialization is All You Need
upvoted
a
paper
2 days ago
Qwen2.5 Technical Report
Articles
Organizations
Collections
3
A collection of papers focused on LLM
-
Orca 2: Teaching Small Language Models How to Reason
Paper • 2311.11045 • Published • 71 -
ToolTalk: Evaluating Tool-Usage in a Conversational Setting
Paper • 2311.10775 • Published • 7 -
Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning
Paper • 2311.11077 • Published • 24 -
MultiLoRA: Democratizing LoRA for Better Multi-Task Learning
Paper • 2311.11501 • Published • 33
A curated list of papers focusing on synthetic data generation
-
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Paper • 2402.13064 • Published • 47 -
Textbooks Are All You Need II: phi-1.5 technical report
Paper • 2309.05463 • Published • 87 -
DataDreamer: A Tool for Synthetic Data Generation and Reproducible LLM Workflows
Paper • 2402.10379 • Published • 30 -
Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Paper • 2312.06585 • Published • 28
Papers
1
spaces
6
models
7
rbiswasfc/deberta-v3-base-zotero-answerai-classifier
Updated
•
2
rbiswasfc/Qwen2-1.5B-Instruct-xLAM-fc
Text Generation
•
Updated
•
12
rbiswasfc/deepseek-coder-1.3b-instruct-xLAM-fc
Text Generation
•
Updated
•
6
rbiswasfc/SmolLM-1.7B-Instructt-xLAM-fc-lora-merged
Text Generation
•
Updated
•
6
rbiswasfc/lmsys-r-gemma-s1-mix110-merged-headless
Text Generation
•
Updated
•
20
rbiswasfc/falcon-7b-8bit
Text Generation
•
Updated
•
13
rbiswasfc/ppo-LunarLander-v2
Reinforcement Learning
•
Updated
•
2
datasets
25
rbiswasfc/zotero-answer-ai-texts
Viewer
•
Updated
•
4.27k
•
140
rbiswasfc/zotero-answer-ai-images
Viewer
•
Updated
•
42.9k
•
51
rbiswasfc/arxiv-papers
Viewer
•
Updated
•
4.67k
•
54
rbiswasfc/f1-fact-final
Viewer
•
Updated
•
242
•
40
rbiswasfc/f1-synthetic-filtered
Viewer
•
Updated
•
230
•
43
rbiswasfc/f1-synthetic
Viewer
•
Updated
•
360
•
50
rbiswasfc/zotero-articles
Viewer
•
Updated
•
2.77k
•
33
rbiswasfc/image-test
Viewer
•
Updated
•
502
•
33
rbiswasfc/fact-qa-iclr
Viewer
•
Updated
•
618
•
39
rbiswasfc/iclr-eval-examples
Viewer
•
Updated
•
231
•
41