O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?
Paper
•
2411.16489
•
Published
•
40
qinluo
qinluo
AI & ML interests
None yet
Recent Activity
liked
a model
about 1 month ago
AIDC-AI/Marco-o1
liked
a dataset
about 2 months ago
Tongyi-ConvAI/MMEvol
Organizations
None yet
qinluo's activity
upvoted
a
paper
about 1 month ago
upvoted
an
article
about 2 months ago
Article
Releasing the largest multilingual open pretraining dataset
By
•
•
98
upvoted
3
papers
about 2 months ago
upvoted
2
papers
3 months ago
upvoted
3
papers
4 months ago
V-STaR: Training Verifiers for Self-Taught Reasoners
Paper
•
2402.06457
•
Published
•
9
LongRecipe: Recipe for Efficient Long Context Generalization in Large Languge Models
Paper
•
2409.00509
•
Published
•
37
RegMix: Data Mixture as Regression for Language Model Pre-training
Paper
•
2407.01492
•
Published
•
35
upvoted
an
article
5 months ago
Article
SmolLM - blazingly fast and remarkably powerful
•
294
upvoted
a
paper
6 months ago
upvoted
a
collection
7 months ago
upvoted
a
paper
7 months ago
upvoted
4
papers
8 months ago
FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design
Paper
•
2401.14112
•
Published
•
18
Decoding Compressed Trust: Scrutinizing the Trustworthiness of Efficient LLMs Under Compression
Paper
•
2403.15447
•
Published
•
16
WildChat: 1M ChatGPT Interaction Logs in the Wild
Paper
•
2405.01470
•
Published
•
61
KAN: Kolmogorov-Arnold Networks
Paper
•
2404.19756
•
Published
•
108
upvoted
2
articles
8 months ago
Article
⚗️ 🧑🏼🌾 Let's grow some Domain Specific Datasets together
By
•
•
29Article
🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets
By
•
•
73