Hugging Face's logo
siqi zhu's picture
5 5

siqi zhu

zsqzz
Viol2000's profile picture BryantMcGill's profile picture imss27's profile picture
·

AI & ML interests

None yet

Recent Activity

authored a paper 19 days ago
Efficiently Serving LLM Reasoning Programs with Certaindex
upvoted a paper 21 days ago
Efficiently Serving LLM Reasoning Programs with Certaindex
upvoted a collection 24 days ago
Synthetic Data and Self-Improvement
View all activity

Organizations

Tsinghua University's profile picture LLMFlywheel's profile picture LLMReasoner's profile picture Project-O1's profile picture

zsqzz's activity

authored a paper 19 days ago
upvoted a paper 21 days ago
upvoted a collection 24 days ago
liked a model about 2 months ago
reacted to di-zhang-fdu's post with 👍 3 months ago
view post
Post
6398
LLaMA-O1: Open Large Reasoning Model Frameworks For Training, Inference and Evaluation With PyTorch and HuggingFace
Large Reasoning Models powered by Monte Carlo Tree Search (MCTS), Self-Play Reinforcement Learning, PPO, AlphaGo Zero's dua policy paradigm and Large Language Models!
https://github.com/SimpleBerry/LLaMA-O1/

What will happen when you compound MCTS ❤ LLM ❤ Self-Play ❤RLHF?
Just a little bite of strawberry!🍓

Past related works:
LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical Reasoning (2410.02884)
Accessing GPT-4 level Mathematical Olympiad Solutions via Monte Carlo Tree Self-refine with LLaMa-3 8B (2406.07394)
  • 2 replies
·
upvoted a paper 4 months ago
updated 2 datasets 4 months ago
updated a dataset 5 months ago
upvoted 2 papers 5 months ago
authored 2 papers 5 months ago
updated 3 datasets 5 months ago
liked a model 5 months ago
updated a model 6 months ago
updated 2 models 8 months ago