Sakana AI

company

Verified

https://sakana.ai/

SakanaAI

AI & ML interests

We are a Tokyo-based R&D company on a quest to create a new kind of foundational AI model based on nature-inspired intelligence.

Recent Activity

Taishi-N324 authored a paper 9 days ago

Balancing Speed and Stability: The Trade-offs of FP8 vs. BF16 Training in LLMs

Taishi-N324 authored a paper 9 days ago

Why We Build Local Large Language Models: An Observational Analysis from 35 Japanese and Multilingual LLMs

Taishi-N324 authored a paper 9 days ago

Wider or Deeper? Scaling LLM Inference-Time Compute with Adaptive Branching Tree Search

View all activity

SakanaAI's activity

Taishi-N324

authored 3 papers 9 days ago

Balancing Speed and Stability: The Trade-offs of FP8 vs. BF16 Training in LLMs

Paper • 2411.08719 • Published Nov 10, 2024

Why We Build Local Large Language Models: An Observational Analysis from 35 Japanese and Multilingual LLMs

Paper • 2412.14471 • Published Dec 19, 2024

Wider or Deeper? Scaling LLM Inference-Time Compute with Adaptive Branching Tree Search

Paper • 2503.04412 • Published 10 days ago • 1

iwiwi

authored a paper 9 days ago

Wider or Deeper? Scaling LLM Inference-Time Compute with Adaptive Branching Tree Search

Paper • 2503.04412 • Published 10 days ago • 1

iwiwi

authored a paper 16 days ago

Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization

Paper • 2502.19261 • Published 18 days ago • 6

Taishi-N324

authored a paper 17 days ago

Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization

Paper • 2502.19261 • Published 18 days ago • 6

RobertTLange

updated a dataset 24 days ago

SakanaAI/AI-CUDA-Engineer-Archive

Viewer • Updated 24 days ago • 30.6k • 14.3k • 139

RobertTLange

published a dataset 24 days ago

SakanaAI/AI-CUDA-Engineer-Archive

Viewer • Updated 24 days ago • 30.6k • 14.3k • 139

takkyu2

authored a paper about 2 months ago

TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models

Paper • 2501.16937 • Published Jan 28 • 5

iwiwi

authored a paper about 2 months ago

TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models

Paper • 2501.16937 • Published Jan 28 • 5

mkshing

authored 2 papers about 2 months ago

Release of Pre-Trained Models for the Japanese Language

Paper • 2404.01657 • Published Apr 2, 2024 • 1

TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models

Paper • 2501.16937 • Published Jan 28 • 5

lfsm

authored a paper 2 months ago

$\text{Transformer}^2$: Self-adaptive LLMs

Paper • 2501.06252 • Published Jan 9 • 53

tyj2022

authored 6 papers 2 months ago

$\text{Transformer}^2$: Self-adaptive LLMs

Paper • 2501.06252 • Published Jan 9 • 53

Agent Skill Acquisition for Large Language Models via CycleQD

Paper • 2410.14735 • Published Oct 16, 2024 • 2

An Evolved Universal Transformer Memory

Paper • 2410.13166 • Published Oct 17, 2024 • 3

Large Language Models As Evolution Strategies

Paper • 2402.18381 • Published Feb 28, 2024

LEVI: Generalizable Fine-tuning via Layer-wise Ensemble of Different Views

Paper • 2402.04644 • Published Feb 7, 2024

Open X-Embodiment: Robotic Learning Datasets and RT-X Models

Paper • 2310.08864 • Published Oct 13, 2023 • 2

conglu

authored a paper 3 months ago

Policy-Guided Diffusion

Paper • 2404.06356 • Published Apr 9, 2024