Taehyeon Kim's picture

2 8 1

Taehyeon Kim

Kthyeon

·

https://taehyeon.oopy.io/

AI & ML interests

LLM Inference: Parallel, Speculative, Instructive Decoding

Recent Activity

new activity about 2 months ago

microsoft/Phi-3-small-8k-instruct:Getting the error: "triton.runtime.autotuner.OutOfResources: out of resource: shared memory, Required: 180224, Hardware limit: 166912. Reducing block sizes or `num_stages` may help."

View all activity

Organizations

Kthyeon's activity

upvoted a paper 3 months ago

Phantom of Latent for Large Language and Vision Models

Paper • 2409.14713 • Published Sep 23 • 27

upvoted 3 papers 6 months ago

Scaling Synthetic Data Creation with 1,000,000,000 Personas

Paper • 2406.20094 • Published Jun 28 • 95

Towards Fast Inference: Exploring and Improving Blockwise Parallel Drafts

Paper • 2404.09221 • Published Apr 14 • 1

Towards Fast Multilingual LLM Inference: Speculative Decoding and Specialized Drafters

Paper • 2406.16758 • Published Jun 24 • 19

upvoted 2 papers 7 months ago

Block Transformer: Global-to-Local Language Modeling for Fast Inference

Paper • 2406.02657 • Published Jun 4 • 37

Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models

Paper • 2405.15574 • Published May 24 • 53

upvoted 2 papers about 1 year ago

Distort, Distract, Decode: Instruction-Tuned Model Can Refine its Response from Noisy Instructions

Paper • 2311.00233 • Published Nov 1, 2023 • 4

Navigating Data Heterogeneity in Federated Learning: A Semi-Supervised Approach for Object Detection

Paper • 2310.17097 • Published Oct 26, 2023 • 3