OpenNLPLab

non-profit

https://github.com/OpenNLPLab

OpenNLPLab

Activity Feed Request to join this org

AI & ML interests

None defined yet.

OpenNLPLab123's activity

liddalidd

authored 2 papers about 2 months ago

Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention

Paper • 2405.17381 • Published May 27, 2024

MiniMax-01: Scaling Foundation Models with Lightning Attention

Paper • 2501.08313 • Published Jan 14 • 276

liddalidd

authored 6 papers 2 months ago

Fine-grained Audible Video Description

Paper • 2303.15616 • Published Mar 27, 2023 • 1

CO2: Efficient Distributed Training with Full Communication-Computation Overlap

Paper • 2401.16265 • Published Jan 29, 2024 • 1

Neural Architecture Search on Efficient Transformers and Beyond

Paper • 2207.13955 • Published Jul 28, 2022 • 1

Linear Attention Sequence Parallelism

Paper • 2404.02882 • Published Apr 3, 2024 • 3

HGRN2: Gated Linear RNNs with State Expansion

Paper • 2404.07904 • Published Apr 11, 2024 • 20

Scaling Laws for Linear Complexity Language Models

Paper • 2406.16690 • Published Jun 24, 2024 • 23

Doreamonzzz

authored 12 papers 3 months ago

Fine-grained Audible Video Description

Paper • 2303.15616 • Published Mar 27, 2023 • 1

Hierarchically Gated Recurrent Neural Network for Sequence Modeling

Paper • 2311.04823 • Published Nov 8, 2023 • 2

Accelerating Toeplitz Neural Network with Constant-time Inference Complexity

Paper • 2311.08756 • Published Nov 15, 2023 • 1

Exploring Transformer Extrapolation

Paper • 2307.10156 • Published Jul 19, 2023 • 1

Scaling TransNormer to 175 Billion Parameters

Paper • 2307.14995 • Published Jul 27, 2023 • 22

CO2: Efficient Distributed Training with Full Communication-Computation Overlap

Paper • 2401.16265 • Published Jan 29, 2024 • 1

cosFormer: Rethinking Softmax in Attention

Paper • 2202.08791 • Published Feb 17, 2022 • 1

Linear Attention Sequence Parallelism

Paper • 2404.02882 • Published Apr 3, 2024 • 3

HGRN2: Gated Linear RNNs with State Expansion

Paper • 2404.07904 • Published Apr 11, 2024 • 20

The Devil in Linear Transformer

Paper • 2210.10340 • Published Oct 19, 2022 • 1

Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention

Paper • 2405.17381 • Published May 27, 2024

Scaling Image Tokenizers with Grouped Spherical Quantization

Paper • 2412.02632 • Published Dec 3, 2024 • 10