Famous

non-profit

Activity Feed Request to join this org

AI & ML interests

Artificial intelligence. To benefit humanity by building the greatest knowledge repository in human history.

OpenScience's activity

ArthurZ

posted an update 4 months ago

Post

3417

Native tensor parallel has landed in transformers!!! https://github.com/huggingface/transformers/pull/34184 thanks a lot to the torch team for their support!

Contributions are welcome to support more models! 🔥

ArthurZ

authored a paper 11 months ago

RecurrentGemma: Moving Past Transformers for Efficient Open Language Models

Paper • 2404.07839 • Published Apr 11, 2024 • 46

manandey

authored a paper 11 months ago

The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset

Paper • 2303.03915 • Published Mar 7, 2023 • 7

ArthurZ

posted an update 12 months ago

Post

mamba is now available in transformers. Thanks to @tridao and @albertgu for this brilliant model! 🚀 and the amazing mamba-ssm kernels powering this!
Checkout the collection here:
state-spaces/transformers-compatible-mamba-65e7b40ab87e5297e45ae406

5 replies

·

manandey

authored a paper about 1 year ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29, 2024 • 138

ArthurZ

authored a paper about 1 year ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29, 2024 • 138

ArthurZ

posted an update about 1 year ago

Post

Just when I was about to go to bed....... Here we go again

hadyelsahar

authored 6 papers about 1 year ago

Seamless: Multilingual Expressive and Streaming Speech Translation

Paper • 2312.05187 • Published Dec 8, 2023 • 14

SeamlessM4T-Massively Multilingual & Multimodal Machine Translation

Paper • 2308.11596 • Published Aug 22, 2023 • 1

A Distributional Approach to Controlled Text Generation

Paper • 2012.11635 • Published Dec 21, 2020

What Language Model to Train if You Have One Million GPU Hours?

Paper • 2210.15424 • Published Oct 27, 2022 • 2

Documenting Geographically and Contextually Diverse Data Sources: The BigScience Catalogue of Language Data and Resources

Paper • 2201.10066 • Published Jan 25, 2022

Proactive Detection of Voice Cloning with Localized Watermarking

Paper • 2401.17264 • Published Jan 30, 2024 • 18

SaulLu

authored a paper almost 2 years ago

What Language Model to Train if You Have One Million GPU Hours?

Paper • 2210.15424 • Published Oct 27, 2022 • 2

manandey

authored 5 papers almost 2 years ago

StarCoder: may the source be with you!

Paper • 2305.06161 • Published May 9, 2023 • 31

PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts

Paper • 2202.01279 • Published Feb 2, 2022

Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP

Paper • 2112.10508 • Published Dec 20, 2021

How sensitive are translation systems to extra contexts? Mitigating gender bias in Neural Machine Translation models through relevant contexts

Paper • 2205.10762 • Published May 22, 2022

Evaluating Gender Bias in Natural Language Inference

Paper • 2105.05541 • Published May 12, 2021

SaulLu

authored a paper almost 2 years ago

The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset

Paper • 2303.03915 • Published Mar 7, 2023 • 7