Tweeties in a Tweety World

community

Activity Feed

AI & ML interests

Multilingual and Low-Resource NLP

Recent Activity

pdelobelle authored a paper 10 days ago

ChocoLlama: Lessons Learned From Teaching Llamas Dutch

justalphie authored a paper 5 months ago

Trans-Tokenization and Cross-lingual Vocabulary Transfers: Language Adaptation of LLMs for Low-Resource NLP

FremyCompany updated a model 5 months ago

Tweeties/tweety-7b-dutch-v24a

View all activity

Tweeties's activity

pdelobelle

authored a paper 10 days ago

ChocoLlama: Lessons Learned From Teaching Llamas Dutch

Paper • 2412.07633 • Published 20 days ago

justalphie

authored a paper 5 months ago

Trans-Tokenization and Cross-lingual Vocabulary Transfers: Language Adaptation of LLMs for Low-Resource NLP

Paper • 2408.04303 • Published Aug 8 • 9

FremyCompany

updated 4 models 5 months ago

pdelobelle

authored a paper 5 months ago

Trans-Tokenization and Cross-lingual Vocabulary Transfers: Language Adaptation of LLMs for Low-Resource NLP

Paper • 2408.04303 • Published Aug 8 • 9

havetisy

updated a model 7 months ago

Tweeties/tweety-7b-armenian-v24a

Text Generation • Updated May 27 • 31 • 1

pdelobelle

updated a model 8 months ago

Tweeties/tweety-7b-italian-v24a

Text Generation • Updated May 13 • 16 • 2

FremyCompany

posted an update 8 months ago

Post

2166

Today, April 26, is the Day of the Tatar Language! 🌟
To celebrate, we release our new language model, Tweety Tatar 🐣

https://huggingface.co/Tweeties/tweety-tatar-base-7b-2024-v1

The model was converted from Mistral Instruct v0.2 using a novel technique called trans-tokenization. As a result, the model uses a brand-new tokenizer, fully tailored for the Tatar language.

We also release a model which can be finetuned for translation of English or Russian into Tatar, and achieves a performance similar to commercial offerings:

https://huggingface.co/Tweeties/tweety-tatar-hydra-base-7b-2024-v1

More details in our upcoming paper 👀
François REMY, Pieter Delobelle, Alfiya Khabibullina

Татар теле көне белән!

3 replies

FremyCompany

updated a Space 9 months ago

Running

📚

README

pdelobelle

authored 5 papers 10 months ago

RobBERT: a Dutch RoBERTa-based Language Model

Paper • 2001.06286 • Published Jan 17, 2020 • 1

Dutch Humor Detection by Generating Negative Examples

Paper • 2010.13652 • Published Oct 26, 2020

RobBERT-2022: Updating a Dutch Language Model to Account for Evolving Language Use

Paper • 2211.08192 • Published Nov 15, 2022 • 1

Measuring Shifts in Attitudes Towards COVID-19 Measures in Belgium Using Multilingual BERT

Paper • 2104.09947 • Published Apr 20, 2021

Time to Take Emoji Seriously: They Vastly Improve Casual Conversational Models

Paper • 1910.13793 • Published Oct 30, 2019

FremyCompany

posted an update 10 months ago

Post

🔥 What's that biomedical model that got 170,763 downloads last month on HuggingFace?! Well, the paper is finally published! #BioLORD

📰 Read our article in the Journal of the American Medical Informatics Association:
https://academic.oup.com/jamia/advance-article/doi/10.1093/jamia/ocae029/7614965

📝TLDR: BioLORD-2023 is a series of semantic language models for the biomedical domain, capable of representing clinical concepts and sentences in a semantic space aligned with human preferences. Our new multilingual version supports 50+ languages and is further finetuned on 7 European languages. These models were trained contrastively and through distillations, using a corpus unifying in the same latent space the concept names of biomedical concepts and their descriptions. For concepts which didn't have a description written by humans in UMLS, we use information contained in the SnomedCT knowledge graph and the capabilities of ChatGPT to generate synthetic data and improve our results.

🤗 Access our models from the HuggingFace hub, including the new 2023-C and 2023-S variants:
FremyCompany/BioLORD-2023
FremyCompany/BioLORD-2023-M
FremyCompany/BioLORD-2023-S
FremyCompany/BioLORD-2023-C