|
--- |
|
title: README |
|
emoji: 🐎 |
|
colorFrom: gray |
|
colorTo: yellow |
|
sdk: static |
|
pinned: true |
|
license: apache-2.0 |
|
short_description: Description of the Mula project. |
|
--- |
|
<div align="center"> |
|
|
|
# Mula: a Sparse Mixture of Experts Language Model trained in Brazilian Portuguese |
|
|
|
</div> |
|
<p align="center"> |
|
<img src="./logo-no-bg.png" alt="Mula" height="400"> |
|
</p> |
|
|
|
Mula is a series of Sparse Mixture of Experts (SMoE) language models, all trained natively in Brazilian Portuguese, designed to help democratize LLMs for low-resource languages. |
|
|
|
Models and datasets are coming soon... |
