---
language:
- kk
- en
- ru
license: mit
tags:
- gpt3
- transformers
- mgpt
---
# 🇰🇿 Kazakh mGPT 1.3B

Language model for Kazakh. Model has 1.3B parameters as you can guess from it's name.

Kazakh belongs to Turkic language family. It's a very vibrant language with approximately 18 million speakers. Here are some facts about it:

1. It is a major language spoken in Kazakhstan.
2. Kazakh has its own version of the Cyrillic script but is transitioning to the Latin script.
3. It has a rich tradition of oral literature, including epic poetry.

## Dataset

TBD

## Technical details

TBD

## Examples of usage

Try different generation strategies to reach better results.

TBD

Model will be improved over time. Stay tuned!