Upload README.md with huggingface_hub

README.md

@@ -17,20 +17,47 @@ Ukranian belongs to Indo-European language family. It's a very melodic language
 
 1. One of the East Slavic languages, alongside Russian and Belarusian.
 2. It is the official language of Ukraine and is written in a version of the Cyrillic script.
-3. Ukrainian has a rich literary history, it has maintained a vibrant cultural presence, especially in poetry and music.
+3. Ukrainian has a rich literary history, and despite political pressures, it has maintained a vibrant cultural presence, especially in poetry and music.
 
-## Dataset
+## Technical details
 
-TBD
+It's one of the models derived from the base [mGPT-XL (1.3B)](https://huggingface.co/ai-forever/mGPT) model (see the list below) which was originally trained on the 61 languages from 25 language families using Wikipedia and C4 corpus.
 
-## Technical details
+We've found additional data for 23 languages most of which are considered as minor and decided to further tune the base model. **Ukranian mGPT 1.3B** was trained for another 10000 steps with batch_size=4 and context window of **2048** tokens on 1 A100.
+
+Final perplexity for this model on validation is **7.1**.
+
+_Chart of the training loss and perplexity:_
+
+![](https://i.imgur.com/DppAo6e.png)
 
-TBD
+## Other mGPT-1.3B models
 
-## Examples of usage
+- [mGPT-1.3B-armenian](https://huggingface.co/ai-forever/mGPT-1.3B-armenian)
+- [mGPT-1.3B-azerbaijan](https://huggingface.co/ai-forever/mGPT-1.3B-azerbaijan)
+- [mGPT-1.3B-bashkir](https://huggingface.co/ai-forever/mGPT-1.3B-bashkir)
+- [mGPT-1.3B-belorussian](https://huggingface.co/ai-forever/mGPT-1.3B-belorussian)
+- [mGPT-1.3B-bulgarian](https://huggingface.co/ai-forever/mGPT-1.3B-bulgarian)
+- [mGPT-1.3B-buryat](https://huggingface.co/ai-forever/mGPT-1.3B-buryat)
+- [mGPT-1.3B-chuvash](https://huggingface.co/ai-forever/mGPT-1.3B-chuvash)
+- [mGPT-1.3B-georgian](https://huggingface.co/ai-forever/mGPT-1.3B-georgian)
+- [mGPT-1.3B-kalmyk](https://huggingface.co/ai-forever/mGPT-1.3B-kalmyk)
+- [mGPT-1.3B-kazakh](https://huggingface.co/ai-forever/mGPT-1.3B-kazakh)
+- [mGPT-1.3B-kirgiz](https://huggingface.co/ai-forever/mGPT-1.3B-kirgiz)
+- [mGPT-1.3B-mari](https://huggingface.co/ai-forever/mGPT-1.3B-mari)
+- [mGPT-1.3B-mongol](https://huggingface.co/ai-forever/mGPT-1.3B-mongol)
+- [mGPT-1.3B-ossetian](https://huggingface.co/ai-forever/mGPT-1.3B-ossetian)
+- [mGPT-1.3B-persian](https://huggingface.co/ai-forever/mGPT-1.3B-persian)
+- [mGPT-1.3B-romanian](https://huggingface.co/ai-forever/mGPT-1.3B-romanian)
+- [mGPT-1.3B-tajik](https://huggingface.co/ai-forever/mGPT-1.3B-tajik)
+- [mGPT-1.3B-tatar](https://huggingface.co/ai-forever/mGPT-1.3B-tatar)
+- [mGPT-1.3B-turkmen](https://huggingface.co/ai-forever/mGPT-1.3B-turkmen)
+- [mGPT-1.3B-tuvan](https://huggingface.co/ai-forever/mGPT-1.3B-tuvan)
+- [mGPT-1.3B-uzbek](https://huggingface.co/ai-forever/mGPT-1.3B-uzbek)
+- [mGPT-1.3B-yakut](https://huggingface.co/ai-forever/mGPT-1.3B-yakut)
 
-Try different generation strategies to reach better results.
+## Feedback
 
-TBD
+If you'll found a bug of have additional data to train model on your language — please, give us feedback.
 
 Model will be improved over time. Stay tuned!