Update README.md
Browse files
README.md
CHANGED
|
@@ -10,6 +10,17 @@ pipeline_tag: conversational
|
|
| 10 |
|
| 11 |
Colab: [link](https://colab.research.google.com/drive/1IBh4FMJPOGZAkX7DYWnIKdav_ZcKatlP)
|
| 12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
v1:
|
| 14 |
- revision 1ad1cb364e3e245a7a376884111e107cfc013911
|
| 15 |
- wandb [link](https://wandb.ai/ilyagusev/rulm_self_instruct/runs/kx2uytey/overview)
|
|
|
|
| 10 |
|
| 11 |
Colab: [link](https://colab.research.google.com/drive/1IBh4FMJPOGZAkX7DYWnIKdav_ZcKatlP)
|
| 12 |
|
| 13 |
+
v2:
|
| 14 |
+
- revision 95876e3d9854e937104f623a5fb7144ca990e8ba
|
| 15 |
+
- wandb [link](https://wandb.ai/ilyagusev/rulm_self_instruct/runs/8p3nfjqv/overview)
|
| 16 |
+
- 4 datasets: ru_turbo_alpaca, ru_turbo_saiga, ru_sharegpt_cleaned, oasst1_ru_main_branch
|
| 17 |
+
- Datasets merging script: [create_chat_set.py](https://github.com/IlyaGusev/rulm/blob/ef58f3d82d6e7b3784d42167ff69188d3766ab61/self_instruct/src/data_processing/create_chat_set.py)
|
| 18 |
+
- Loss: 0.942
|
| 19 |
+
- Context length: 2000
|
| 20 |
+
- Conversational template: `"<s>{role}\n{content}</s>"`
|
| 21 |
+
- Possible roles: `["system", "user", "bot"]`
|
| 22 |
+
- System prompt: `"Ты — Сайга, русскоязычный автоматический ассистент. Ты разговариваешь с людьми и помогаешь им."`
|
| 23 |
+
|
| 24 |
v1:
|
| 25 |
- revision 1ad1cb364e3e245a7a376884111e107cfc013911
|
| 26 |
- wandb [link](https://wandb.ai/ilyagusev/rulm_self_instruct/runs/kx2uytey/overview)
|