Commit
·
8cff0af
1
Parent(s):
ef53bac
Update README.md
Browse files
README.md
CHANGED
|
@@ -25,8 +25,10 @@ license: apache-2.0
|
|
| 25 |
|
| 26 |
### Model description
|
| 27 |
|
| 28 |
-
A text generation (autoregressive) model, using Huggingface transformers and fastai based on the English GPT-2(small).
|
| 29 |
-
|
|
|
|
|
|
|
| 30 |
Based on the work of Thomas Dehaene (ML6) for the creation of a Dutch GPT2: https://colab.research.google.com/drive/1Y31tjMkB8TqKKFlZ5OJ9fcMp3p8suvs4?usp=sharing
|
| 31 |
|
| 32 |
|
|
|
|
| 25 |
|
| 26 |
### Model description
|
| 27 |
|
| 28 |
+
A text generation (autoregressive) model, using Huggingface transformers and fastai based on the English GPT-2(small). 

|
| 29 |
+
|
| 30 |
+
Finetuned with gradual layer unfreezing. This is a more efficient and sustainable alternative compared to training from scratch, especially for low-resource languages. 

|
| 31 |
+
|
| 32 |
Based on the work of Thomas Dehaene (ML6) for the creation of a Dutch GPT2: https://colab.research.google.com/drive/1Y31tjMkB8TqKKFlZ5OJ9fcMp3p8suvs4?usp=sharing
|
| 33 |
|
| 34 |
|