File size: 1,008 Bytes
77fb49b 027486f 4c4ffb4 77fb49b 027486f 77fb49b 027486f 4c4ffb4 77fb49b 027486f 5911f9d 77fb49b 027486f 77fb49b 027486f 77fb49b 027486f 77fb49b 027486f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 |
---
library_name: transformers
datasets:
- BramVanroy/alpaca-cleaned-dutch
language:
- nl
license: cc-by-nc-4.0
---
## gemma2b-it-dutch-v1
## Model description
Really shitty finetune of [gemma-2b-it](https://huggingface.co/google/gemma-2b-it) using [BramVanroy/alpaca-cleaned-dutch](https://huggingface.co/datasets/BramVanroy/alpaca-cleaned-dutch).
## Intended uses & limitations
Its finetuned on [gemma-2b-it](https://huggingface.co/google/gemma-2b-it) which is an english model. However because gemma has a large vocab size i thought it to be interessting to see if it could learn dutch.
## Training and evaluation data
Trained on [BramVanroy/alpaca-cleaned-dutch](https://huggingface.co/datasets/BramVanroy/alpaca-cleaned-dutch) dataset.
Therefore, commercial use of this model is forbidden. The model is intended for research purposes only.
## Training procedure
Trained with QLoRA and merged before upload.
### Training hyperparameters
idk anymore tbh (i think it has been trained on 400 steps) |