metadata
library_name: transformers
datasets:
- BramVanroy/alpaca-cleaned-dutch
language:
- nl
license: cc-by-nc-4.0
gemma2b-it-dutch-v1
Model description
Really shitty finetune of gemma-2b-it using BramVanroy/alpaca-cleaned-dutch.
Intended uses & limitations
Its finetuned on gemma-2b-it which is an english model. However because gemma has a large vocab size i thought it to be interessting to see if it could learn dutch.
Training and evaluation data
Trained on BramVanroy/alpaca-cleaned-dutch dataset. Therefore, commercial use of this model is forbidden. The model is intended for research purposes only.
Training procedure
Trained with QLoRA and merged before upload.
Training hyperparameters
idk anymore tbh (i think it has been trained on 400 steps)