---
library_name: transformers
datasets:
- BramVanroy/alpaca-cleaned-dutch
language:
- nl
license: cc-by-nc-4.0
---

## gemma2b-it-dutch-v1


## Model description
Really shitty finetune of [gemma-2b-it](https://huggingface.co/google/gemma-2b-it) using [BramVanroy/alpaca-cleaned-dutch](https://huggingface.co/datasets/BramVanroy/alpaca-cleaned-dutch).

## Intended uses & limitations
Its finetuned on [gemma-2b-it](https://huggingface.co/google/gemma-2b-it) which is an english model. However because gemma has a large vocab size i thought it to be interessting to see if it could learn dutch.

## Training and evaluation data
Trained on [BramVanroy/alpaca-cleaned-dutch](https://huggingface.co/datasets/BramVanroy/alpaca-cleaned-dutch) dataset. 
Therefore, commercial use of this model is forbidden. The model is intended for research purposes only.

## Training procedure

Trained with QLoRA and merged before upload.

### Training hyperparameters
idk anymore tbh (i think it has been trained on 400 steps)