Edit model card

gemma2b-it-dutch-v1

Model description

Really shitty finetune of gemma-2b-it using BramVanroy/alpaca-cleaned-dutch.

Intended uses & limitations

Its finetuned on gemma-2b-it which is an english model. However because gemma has a large vocab size i thought it to be interessting to see if it could learn dutch.

Training and evaluation data

Trained on BramVanroy/alpaca-cleaned-dutch dataset. Therefore, commercial use of this model is forbidden. The model is intended for research purposes only.

Training procedure

Trained with QLoRA and merged before upload.

Training hyperparameters

idk anymore tbh (i think it has been trained on 400 steps)

Downloads last month
0
Safetensors
Model size
2.51B params
Tensor type
FP16
·
Inference API
Input a message to start chatting with cherryboi/gemma2b-it-dutch-v1.
This model can be loaded on Inference API (serverless).

Dataset used to train cherryboi/gemma2b-it-dutch-v1