Edit model card

Mae'r model LLM yn seiliedig ar mistralai/Mistral-7B-v0.1, gyda hyfforddiant parhaus am 2 Epoch cyfan o ddata Cymreig o'r dataset allenai/MADLAD-400.

Pwrpas y model yw fod yn gychwyn i hyfforddiant cywrain pellach i greu casgliad o LLMs Cymreig penodol.


Contains information from allenai/MADLAD-400 which is made available under the ODC Attribution License.

Downloads last month
4
Safetensors
Model size
7.24B params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train BangorAI/mistral-7b-cy-epoch-2