What license?

#2
by ifmain - opened

What is the license for this model? Are you publishing as MIT (as the original) or under a different license?

The model is more a work-in-progress snapshot to investigate bfloat16. I suspect a few changes to the modelling_gpt2.py code as things progress.

There with also be fineweb-edu-774M and larger models to follow, and then fine-tunes, of course!

The training code is mit, the training data is odc-by and the model is mit license - see mdouglas/llmc-gpt2-774M-150B for the model referenced from the llm.c project discussions.

ifmain changed discussion status to closed

Sign up or log in to comment