Could you consider pruning also the instruct-version?

#5
by AiCreatornator - opened

This base model is not so usefull for chat for example.

I'll look into it! It's a little more tricky as we don't have the dataset used for the instruct version, but I have a few ideas to make it work. I'll see what I can do.

@chargoddard I will also be waiting for it

that would really be great

Sign up or log in to comment