what is the prompt used for instruction tuning, and why the model is pre-trained on refineweb but also instruction-tuned with it?

#30

by zerolyn - opened Jun 12, 2023

Jun 12, 2023

can i have the prompts for instruction tuning? I'm also confused about why the model is pre-trained with refineweb but also instruction-tuned with its subset?

ccasimiro

Jun 13, 2023

Hi, as requested by @zerolyn , would be very useful to have the exact prompt used for fine-tuning to make the generation more reliable and robust. Thanks a lot for your contribution to the open-source!

kronus86

Jun 19, 2023

Can we please get the prompt used for fine-tuning.

michaelomahony

Jul 10, 2023

Bump

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment