Will any prompt format work?
#1
by
Jdods84
- opened
I have an Alpaca prompt format for use with character RP. Will this work?
You would have to check the source repo for details like this - I only provide the quants. In this case, the model author says to use chatml.
Personally, I don't usually care much for the prompt format myself - a good model will understand my prompt format, but without doubt, prompt format has an effect, especially on smaller models. I would suggest to try it and see what the results are, and maybe try with chatml to see if it makes a real difference.
mradermacher
changed discussion status to
closed