Awesome model, can't get the prompt template right
#12
by
ben-epstein
- opened
This model is performing really well, thank you! I've been using it with ramalama and gpt4all. But with gpt4all, and the prompt template like so
<start_of_turn>user
%1<end_of_turn>
<start_of_turn>%2
<end_of_turn>
Similar to your suggested prompt template, the model always ends with <end_of_turn>. I tried a bunch of variations, even identical to your suggestion, but the same issue arose.
<start_of_turn>user
%1<end_of_turn>
<start_of_turn>%2
<end_of_turn>
<start_of_turn>
Sorry if this isn't the right place to ask, just curious what i'm doing wrong. Thanks!