Prompt template fail in Jan.ai
The default prompt template seems to work most of the time. Except when it starts looping and repeating itself, several times in the same response. Sometimes it produces pages and pages and pages of response before it finishes.
the default prompt in Jan.ai:
{system_message}
### Instruction: {prompt}
### Response:
Pasting the prompt template provided in the readme.md leads to errors initializing the model. No chat or response is possible.
Tested with the 5GB and the 6GB model.
Using Jan.ai v0.5.0
Hello!
I don't know Jan.ai at all, but you need to use the Llama-3-Instruct prompt template with this model, not Alpaca!
If copy/pasting the prompt format don't work, maybe try to see if they already have the correct prompt template For Llama-3-Instruct, if they have, you just need to use the same one.
Tell me if you made it work!
Pasting the prompt template provided in the readme.md leads to errors initializing the model. No chat or response is possible.
Tested with the 5GB and the 6GB model.
Using Jan.ai v0.5.0
Put this
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{system_message}<|eot_id|><|start_header_id|>user<|end_header_id|>
{prompt}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
Into "Prompt template" in the "Model Parameters" tab
&
Put this
<|end_of_text|> <|eot_id|>
In "Stop" in the "Inference Parameters" tab
Confirmed working for me atleast