Sampler Tips for Kobold.cpp?
#4
by
Puchacz19
- opened
Hi, I like your model, I use your instruct template and I have a question about Sampler for Kobold. The sliders are different from oobaboba ai. What are your recommendations?
I haven't used Kobold in a long time. If it supports Min-P, then you should be able to mirror the settings.
I like setting MinP between 0.3 and 0.45 with a temperature between 1.2 and 1.45. Play around with combinations in that range. I would set your repetition penalty between 1.1 and 1.2. As long as you can do that, you should get some nice results.
sophosympatheia
changed discussion status to
closed