LemonadeRP-4.5.3 4bpw

Exllama quant of KatyTheCutie/LemonadeRP-4.5.3

7B roleplay focused model, creativity and less cliché is the focus of this merge.

Other quants:

EXL2: 8bpw, 6bpw, 5bpw, 4bpw

Prompt format: Chatml

Based on the models going in to this I would assume Chatml is the appropriate format.

<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>

Contact

Kooten on discord

ko-fi.com/kooten if you would like to support me

Downloads last month
38
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Spaces using Kooten/LemonadeRP-4.5.3-4bpw-exl2 3