Lelantos-Maid-DPO-7B 4bpw EXL2

Note: There have been issues with never ending generations for the exl quant of this model, i have not been able to figure out why, though it works for some.

Description

Exllama quant of SanjiWatsuki/Lelantos-Maid-DPO-7B

Other quants:

EXL2: 8bpw, 4bpw

Prompt format: ChatML

It is partly Noromaid so should be ChatML

<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>

Contact

Kooten on discord

Downloads last month
14
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.