|
--- |
|
license: apache-2.0 |
|
tags: |
|
- merge |
|
- mergekit |
|
- lazymergekit |
|
- SanjiWatsuki/Lelantos-DPO-7B |
|
- NeverSleep/Noromaid-7B-0.4-DPO |
|
--- |
|
|
|
# Lelantos-Maid-DPO-7B 4bpw EXL2 |
|
***Note:*** There have been issues with never ending generations for the exl quant of this model, i have not been able to figure out why, though it works for some. |
|
|
|
## Description |
|
Exllama quant of [SanjiWatsuki/Lelantos-Maid-DPO-7B](https://huggingface.co/SanjiWatsuki/Lelantos-Maid-DPO-7B) |
|
|
|
## Other quants: |
|
EXL2: [8bpw](https://huggingface.co/Kooten/Lelantos-Maid-DPO-7B-8bpw-exl2), [4bpw](https://huggingface.co/Kooten/Lelantos-Maid-DPO-7B-4bpw-exl2) |
|
|
|
## Prompt format: ChatML |
|
It is partly Noromaid so should be ChatML |
|
|
|
``` |
|
<|im_start|>system |
|
{sysprompt}<|im_end|> |
|
<|im_start|>user |
|
{input}<|im_end|> |
|
<|im_start|>assistant |
|
{output}<|im_end|> |
|
``` |
|
## Contact |
|
Kooten on discord |
