|
--- |
|
base_model: |
|
- Test157t/Pasta-PrimaMaid-7b |
|
- macadeliccc/WestLake-7B-v2-laser-truthy-dpo |
|
library_name: transformers |
|
tags: |
|
- mergekit |
|
- merge |
|
|
|
--- |
|
|
|
# Pasta-Lake-7b 4bpw |
|
Exllama quant of [Test157t/Pasta-Lake-7b](https://huggingface.co/Test157t/Pasta-Lake-7b) |
|
|
|
## Other quants: |
|
EXL2: [8bpw](https://huggingface.co/Kooten/Pasta-Lake-7b-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Pasta-Lake-7b-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Pasta-Lake-7b-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Pasta-Lake-7b-4bpw-exl2) |
|
|
|
|
|
## Prompt Format: ChatML |
|
The merge contains multiple formats, alpaca, mistral and chatml however chatml should be a good place to start. |
|
|
|
``` |
|
<|im_start|>system<|im_end|> |
|
|
|
<|im_start|>user <|im_end|> |
|
|
|
<|im_start|>assistant |
|
``` |
|
|
|
## Contact |
|
Kooten on discord |
|
|
|
[ko-fi.com/kooten](https://ko-fi.com/kooten) if you would like to support me |
|
|
