---
base_model:
- mistralai/Mixtral-8x7B-v0.1
- jondurbin/bagel-dpo-8x7b-v0.2
- Sao10K/Sensualize-Mixtral-bf16
- mistralai/Mixtral-8x7B-v0.1
- Doctor-Shotgun/limarp-zloss-mixtral-8x7b-qlora
- mistralai/Mixtral-8x7B-Instruct-v0.1
tags:
- mergekit
- merge
license: cc-by-nc-4.0
---

# BagelMIsteryTour-v2-8x7B 3.5bpw
Exllama quant of [ycros/BagelMIsteryTour-v2-8x7B](https://huggingface.co/ycros/BagelMIsteryTour-v2-8x7B)

## Other quants:

EXL2: [8bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-4bpw-exl2), [3.5bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-3.5bpw-exl2)

## Prompt format: Alpaca
It is noted to also work with mistral

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Input:
{input}
### Response:
```

## Contact
Kooten on discord

[ko-fi.com/kooten](https://ko-fi.com/kooten) if you would like to support me