|
--- |
|
license: other |
|
language: |
|
- en |
|
--- |
|
![image/png](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/umAoqWpJAhrpZbmzwiynH.png) |
|
# Quant's available from Bartowski <3: [GGUF](https://huggingface.co/bartowski/Captain_BMO-12B-GGUF) Exl2 Quant's from me: [4bpw Exl2](https://huggingface.co/Nitral-AI/Captain_BMO-12b-4bpw-exl2) [6bpw Exl2](https://huggingface.co/Nitral-AI/Captain_BMO-12b-6bpw-exl2) |
|
![image/png](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/qmC-LKV6T93GhuqSjtSxN.png) |
|
# Uses Mistral Formatting, Text completion [preset here](https://huggingface.co/Nitral-AI/Captain_BMO-12B/tree/main/ST) |
|
Notes: One off train most likely, this was done purely for internal testing purposes but seemed ok enough to release. I do not plan to offer any kind of extended support for using this model, so your mileage may vary depending on use and context size. |
|
- (Nemo 12B instruct as base) |
|
- 200k randomized subset of GU_instruct-Remastered-1.1, with a splash of 25k hathor/poppy sauce, slow cooked for 3 epochs on medium heat. |