|
--- |
|
license: cc-by-nc-4.0 |
|
tags: |
|
- not-for-all-audiences |
|
--- |
|
|
|
# Caution: This model may output adult content. |
|
|
|
|
|
 |
|
|
|
# FISH - Fusion of Intuitive Semantic Heuristics |
|
|
|
For this model I took the following LoRAs |
|
|
|
[SeanWu25/Mixtral_8x7b_Medicine](https://huggingface.co/SeanWu25/Mixtral_8x7b_Medicine) |
|
|
|
[SeanWu25/Mixtral_8x7b_WuKurtz](https://huggingface.co/SeanWu25/Mixtral_8x7b_WuKurtz) |
|
|
|
and |
|
|
|
[wandb/Mixtral-8x7b-Remixtral](https://huggingface.co/wandb/Mixtral-8x7b-Remixtral) |
|
|
|
And merged them onto their base model. |
|
|
|
I then did a simple linear merge between them, an experimental unreleased 8x7B model, and an unreleased model that was a intermediate step in creating [Envoid/BondBurger-8x7B](https://huggingface.co/Envoid/BondBurger-8x7B?not-for-all-audiences=true) |
|
|
|
The end results are a surprisingly good model for role palying style entertainment. |
|
|
|
At first I was disappointed with the results but ended up settling on the following sampler parameters which really bring it to life. |
|
|
|
|
|
 |
|
|
|
## It does eccentuate characters that have particularly aggressive personalities. |
|
|
|
## Because this is part of the whole SensualNousInstruct family of models it still suffers from the same tokenizer/special tokens weirdness. |
|
|
|
## This model has only been tested in Q8 GGUF form due to hardware limitations. |
|
|
|
It responds well to [INST] do a thing [/INST] instruct style formatting (although uses the ChatML special tokens) |
