Never seen this before.
100b sadly is probably a bit much for my machine. Have you considered doing something like this with Miqu or Nemotron? A genuine Mini-Miqu would be something else!
He often experiments with models before releasing them, you can check for them here, right now there's healed version of 100B Larazus(it needs fine-tuning after being pruned), 90B and 72B Lazarus, he probably won't waste time on "healing" 72B because it's too bad(It was pruned down from 123B and lost almost half of it's size, the damage is too heavy).
As for Mini-Miqu, there's 39B SkyFall, and upscaled and post fine-tuned version of 22B Mistral Small
Thanks for the reply man, I really enjoyed some of your MOE models, NeuralKunoichi-EroSumika-4x7B-128k being a favourite of mine for story writing. Claude Maid is nice was well!
Have you tried Skyfall yourself? I had no luck with Tunguska. I wonder how it does at long context as I noticed Small starts to struggle at about 20k.
He does some really cool experiments and a lot of his models are really solid, very horny as well lol
A genuine Mini-Miqu would be something else!
Hohoho!
A genuine Mini-Miqu would be something else!
Hohoho!
Ohhhh now I am intrigued!