A consideration for your next model

#23
by pyhornet - opened

Hi! It's still a good model by the way. I had a lot of fun generating creativity with this one back in 2023 and I thank you for this. So, since it's a little outdated and based on the first version of Mistral architecture, it has some problems with understanding complex situations when I'm doing roleplay or storytelling which is understandable why.

So, I was just wondering, it would be nice to have a L3.1 8B (or any other model)* version using the same dataset from this one…. Perhaps that would be fantastic. The model would get even more smarter due to the increase of parameters and more updated as well. So, if you have some time and interest, I leave this as a consideration for your next one.

Ah, additionally, just another thing, it would be also nice if you remove any slop from the dataset (if there is any) because it makes the model generate unwanted bias or imply 'correctness' which destroys creativity as we get from the base L3.1 (and some models)*. So, a cleared dataset would be considerable as well, but that's your decision.

Many thanks and have a good one!

Sign up or log in to comment