Funny model.
I like this model. At this size, what it can do and know is impresive and I more like performant models but with this something little
different, that corpo models othen lacked. I am not much in RP however... To be fair Llama 3 was big success and how it interacted with user and impresed lots of people. Still lots to do, because oftentimes all those LLM models feel like psycho... ;P I would say Llama-3.1-Minitron-4B-Width-Base is revolutionary for this model size and I can run it comfortable on my phone and other low end ARM devices... ;P Your finetune is funny, see what it told me:
;P so, it is not always perfect but beside this it woks quite well and halucinates less then NeuroCom also v2.
Dude, it looks like you have more this stuff and I will have to quant it also... ;P Good work! Thank you for the model!
I highly recommend Zenith, it is my highest MMLU scorer and seems to do quite well for its size. Thanks for the kind words!