Best model I tried yet
#2
by
Chroniak
- opened
I'm using Captain_Eris_Noctis-12B-v0.420.i1-Q4_K_S.gguf from mradermacher, and it's by far the best one I have tried. The results in SillyTavern are so, so good. For once, they behave more like a real human. I'm a Newby and kinda don't like gguf because of the long prompt evaluation, but I'm willing to endure because the results are just too good.
Good work, really!
Glad to hear its been going well on your end! If you want i could probably do a 4bpw exl2 quant of this and upload at some point here.
That would be nice, if that would be possible. Thanks again!
https://huggingface.co/Nitrals-Quants/Captain_Eris_Noctis-12B-v0.420-4bpw-exl2 uploading here now, will take a little while.