Thanks for the effort!
#1
by
Hugs4Llamas
- opened
I was looking for a Q4 K S version and your Q4 K M is the closest thing I could find. Downloading now. Argilla is also preparing a release as they told me.
Unfortunately something seems to be broken with the models. It adds <0x0A> at the beginning or end of it's outputs. Im using the same setup which I also use for NeuralHermes and OpenHermes so there must be a problem with the model.
I see the problem. I will upload the correct version. Thanks for pointing out
Hello, any news on this?