This is a general discussion thread.
Feel free to share anything or report any issues.

This model is part of this collection with other GGUF quantizations.

NOTES: This model seems to be overtly confident leading to hallucinations, normalization has seemed to also break the long context chaining. I do not recommend this model.

Use the previous version, Kunocchini-7B-128k-test-GGUF-Imatrix, found in the collection.