Endless Spaces
Tried the gguf version with ollama, used the right template, it does generate endless empty spaces and lines after an answer.
Same here, SillyTavern shows many ' \n' at the end of the generation up to the full context size but filtering it out before it shows it in the WebUI. But this slows down the response time.
Update: it didn't happen with the original files here, but on the gguf, so the issue is there not here.
Same. Converted it to gguf myself but same problem.
this should be fixed now with this change, sorry for the oversight: https://huggingface.co/DiscoResearch/DiscoLM_German_7b_v1/commit/560f972f9f735fc9289584b3aa8d75d0e539c44e
Will ping TheBloke to reup quants as soon as we´ve confirmed everything is working now. Thanks everybody for reporting this issue!