Those GGUF 20B models behave incredibly well (when set up correctly) it's been a long time since my dungeon crawling card/bot behaved so interestingly! Simply Thank you! :-)8GB Vram (23 layers) and 32GB RAM on i7 -> ~2 tk/s, worth the wait.
· Sign up or log in to comment
