This a 3x7B MoE model that I made out of some RP models I liked and I also applied a small lora I made myself to one of the experts. You can find a Q5_K_M GGUF version here : https://huggingface.co/WesPro/Wizard-Kun-Lake_3x7B-MoE_Q5_K_M.
This a 3x7B MoE model that I made out of some RP models I liked and I also applied a small lora I made myself to one of the experts. You can find a Q5_K_M GGUF version here : https://huggingface.co/WesPro/Wizard-Kun-Lake_3x7B-MoE_Q5_K_M.