This a 3x7B MoE model I made for RP purposes. I also made a Q5_K_M GGUF version : https://huggingface.co/WesPro/Wizard-Kun-Lake_3x7B-MoE_Q5_K_M.
This a 3x7B MoE model I made for RP purposes. I also made a Q5_K_M GGUF version : https://huggingface.co/WesPro/Wizard-Kun-Lake_3x7B-MoE_Q5_K_M.