GGUF quants available here

#11
by andrijdavid - opened

The GGUF is available here. I had to split it due to the size. Tested using Llama.cpp
https://huggingface.co/andrijdavid/Mixtral-8x22B-v0.1-GGUF/

Sign up or log in to comment