GGUF + quants for: https://huggingface.co/l3utterfly/mistral-7b-v0.1-layla-v4
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit