EXPERIMENTAL! Read information HERE for recommended settings to get the best results.

GGUF Quants of https://huggingface.co/Vdr1/MN-12B-Sunfall-v0.6.1-Lyra-v1

Downloads last month
22
GGUF
Model size
12.2B params
Architecture
llama

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .