iMatrix GGUFs for https://huggingface.co/Undi95/MG-FinalMix-72B

imat generated with Kalomaxe's groups_merged.txt

Downloads last month
942
GGUF
Model size
72.7B params
Architecture
qwen2
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for MarsupialAI/MG-FinalMix-72B_iMatrix_GGUF