Q4_K_S GGUF for https://huggingface.co/MarsupialAI/Dumbstral-169B
No imat, no other quant schemes. This is all I'm willing to do for a model that nobody can reasonably run. FSM help Bartowski and Mradermacher if they choose to run full quant sets for this bastard.
- Downloads last month
- 67
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.