See the full model card here: https://huggingface.co/sophosympatheia/Midnight-Miqu-70B-v1.0 6.0bpw version, using default calibration dataset, for the 72gb chads
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.