Quantized Model in GGML of: https://huggingface.co/zarakiquemparte/hermeslimarp-l2-7b
If you need other quantized models use @TheBloke:
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.