YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
EXL2 quants of Smaug-72B-v0.1.
Couldn't find a description of the prompt format, but it looks like OpenChat?
2.50 bits per weight (may be a little broken?)
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.