YuE-s1-7B-anneal-en-cot-exl2
m-a-p/YuE-s1-7B-anneal-en-cot quantized with Exllamav2. It appears to remain coherent using the default calibration data without adding audio tokens.
Intended to be used with the WIP exl2 inference repository for YuE.
Links:
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for Doctor-Shotgun/YuE-s1-7B-anneal-en-cot-exl2
Base model
m-a-p/YuE-s1-7B-anneal-en-cot