magnum-v2-4b
ExLlamav2 8 bpw quants of https://huggingface.co/anthracite-org/magnum-v2-4b
- Downloads last month
- 6
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model authors have turned it off explicitly.
Model tree for altomek/magnum-v2-4b-8bpw-EXL2
Base model
nvidia/Llama-3.1-Minitron-4B-Width-Base
Finetuned
anthracite-org/magnum-v2-4b