8.0 BPW EXL2 quant of https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-1.5B-v0.0 8bit heads. Default measurement dataset.

Downloads last month
1
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for MarsupialAI/EVA-Qwen2.5-1.5B-v0.0_EXL2_8.0BPW_H8

Base model

Qwen/Qwen2.5-1.5B
Quantized
(41)
this model