Hugging Face's logo

axolotl-quants
/
DeepSeek-V2.5-bnb-nf4-bf16

Safetensors
deepseek_v2
custom_code
4-bit precision
bitsandbytes
Model card Files Community
1
New discussion

What engine should be used to infer this model?
#1 opened 2 months ago by RobertLiu0905