Convert from stabilityai/stablelm-2-1_6b and BNB 4 bits quantized.

Require onnxruntime>=0.17.0

Downloads last month
8
Inference Examples
Inference API (serverless) does not yet support transformers.js models for this pipeline type.

Collection including BricksDisplay/stablelm-2-1_6b-bnb4