microsoft

/

Mistral-7B-v0.1-onnx

like 12

Follow

Microsoft 6.93k

I'm running Python 3.8.19, transformers 4.42.3, onnx 1.16.1, & onnxruntime 1.18.1 however when I try to run the model using the code snippet on the model card I get a Onnxruntime error of:

Fail: [ONNXRuntimeError] : 1 : FAIL : Deserialize tensor model.layers.31.attn.o_proj.MatMul.weight failed.GetFileLength for ./Mistral-7B-v0.1.onnx.data failed:Invalid fd was supplied: -1

Any thoughts?