Failed to load external data file ""model_q4.onnx_data""
#2
by
RonanMcGovern
- opened
Any tips on avoiding this error? BTW tvm for these onnx models
Error: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Deserialize tensor model.layers.19.mlp.down_proj.MatMul.weight_Q4 failed.Failed to load external data file ""model_q4.onnx_data"", error: Module.MountedFiles is not available.
hm, that file is there and should be found as long it is next to model_q4.onnx.
Yeah, actually I'm getting this error on the onnx-community files too.
Looks like this issue is pervasive (except on static model_id = "onnx-community/Phi-3.5-mini-instruct-onnx-web"; for some reason). There are many open issues here.
On a related note, any idea why the system message seems to be excluded? Seems common in these "web" models...