Need some insight on the process of converting this to ONNX

#15

by BCenti - opened Mar 9, 2023

Mar 9, 2023

Hello, I really enjoyed this model and I've been trying to learn more about neural net and I wanted to convert this model to Onnx format for experimentation. I am wondering if you could provide some insight on what the process for converting this model be like, I would appreciate any tips you could offer.

Please and thank you kindly.

11b

Pygmalion org Mar 10, 2023

Hello!

I have not tried it personally, but I've seen a report from another user who used HuggingFace optimum and observed significant speedups after converting the model to an optimized ONNX graph through that library. The documentation there might be a good starting point.

BCenti

Mar 10, 2023

Thank you so much for the tip!

11b changed discussion status to closed Mar 17, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment