Export
The original model was exported using the following process:
THe following repos were used: - https://github.com/pdufour/Native-LLM-for-Android - https://github.com/pdufour/transformers.js/tree/add-block-list
If you close this repo and the above 2 to the same directory you can run the following commands:
From Qwen2-VL-2B-Instruct-ONNX-Q4-F16
:
make all-in-one
This will create an export of the onnx models.