Create EXPORT.md
Browse files
EXPORT.md
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Export
|
| 2 |
+
|
| 3 |
+
The original model was exported using the following process:
|
| 4 |
+
|
| 5 |
+
THe following repos were used:
|
| 6 |
+
- https://github.com/pdufour/Native-LLM-for-Android
|
| 7 |
+
- https://github.com/pdufour/transformers.js/tree/add-block-list
|
| 8 |
+
-
|
| 9 |
+
If you close this repo and the above 2 to the same directory you can run the following commands:
|
| 10 |
+
|
| 11 |
+
From `Qwen2-VL-2B-Instruct-ONNX-Q4-F16`:
|
| 12 |
+
`make all-in-one`
|
| 13 |
+
|
| 14 |
+
This will create an export of the onnx models.
|