microsoft

/

Phi-4-multimodal-instruct-onnx

like 58

Follow

Microsoft 10.3k

Im having some problems running the model on my osx arm device. After following the tutorial (many times) for building the cpu version, this is the result I get:

phi4mm_take2 on main ? ❯ uv run phi4-mm.py -m ./cpu -e cpu                                                                                                        
Loading model...
Traceback (most recent call last):
  File "/Users/klnstpr/Code/efecte/phi4mm_take2/phi4-mm.py", line 211, in <module>
    run(args)
    ~~~^^^^^^
  File "/Users/klnstpr/Code/efecte/phi4mm_take2/phi4-mm.py", line 64, in run
    model = og.Model(config)
RuntimeError: Load model from ./cpu/ failed:Protobuf parsing failed.

Anyone has successfully converted to onnx and ran the model on Apple silicon?