Apple M1/M2/M3 - Metal
#1
by
christianweyer
- opened
Do you have an example to run this on Metal / MPS?
Thanks!
christianweyer
changed discussion title from
Apple M1/M2/M3 - Meta
to Apple M1/M2/M3 - Metal
Hi Chris, I will work on it! I will let you know once we did it.
Do you have an example to run this on Metal / MPS?
Thanks!
alexchen4ai
changed discussion status to
closed
alexchen4ai
changed discussion status to
open
https://huggingface.co/NexaAIDev/octopus-v4-gguf
Hi Chris, please check out this link. Consider to use GGUF and ollama to run it on your computer. To utilize the M chip better, we still need more time to optimize it.
BTW: Would be nice to have an official model in the Ollama registry from you guys.
https://ollama.com/search?q=octo&p=1