how to run
#1
by
cachro2
- opened
Any preferred UI for running pixtral exl12? would be great if exui supported images.
cachro2
changed discussion status to
closed
cachro2
changed discussion status to
open
you can either use tabbyAPI to run it directly under a openai api compatible server or if you want to use the exllama library directly, you can take a look at the example from the github at exllamav2/examples/multimodal.py