Triton error while running demo code

#11
by chiauho - opened
Hugging Face 1Bit LLMs org

Hi, I am new to this. While running the demo code, I encountered this error:

raise BackendCompilerFailed(self.compiler_fn, e) from e
torch._dynamo.exc.BackendCompilerFailed: backend='inductor' raised:
RuntimeError: Cannot find a working triton installation. Either the package is not installed or it is too old. More information on installing Triton can be found at https://github.com/openai/triton

Checking up on Triton, I found it seems to only run on Unix, while mine is on Windows. Is this the real issue or is it something else.
I installed the latest transformers from github.com version 4.46.0

Appreciate any help. Thank you all.

Hugging Face 1Bit LLMs org
edited 20 days ago

Hi, Yes according to triton docs it's not compatible with windows for now, If you want to try the code you can try it using wsl or on a google colab for example

Hugging Face 1Bit LLMs org

ok, thank you very much.

Sign up or log in to comment