Cuda error with ooba-booga WebUI
Not sure why it's doing this? It's recognizing the gpu but it's saying the CUDA extension isn't installed and it causes it to not work. I have a 2060 super.
Here's the error:
CUDA SETUP: CUDA runtime path found: C:\Users\user\Documents\oobabooga-windows\installer_files\env\bin\cudart64_110.dll
CUDA SETUP: Highest compute capability among GPUs detected: 7.5
CUDA SETUP: Detected CUDA version 117
CUDA SETUP: Loading binary C:\Users\user\Documents\oobabooga-windows\installer_files\env\lib\site-packages\bitsandbytes\libbitsandbytes_cuda117.dll...
Loading anon8231489123_gpt4-x-alpaca-13b-native-4bit-128g...
CUDA extension not installed.
Loading model ...
Done.
Maybe it's a problem with ooba?
I think thats related to the way oobaboogie is installed. I did a clean install of it in a new folder and the cuda exension error went poof. :D
I think thats related to the way oobaboogie is installed. I did a clean install of it in a new folder and the cuda exension error went poof. :D
Oh great, I will try that thanks!
Hey did you manage to fix this? I'm currently facing the same problem