can this model run on just CPU and RAM?
#3
by
Joe993
- opened
I have been using Google Colab and have successfully run it using GPU, but when I try to use only the CPU and RAM, then I get this the error message:
ImportError: Using bitsandbytes 8-bit quantization requires Accelerate: pip install accelerate and the latest version of bitsandbytes: pip install -i https://pypi.org/simple/ bitsandbytes
even though I have them both installed
I just want to know if it's possible or not to make this work on just CPU and RAM? if it is, then can someone show me the steps of how to do so?