First of all thank you for the effort of providing vicuna. I try to load the model with 54 GB CPU ram, but i still run out of memory. Shouldnt even 30 GB be enough?
According to official git repo of Vicuna the 30GB of memory is for 7B version.
· Sign up or log in to comment
