Help with RAM and VRAM requirements
#1
by
akshaaayyy
- opened
Hi,
could you help me with the RAM and VRAM requirements to run the model branch : 'gptq-3bit--1g-actorder_True'
I have a RTX 3070 with 7GB usable VRAM and 20GB usable RAM.
Unless you want to wait for a very long time for the AI to answer I would recommend you to rent a powerful GPU instead. Vast.ai is the cheapest I found so far. Go for 2X RTX 3090 for a total of 48 gig. It will cost around 50-60 cents per hour. (Price fluctuate wildly...)