Will this model work in OobaBooga (text-generation-webui) on a single 4090 card system with any settings?

by cleverest - opened Aug 14, 2023

Aug 14, 2023

Is this possible with some settings, checking CPU to offload some...anyway to optimize it further, etc..?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment