CPU without GPU - usage requirements & optimization

#41

by famoustm - opened 15 days ago

15 days ago

If you're going to use CPU & RAM only without a GPU, what can be done to optimize the speed of running llama as an api?

Thanks in advance

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment