How can I use it on multiple GPUs?

by aeminkocal - opened Jul 25, 2023

Jul 25, 2023

I used original Llama 2 13B on 3090 + 4090 System with torchrun with two nodes option. How can I run this in similar fashion? Also will there be a 13B version?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment