hi, thank you for your awesome work. There are some doubts about the training batch size in the paper. Does it refer to per device batch size or total batch size? And how many A100 80G are required for training？Looking forward to your reply!
· Sign up or log in to comment
