Shutting down servers during fine-tuning
#73
by
yjok0220
- opened
My server GPU specs are like this: fine-tuning version 2b of GEMMA on my server finishes fine, but when I fine-tune version 7b, the server suddenly crashes. Is this a problem caused by insufficient specifications?
i have the same issue
Hi
@yjok0220
and
@Aniketnew7
, The crashes you are experiencing when fine tuning the 7B model likely results from insufficient GPU resources on your sever. Fine-tuning larger models requires significantly more computational power, memory (both GPU and CPU), and storage than smaller models. Kindly check in server , you need to have adequate GPU memory, system RAM, disk space, and proper cooling and power supply.
Kindly try and let me know if you have still issue is persists.