Re-add my commit with my best results (9d65f1419f0e87aa21be9fdf72ca8bcb9a395367) after adding a task tag 2928ca1 verified sfedar commited on Sep 11
End of training, 11 epochs, 4 batch size, writer batch size: 1000, 1 gradient accumulation steps, learning rate: 5e-05, 30 s 23dc514 verified sfedar commited on Sep 11
End of training, 10+1 epochs, 4 batch size, writer batch size: 1000, 1 gradient accumulation steps, learning rate: 5e-05, 30 s 9d65f14 verified sfedar commited on Sep 9