File size: 874 Bytes
d06471f
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
Step 1 | loss:2.7997887134552 lr:2e-05 tokens_per_second_per_gpu:58.93894662593801 
Step 2 | loss:1.9635694026947021 lr:2e-05 tokens_per_second_per_gpu:206.09949463642906 
Step 3 | loss:1.9302600622177124 lr:2e-05 tokens_per_second_per_gpu:216.92945722999465 
Step 4 | loss:2.5740036964416504 lr:2e-05 tokens_per_second_per_gpu:221.10292263228686 
Step 5 | loss:2.0926806926727295 lr:2e-05 tokens_per_second_per_gpu:219.83932104406693 
Step 6 | loss:2.3473567962646484 lr:2e-05 tokens_per_second_per_gpu:213.56235556642372 
Step 7 | loss:2.1897239685058594 lr:2e-05 tokens_per_second_per_gpu:215.91101003805272 
Step 8 | loss:1.754281759262085 lr:2e-05 tokens_per_second_per_gpu:209.87727428872608 
Step 9 | loss:2.008831024169922 lr:2e-05 tokens_per_second_per_gpu:184.71083655140447 
Step 10 | loss:2.4670588970184326 lr:2e-05 tokens_per_second_per_gpu:216.0040750210692