Writing logs to ./outputs/2024-03-22-01-16-17-693140/train_log.txt. Wrote original training args to ./outputs/2024-03-22-01-16-17-693140/training_args.json. ***** Running training ***** Num examples = 560000 Num epochs = 50 Num clean epochs = 50 Instantaneous batch size per device = 8 Total train batch size (w. parallel, distributed & accumulation) = 8 Gradient accumulation steps = 1 Total optimization steps = 3500000 ========================================================== Epoch 1 Running clean epoch 1/50 Train accuracy: 81.85% Eval accuracy: 88.42% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 2 Running clean epoch 2/50 Train accuracy: 88.95% Eval accuracy: 88.87% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 3 Running clean epoch 3/50 Train accuracy: 89.65% Eval accuracy: 89.58% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 4 Running clean epoch 4/50 Train accuracy: 90.02% Eval accuracy: 89.53% ========================================================== Epoch 5 Running clean epoch 5/50 Train accuracy: 90.22% Eval accuracy: 89.73% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 6 Running clean epoch 6/50 Train accuracy: 90.43% Eval accuracy: 89.60% ========================================================== Epoch 7 Running clean epoch 7/50 Train accuracy: 90.64% Eval accuracy: 89.83% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 8 Running clean epoch 8/50 Train accuracy: 90.79% Eval accuracy: 90.04% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 9 Running clean epoch 9/50 Train accuracy: 90.97% Eval accuracy: 90.22% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 10 Running clean epoch 10/50 Train accuracy: 91.16% Eval accuracy: 90.33% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 11 Running clean epoch 11/50 Train accuracy: 91.37% Eval accuracy: 90.50% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 12 Running clean epoch 12/50 Train accuracy: 91.58% Eval accuracy: 90.42% ========================================================== Epoch 13 Running clean epoch 13/50 Train accuracy: 91.81% Eval accuracy: 90.64% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 14 Running clean epoch 14/50 Train accuracy: 92.01% Eval accuracy: 90.71% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 15 Running clean epoch 15/50 Train accuracy: 92.23% Eval accuracy: 90.88% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 16 Running clean epoch 16/50 Train accuracy: 92.41% Eval accuracy: 90.95% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 17 Running clean epoch 17/50 Train accuracy: 92.59% Eval accuracy: 90.72% ========================================================== Epoch 18 Running clean epoch 18/50 Train accuracy: 92.78% Eval accuracy: 91.12% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 19 Running clean epoch 19/50 Train accuracy: 92.97% Eval accuracy: 91.19% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 20 Running clean epoch 20/50 Train accuracy: 93.12% Eval accuracy: 91.43% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 21 Running clean epoch 21/50 Train accuracy: 93.28% Eval accuracy: 91.47% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 22 Running clean epoch 22/50 Train accuracy: 93.42% Eval accuracy: 91.52% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 23 Running clean epoch 23/50 Train accuracy: 93.54% Eval accuracy: 91.71% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 24 Running clean epoch 24/50 Train accuracy: 93.69% Eval accuracy: 91.61% ========================================================== Epoch 25 Running clean epoch 25/50 Train accuracy: 93.86% Eval accuracy: 91.69% ========================================================== Epoch 26 Running clean epoch 26/50 Train accuracy: 93.98% Eval accuracy: 91.63% ========================================================== Epoch 27 Running clean epoch 27/50 Train accuracy: 94.12% Eval accuracy: 91.57% ========================================================== Epoch 28 Running clean epoch 28/50 Train accuracy: 94.24% Eval accuracy: 91.74% Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ ========================================================== Epoch 29 Running clean epoch 29/50 Train accuracy: 94.37% Eval accuracy: 91.73% ========================================================== Epoch 30 Running clean epoch 30/50 Train accuracy: 94.47% Eval accuracy: 91.45% ========================================================== Epoch 31 Running clean epoch 31/50 Train accuracy: 94.62% Eval accuracy: 91.34% ========================================================== Epoch 32 Running clean epoch 32/50 Train accuracy: 94.72% Eval accuracy: 91.58% ========================================================== Epoch 33 Running clean epoch 33/50 Train accuracy: 94.86% Eval accuracy: 91.61% ========================================================== Epoch 34 Running clean epoch 34/50 Train accuracy: 94.96% Eval accuracy: 91.70% ========================================================== Epoch 35 Running clean epoch 35/50 Train accuracy: 95.06% Eval accuracy: 91.65% ========================================================== Epoch 36 Running clean epoch 36/50 Train accuracy: 95.17% Eval accuracy: 91.71% ========================================================== Epoch 37 Running clean epoch 37/50 Train accuracy: 95.28% Eval accuracy: 91.58% ========================================================== Epoch 38 Running clean epoch 38/50 Train accuracy: 95.37% Eval accuracy: 91.52% ========================================================== Epoch 39 Running clean epoch 39/50 Train accuracy: 95.49% Eval accuracy: 91.10% ========================================================== Epoch 40 Running clean epoch 40/50 Train accuracy: 95.58% Eval accuracy: 91.54% ========================================================== Epoch 41 Running clean epoch 41/50 Train accuracy: 95.68% Eval accuracy: 91.37% ========================================================== Epoch 42 Running clean epoch 42/50 Train accuracy: 95.76% Eval accuracy: 91.34% ========================================================== Epoch 43 Running clean epoch 43/50 Train accuracy: 95.85% Eval accuracy: 91.01% ========================================================== Epoch 44 Running clean epoch 44/50 Train accuracy: 95.95% Eval accuracy: 91.35% ========================================================== Epoch 45 Running clean epoch 45/50 Train accuracy: 96.03% Eval accuracy: 91.23% ========================================================== Epoch 46 Running clean epoch 46/50 Train accuracy: 96.10% Eval accuracy: 91.19% ========================================================== Epoch 47 Running clean epoch 47/50 Train accuracy: 96.18% Eval accuracy: 91.14% ========================================================== Epoch 48 Running clean epoch 48/50 Train accuracy: 96.29% Eval accuracy: 91.27% ========================================================== Epoch 49 Running clean epoch 49/50 Train accuracy: 96.39% Eval accuracy: 91.14% ========================================================== Epoch 50 Running clean epoch 50/50 Train accuracy: 96.46% Eval accuracy: 91.11% Wrote README to ./outputs/2024-03-22-01-16-17-693140/README.md.