| Writing logs to ./outputs/2024-03-22-01-16-17-693140/train_log.txt. | |
| Wrote original training args to ./outputs/2024-03-22-01-16-17-693140/training_args.json. | |
| ***** Running training ***** | |
| Num examples = 560000 | |
| Num epochs = 50 | |
| Num clean epochs = 50 | |
| Instantaneous batch size per device = 8 | |
| Total train batch size (w. parallel, distributed & accumulation) = 8 | |
| Gradient accumulation steps = 1 | |
| Total optimization steps = 3500000 | |
| ========================================================== | |
| Epoch 1 | |
| Running clean epoch 1/50 | |
| Train accuracy: 81.85% | |
| Eval accuracy: 88.42% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 2 | |
| Running clean epoch 2/50 | |
| Train accuracy: 88.95% | |
| Eval accuracy: 88.87% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 3 | |
| Running clean epoch 3/50 | |
| Train accuracy: 89.65% | |
| Eval accuracy: 89.58% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 4 | |
| Running clean epoch 4/50 | |
| Train accuracy: 90.02% | |
| Eval accuracy: 89.53% | |
| ========================================================== | |
| Epoch 5 | |
| Running clean epoch 5/50 | |
| Train accuracy: 90.22% | |
| Eval accuracy: 89.73% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 6 | |
| Running clean epoch 6/50 | |
| Train accuracy: 90.43% | |
| Eval accuracy: 89.60% | |
| ========================================================== | |
| Epoch 7 | |
| Running clean epoch 7/50 | |
| Train accuracy: 90.64% | |
| Eval accuracy: 89.83% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 8 | |
| Running clean epoch 8/50 | |
| Train accuracy: 90.79% | |
| Eval accuracy: 90.04% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 9 | |
| Running clean epoch 9/50 | |
| Train accuracy: 90.97% | |
| Eval accuracy: 90.22% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 10 | |
| Running clean epoch 10/50 | |
| Train accuracy: 91.16% | |
| Eval accuracy: 90.33% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 11 | |
| Running clean epoch 11/50 | |
| Train accuracy: 91.37% | |
| Eval accuracy: 90.50% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 12 | |
| Running clean epoch 12/50 | |
| Train accuracy: 91.58% | |
| Eval accuracy: 90.42% | |
| ========================================================== | |
| Epoch 13 | |
| Running clean epoch 13/50 | |
| Train accuracy: 91.81% | |
| Eval accuracy: 90.64% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 14 | |
| Running clean epoch 14/50 | |
| Train accuracy: 92.01% | |
| Eval accuracy: 90.71% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 15 | |
| Running clean epoch 15/50 | |
| Train accuracy: 92.23% | |
| Eval accuracy: 90.88% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 16 | |
| Running clean epoch 16/50 | |
| Train accuracy: 92.41% | |
| Eval accuracy: 90.95% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 17 | |
| Running clean epoch 17/50 | |
| Train accuracy: 92.59% | |
| Eval accuracy: 90.72% | |
| ========================================================== | |
| Epoch 18 | |
| Running clean epoch 18/50 | |
| Train accuracy: 92.78% | |
| Eval accuracy: 91.12% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 19 | |
| Running clean epoch 19/50 | |
| Train accuracy: 92.97% | |
| Eval accuracy: 91.19% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 20 | |
| Running clean epoch 20/50 | |
| Train accuracy: 93.12% | |
| Eval accuracy: 91.43% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 21 | |
| Running clean epoch 21/50 | |
| Train accuracy: 93.28% | |
| Eval accuracy: 91.47% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 22 | |
| Running clean epoch 22/50 | |
| Train accuracy: 93.42% | |
| Eval accuracy: 91.52% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 23 | |
| Running clean epoch 23/50 | |
| Train accuracy: 93.54% | |
| Eval accuracy: 91.71% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 24 | |
| Running clean epoch 24/50 | |
| Train accuracy: 93.69% | |
| Eval accuracy: 91.61% | |
| ========================================================== | |
| Epoch 25 | |
| Running clean epoch 25/50 | |
| Train accuracy: 93.86% | |
| Eval accuracy: 91.69% | |
| ========================================================== | |
| Epoch 26 | |
| Running clean epoch 26/50 | |
| Train accuracy: 93.98% | |
| Eval accuracy: 91.63% | |
| ========================================================== | |
| Epoch 27 | |
| Running clean epoch 27/50 | |
| Train accuracy: 94.12% | |
| Eval accuracy: 91.57% | |
| ========================================================== | |
| Epoch 28 | |
| Running clean epoch 28/50 | |
| Train accuracy: 94.24% | |
| Eval accuracy: 91.74% | |
| Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/ | |
| ========================================================== | |
| Epoch 29 | |
| Running clean epoch 29/50 | |
| Train accuracy: 94.37% | |
| Eval accuracy: 91.73% | |
| ========================================================== | |
| Epoch 30 | |
| Running clean epoch 30/50 | |
| Train accuracy: 94.47% | |
| Eval accuracy: 91.45% | |
| ========================================================== | |
| Epoch 31 | |
| Running clean epoch 31/50 | |
| Train accuracy: 94.62% | |
| Eval accuracy: 91.34% | |
| ========================================================== | |
| Epoch 32 | |
| Running clean epoch 32/50 | |
| Train accuracy: 94.72% | |
| Eval accuracy: 91.58% | |
| ========================================================== | |
| Epoch 33 | |
| Running clean epoch 33/50 | |
| Train accuracy: 94.86% | |
| Eval accuracy: 91.61% | |
| ========================================================== | |
| Epoch 34 | |
| Running clean epoch 34/50 | |
| Train accuracy: 94.96% | |
| Eval accuracy: 91.70% | |
| ========================================================== | |
| Epoch 35 | |
| Running clean epoch 35/50 | |
| Train accuracy: 95.06% | |
| Eval accuracy: 91.65% | |
| ========================================================== | |
| Epoch 36 | |
| Running clean epoch 36/50 | |
| Train accuracy: 95.17% | |
| Eval accuracy: 91.71% | |
| ========================================================== | |
| Epoch 37 | |
| Running clean epoch 37/50 | |
| Train accuracy: 95.28% | |
| Eval accuracy: 91.58% | |
| ========================================================== | |
| Epoch 38 | |
| Running clean epoch 38/50 | |
| Train accuracy: 95.37% | |
| Eval accuracy: 91.52% | |
| ========================================================== | |
| Epoch 39 | |
| Running clean epoch 39/50 | |
| Train accuracy: 95.49% | |
| Eval accuracy: 91.10% | |
| ========================================================== | |
| Epoch 40 | |
| Running clean epoch 40/50 | |
| Train accuracy: 95.58% | |
| Eval accuracy: 91.54% | |
| ========================================================== | |
| Epoch 41 | |
| Running clean epoch 41/50 | |
| Train accuracy: 95.68% | |
| Eval accuracy: 91.37% | |
| ========================================================== | |
| Epoch 42 | |
| Running clean epoch 42/50 | |
| Train accuracy: 95.76% | |
| Eval accuracy: 91.34% | |
| ========================================================== | |
| Epoch 43 | |
| Running clean epoch 43/50 | |
| Train accuracy: 95.85% | |
| Eval accuracy: 91.01% | |
| ========================================================== | |
| Epoch 44 | |
| Running clean epoch 44/50 | |
| Train accuracy: 95.95% | |
| Eval accuracy: 91.35% | |
| ========================================================== | |
| Epoch 45 | |
| Running clean epoch 45/50 | |
| Train accuracy: 96.03% | |
| Eval accuracy: 91.23% | |
| ========================================================== | |
| Epoch 46 | |
| Running clean epoch 46/50 | |
| Train accuracy: 96.10% | |
| Eval accuracy: 91.19% | |
| ========================================================== | |
| Epoch 47 | |
| Running clean epoch 47/50 | |
| Train accuracy: 96.18% | |
| Eval accuracy: 91.14% | |
| ========================================================== | |
| Epoch 48 | |
| Running clean epoch 48/50 | |
| Train accuracy: 96.29% | |
| Eval accuracy: 91.27% | |
| ========================================================== | |
| Epoch 49 | |
| Running clean epoch 49/50 | |
| Train accuracy: 96.39% | |
| Eval accuracy: 91.14% | |
| ========================================================== | |
| Epoch 50 | |
| Running clean epoch 50/50 | |
| Train accuracy: 96.46% | |
| Eval accuracy: 91.11% | |
| Wrote README to ./outputs/2024-03-22-01-16-17-693140/README.md. | |