The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling `transformers.utils.move_cache()`.

0it [00:00, ?it/s]
0it [00:00, ?it/s]
/opt/conda/lib/python3.10/site-packages/transformers/deepspeed.py:23: FutureWarning: transformers.deepspeed module is deprecated and will be removed in a future version. Please import deepspeed modules directly from transformers.integrations
  warnings.warn(
2024-07-01 06:29:39.261540: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-07-01 06:29:39.261717: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-07-01 06:29:39.402767: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
/opt/conda/lib/python3.10/site-packages/datasets/load.py:929: FutureWarning: The repository for data contains custom code which must be executed to correctly load the dataset. You can inspect the repository content at /kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/data_interface/data.py
You can avoid this message in future by passing the argument `trust_remote_code=True`.
Passing `trust_remote_code=True` will be mandatory to load this dataset from the next major release of `datasets`.
  warnings.warn(

Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 401 examples [00:00, 7281.18 examples/s]

Running tokenizer on train dataset:   0%|          | 0/401 [00:00<?, ? examples/s]
Running tokenizer on train dataset: 100%|██████████| 401/401 [00:00<00:00, 1591.36 examples/s]
Running tokenizer on train dataset: 100%|██████████| 401/401 [00:00<00:00, 1573.97 examples/s]
Saving cached train data ...

Saving the dataset (0/1 shards):   0%|          | 0/401 [00:00<?, ? examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 401/401 [00:00<00:00, 102850.60 examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 401/401 [00:00<00:00, 98455.53 examples/s] 
/opt/conda/lib/python3.10/site-packages/transformers/optimization.py:588: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning
  warnings.warn(
All 65536 steps, warm_up steps: 200
wandb: WARNING The `run_name` is currently set to the same value as `TrainingArguments.output_dir`. If this was not intended, please specify a different run name by setting the `TrainingArguments.run_name` parameter.
wandb: Currently logged in as: abdiharyadi. Use `wandb login --relogin` to force relogin
wandb: wandb version 0.17.3 is available!  To upgrade, please run:
wandb:  $ pip install wandb --upgrade
wandb: Tracking run with wandb version 0.17.0
wandb: Run data is saved locally in /kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/wandb/run-20240701_062953-dxv8icy8
wandb: Run `wandb offline` to turn off syncing.
wandb: Syncing run /kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/../outputs/indoamrbart-mbart-fted
wandb: ⭐️ View project at https://wandb.ai/abdiharyadi/huggingface
wandb: 🚀 View run at https://wandb.ai/abdiharyadi/huggingface/runs/dxv8icy8

  0%|          | 0/65536 [00:00<?, ?it/s]/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

  0%|          | 1/65536 [00:01<29:53:28,  1.64s/it]
                                                    
{'loss': 5.1405, 'learning_rate': 5e-09, 'epoch': 0.06}

  0%|          | 1/65536 [00:01<29:53:28,  1.64s/it]
  0%|          | 2/65536 [00:02<19:23:05,  1.06s/it]
  0%|          | 3/65536 [00:02<15:46:59,  1.15it/s]
  0%|          | 4/65536 [00:03<14:46:21,  1.23it/s]
  0%|          | 5/65536 [00:04<14:16:07,  1.28it/s]
  0%|          | 6/65536 [00:05<13:37:42,  1.34it/s]
  0%|          | 7/65536 [00:05<13:16:10,  1.37it/s]
  0%|          | 8/65536 [00:06<12:43:23,  1.43it/s]
  0%|          | 9/65536 [00:07<12:29:37,  1.46it/s]
  0%|          | 10/65536 [00:07<12:45:54,  1.43it/s]
  0%|          | 11/65536 [00:08<12:24:54,  1.47it/s]
  0%|          | 12/65536 [00:09<11:59:46,  1.52it/s]
  0%|          | 13/65536 [00:09<12:04:16,  1.51it/s]
  0%|          | 14/65536 [00:10<11:53:30,  1.53it/s]
  0%|          | 15/65536 [00:11<12:08:08,  1.50it/s]
  0%|          | 16/65536 [00:11<12:06:05,  1.50it/s]
  0%|          | 17/65536 [00:12<12:33:28,  1.45it/s]
  0%|          | 18/65536 [00:13<12:48:14,  1.42it/s]
  0%|          | 19/65536 [00:13<12:07:49,  1.50it/s]
  0%|          | 20/65536 [00:14<11:52:32,  1.53it/s]
                                                     
{'loss': 5.203, 'learning_rate': 1e-07, 'epoch': 1.23}

  0%|          | 20/65536 [00:14<11:52:32,  1.53it/s]
  0%|          | 21/65536 [00:15<12:16:07,  1.48it/s]
  0%|          | 22/65536 [00:15<12:22:03,  1.47it/s]
  0%|          | 23/65536 [00:16<12:19:20,  1.48it/s]
  0%|          | 24/65536 [00:17<12:08:50,  1.50it/s]
  0%|          | 25/65536 [00:17<12:12:55,  1.49it/s]
  0%|          | 26/65536 [00:18<12:10:52,  1.49it/s]
  0%|          | 27/65536 [00:19<12:03:12,  1.51it/s]
  0%|          | 28/65536 [00:19<12:18:18,  1.48it/s]
  0%|          | 29/65536 [00:20<12:22:08,  1.47it/s]
  0%|          | 30/65536 [00:21<12:35:12,  1.45it/s]
  0%|          | 31/65536 [00:21<12:14:36,  1.49it/s]
  0%|          | 32/65536 [00:22<12:18:18,  1.48it/s]
  0%|          | 33/65536 [00:23<12:35:02,  1.45it/s]
  0%|          | 34/65536 [00:23<12:31:34,  1.45it/s]
  0%|          | 35/65536 [00:24<12:53:04,  1.41it/s]
  0%|          | 36/65536 [00:25<12:41:19,  1.43it/s]
  0%|          | 37/65536 [00:26<12:23:19,  1.47it/s]
  0%|          | 38/65536 [00:26<12:11:10,  1.49it/s]
  0%|          | 39/65536 [00:27<11:54:50,  1.53it/s]
  0%|          | 40/65536 [00:27<11:47:33,  1.54it/s]
                                                     
{'loss': 4.9675, 'learning_rate': 2e-07, 'epoch': 2.47}

  0%|          | 40/65536 [00:27<11:47:33,  1.54it/s]
  0%|          | 41/65536 [00:28<11:57:31,  1.52it/s]
  0%|          | 42/65536 [00:29<12:07:59,  1.50it/s]
  0%|          | 43/65536 [00:29<12:13:12,  1.49it/s]
  0%|          | 44/65536 [00:30<12:16:11,  1.48it/s]
  0%|          | 45/65536 [00:31<12:08:17,  1.50it/s]
  0%|          | 46/65536 [00:31<12:12:59,  1.49it/s]
  0%|          | 47/65536 [00:32<11:59:37,  1.52it/s]
  0%|          | 48/65536 [00:33<12:10:38,  1.49it/s]
  0%|          | 49/65536 [00:34<12:26:43,  1.46it/s]
  0%|          | 50/65536 [00:34<12:02:21,  1.51it/s]
  0%|          | 51/65536 [00:35<11:50:07,  1.54it/s]
  0%|          | 52/65536 [00:35<11:55:59,  1.52it/s]
  0%|          | 53/65536 [00:36<12:13:47,  1.49it/s]
  0%|          | 54/65536 [00:37<12:03:41,  1.51it/s]
  0%|          | 55/65536 [00:37<12:14:43,  1.49it/s]
  0%|          | 56/65536 [00:38<12:36:39,  1.44it/s]
  0%|          | 57/65536 [00:39<12:26:50,  1.46it/s]
  0%|          | 58/65536 [00:40<12:14:50,  1.49it/s]
  0%|          | 59/65536 [00:40<12:21:45,  1.47it/s]
  0%|          | 60/65536 [00:41<12:19:13,  1.48it/s]
                                                     
{'loss': 4.4002, 'learning_rate': 3e-07, 'epoch': 3.7}

  0%|          | 60/65536 [00:41<12:19:13,  1.48it/s]
  0%|          | 61/65536 [00:42<12:12:35,  1.49it/s]
  0%|          | 62/65536 [00:42<12:13:59,  1.49it/s]
  0%|          | 63/65536 [00:43<12:07:23,  1.50it/s]
  0%|          | 64/65536 [00:44<12:15:30,  1.48it/s]
  0%|          | 65/65536 [00:44<12:31:32,  1.45it/s]
  0%|          | 66/65536 [00:45<12:25:40,  1.46it/s]
  0%|          | 67/65536 [00:46<12:36:57,  1.44it/s]
  0%|          | 68/65536 [00:46<12:22:28,  1.47it/s]
  0%|          | 69/65536 [00:47<12:16:51,  1.48it/s]
  0%|          | 70/65536 [00:48<12:07:30,  1.50it/s]
  0%|          | 71/65536 [00:48<12:09:27,  1.50it/s]
  0%|          | 72/65536 [00:49<12:17:21,  1.48it/s]
  0%|          | 73/65536 [00:50<12:10:44,  1.49it/s]
  0%|          | 74/65536 [00:50<12:02:38,  1.51it/s]
  0%|          | 75/65536 [00:51<11:58:53,  1.52it/s]
  0%|          | 76/65536 [00:52<12:13:28,  1.49it/s]
  0%|          | 77/65536 [00:52<11:53:57,  1.53it/s]
  0%|          | 78/65536 [00:53<12:19:57,  1.47it/s]
  0%|          | 79/65536 [00:54<11:51:37,  1.53it/s]
  0%|          | 80/65536 [00:54<12:17:39,  1.48it/s]
                                                     
{'loss': 4.1191, 'learning_rate': 4e-07, 'epoch': 4.94}

  0%|          | 80/65536 [00:54<12:17:39,  1.48it/s]
  0%|          | 81/65536 [00:55<12:18:47,  1.48it/s]
  0%|          | 82/65536 [00:56<12:49:11,  1.42it/s]
  0%|          | 83/65536 [00:56<12:26:54,  1.46it/s]
  0%|          | 84/65536 [00:57<12:10:21,  1.49it/s]
  0%|          | 85/65536 [00:58<12:09:36,  1.50it/s]
  0%|          | 86/65536 [00:58<12:00:13,  1.51it/s]
  0%|          | 87/65536 [00:59<12:17:45,  1.48it/s]
  0%|          | 88/65536 [01:00<12:23:22,  1.47it/s]
  0%|          | 89/65536 [01:00<12:02:15,  1.51it/s]
  0%|          | 90/65536 [01:01<11:59:42,  1.52it/s]
  0%|          | 91/65536 [01:02<12:12:39,  1.49it/s]
  0%|          | 92/65536 [01:02<12:19:41,  1.47it/s]
  0%|          | 93/65536 [01:03<12:05:48,  1.50it/s]
  0%|          | 94/65536 [01:04<12:32:04,  1.45it/s]
  0%|          | 95/65536 [01:04<12:29:37,  1.45it/s]
  0%|          | 96/65536 [01:05<12:15:45,  1.48it/s]
  0%|          | 97/65536 [01:06<12:00:00,  1.51it/s]
  0%|          | 98/65536 [01:06<12:10:48,  1.49it/s]
  0%|          | 99/65536 [01:07<12:11:55,  1.49it/s]
  0%|          | 100/65536 [01:08<12:31:36,  1.45it/s]
                                                      
{'loss': 3.938, 'learning_rate': 5e-07, 'epoch': 6.17}

  0%|          | 100/65536 [01:08<12:31:36,  1.45it/s]
  0%|          | 101/65536 [01:08<12:12:37,  1.49it/s]
  0%|          | 102/65536 [01:09<12:06:46,  1.50it/s]
  0%|          | 103/65536 [01:10<12:01:04,  1.51it/s]
  0%|          | 104/65536 [01:10<12:07:54,  1.50it/s]
  0%|          | 105/65536 [01:11<11:44:55,  1.55it/s]
  0%|          | 106/65536 [01:12<11:55:23,  1.52it/s]
  0%|          | 107/65536 [01:12<11:58:24,  1.52it/s]
  0%|          | 108/65536 [01:13<12:01:51,  1.51it/s]
  0%|          | 109/65536 [01:14<12:11:17,  1.49it/s]
  0%|          | 110/65536 [01:14<12:09:19,  1.50it/s]
  0%|          | 111/65536 [01:15<12:17:42,  1.48it/s]
  0%|          | 112/65536 [01:16<12:28:45,  1.46it/s]
  0%|          | 113/65536 [01:17<12:19:32,  1.47it/s]
  0%|          | 114/65536 [01:17<12:46:36,  1.42it/s]
  0%|          | 115/65536 [01:18<12:29:19,  1.46it/s]
  0%|          | 116/65536 [01:19<12:22:12,  1.47it/s]
  0%|          | 117/65536 [01:19<12:04:23,  1.51it/s]
  0%|          | 118/65536 [01:20<11:51:51,  1.53it/s]
  0%|          | 119/65536 [01:21<12:15:57,  1.48it/s]
  0%|          | 120/65536 [01:21<12:11:21,  1.49it/s]
                                                      
{'loss': 3.6329, 'learning_rate': 6e-07, 'epoch': 7.41}

  0%|          | 120/65536 [01:21<12:11:21,  1.49it/s]
  0%|          | 121/65536 [01:22<12:09:43,  1.49it/s]
  0%|          | 122/65536 [01:23<12:11:03,  1.49it/s]
  0%|          | 123/65536 [01:23<12:09:23,  1.49it/s]
  0%|          | 124/65536 [01:24<12:21:48,  1.47it/s]
  0%|          | 125/65536 [01:25<12:25:25,  1.46it/s]
  0%|          | 126/65536 [01:25<12:43:03,  1.43it/s]
  0%|          | 127/65536 [01:26<12:41:30,  1.43it/s]
  0%|          | 128/65536 [01:27<12:33:28,  1.45it/s]
  0%|          | 129/65536 [01:27<12:27:50,  1.46it/s]
  0%|          | 130/65536 [01:28<12:23:28,  1.47it/s]
  0%|          | 131/65536 [01:29<12:07:00,  1.50it/s]
  0%|          | 132/65536 [01:29<11:59:46,  1.51it/s]
  0%|          | 133/65536 [01:30<12:11:51,  1.49it/s]
  0%|          | 134/65536 [01:31<12:12:26,  1.49it/s]
  0%|          | 135/65536 [01:31<12:09:30,  1.49it/s]
  0%|          | 136/65536 [01:32<12:16:58,  1.48it/s]
  0%|          | 137/65536 [01:33<12:14:57,  1.48it/s]
  0%|          | 138/65536 [01:33<12:16:54,  1.48it/s]
  0%|          | 139/65536 [01:34<12:10:24,  1.49it/s]
  0%|          | 140/65536 [01:35<12:11:31,  1.49it/s]
                                                      
{'loss': 3.428, 'learning_rate': 7e-07, 'epoch': 8.64}

  0%|          | 140/65536 [01:35<12:11:31,  1.49it/s]
  0%|          | 141/65536 [01:35<12:09:23,  1.49it/s]
  0%|          | 142/65536 [01:36<12:10:21,  1.49it/s]
  0%|          | 143/65536 [01:37<12:18:47,  1.48it/s]
  0%|          | 144/65536 [01:37<12:01:59,  1.51it/s]
  0%|          | 145/65536 [01:38<12:39:33,  1.43it/s]
  0%|          | 146/65536 [01:39<12:34:46,  1.44it/s]
  0%|          | 147/65536 [01:40<12:30:21,  1.45it/s]
  0%|          | 148/65536 [01:40<12:09:52,  1.49it/s]
  0%|          | 149/65536 [01:41<12:09:27,  1.49it/s]
  0%|          | 150/65536 [01:42<12:12:52,  1.49it/s]
  0%|          | 151/65536 [01:42<11:58:32,  1.52it/s]
  0%|          | 152/65536 [01:43<12:17:00,  1.48it/s]
  0%|          | 153/65536 [01:44<12:09:03,  1.49it/s]
  0%|          | 154/65536 [01:44<11:51:48,  1.53it/s]
  0%|          | 155/65536 [01:45<11:58:49,  1.52it/s]
  0%|          | 156/65536 [01:45<11:54:07,  1.53it/s]
  0%|          | 157/65536 [01:46<12:04:00,  1.51it/s]
  0%|          | 158/65536 [01:47<11:52:51,  1.53it/s]
  0%|          | 159/65536 [01:47<11:49:06,  1.54it/s]
  0%|          | 160/65536 [01:48<11:56:37,  1.52it/s]
                                                      
{'loss': 3.3975, 'learning_rate': 8e-07, 'epoch': 9.88}

  0%|          | 160/65536 [01:48<11:56:37,  1.52it/s]
  0%|          | 161/65536 [01:49<12:25:00,  1.46it/s]
  0%|          | 162/65536 [01:50<12:35:51,  1.44it/s]
  0%|          | 163/65536 [01:50<12:58:19,  1.40it/s]
  0%|          | 164/65536 [01:51<12:39:18,  1.43it/s]
  0%|          | 165/65536 [01:52<12:27:23,  1.46it/s]
  0%|          | 166/65536 [01:52<12:04:25,  1.50it/s]
  0%|          | 167/65536 [01:53<12:17:21,  1.48it/s]
  0%|          | 168/65536 [01:54<12:14:57,  1.48it/s]
  0%|          | 169/65536 [01:54<12:06:09,  1.50it/s]
  0%|          | 170/65536 [01:55<12:02:16,  1.51it/s]
  0%|          | 171/65536 [01:56<11:55:12,  1.52it/s]
  0%|          | 172/65536 [01:56<11:50:29,  1.53it/s]
  0%|          | 173/65536 [01:57<11:50:59,  1.53it/s]
  0%|          | 174/65536 [01:58<12:06:34,  1.50it/s]
  0%|          | 175/65536 [01:58<12:25:49,  1.46it/s]
  0%|          | 176/65536 [01:59<12:03:50,  1.50it/s]
  0%|          | 177/65536 [02:00<12:04:12,  1.50it/s]
  0%|          | 178/65536 [02:00<12:12:22,  1.49it/s]
  0%|          | 179/65536 [02:01<12:19:11,  1.47it/s]
  0%|          | 180/65536 [02:02<12:00:33,  1.51it/s]
                                                      
{'loss': 3.2188, 'learning_rate': 9e-07, 'epoch': 11.11}

  0%|          | 180/65536 [02:02<12:00:33,  1.51it/s]
  0%|          | 181/65536 [02:02<12:10:16,  1.49it/s]
  0%|          | 182/65536 [02:03<11:51:09,  1.53it/s]
  0%|          | 183/65536 [02:04<11:49:30,  1.54it/s]
  0%|          | 184/65536 [02:04<11:48:20,  1.54it/s]
  0%|          | 185/65536 [02:05<12:18:34,  1.47it/s]
  0%|          | 186/65536 [02:06<12:20:03,  1.47it/s]
  0%|          | 187/65536 [02:06<12:11:30,  1.49it/s]
  0%|          | 188/65536 [02:07<12:11:00,  1.49it/s]
  0%|          | 189/65536 [02:08<12:24:40,  1.46it/s]
  0%|          | 190/65536 [02:08<12:24:18,  1.46it/s]
  0%|          | 191/65536 [02:09<12:33:06,  1.45it/s]
  0%|          | 192/65536 [02:10<12:22:17,  1.47it/s]
  0%|          | 193/65536 [02:10<12:02:51,  1.51it/s]
  0%|          | 194/65536 [02:11<11:53:36,  1.53it/s]
  0%|          | 195/65536 [02:12<12:04:49,  1.50it/s]
  0%|          | 196/65536 [02:12<12:04:57,  1.50it/s]
  0%|          | 197/65536 [02:13<11:57:40,  1.52it/s]
  0%|          | 198/65536 [02:14<11:47:38,  1.54it/s]
  0%|          | 199/65536 [02:14<11:42:26,  1.55it/s]
  0%|          | 200/65536 [02:15<11:32:47,  1.57it/s]
                                                      
{'loss': 3.1188, 'learning_rate': 1e-06, 'epoch': 12.35}

  0%|          | 200/65536 [02:15<11:32:47,  1.57it/s]
  0%|          | 201/65536 [02:16<12:01:13,  1.51it/s]
  0%|          | 202/65536 [02:16<12:34:59,  1.44it/s]
  0%|          | 203/65536 [02:17<12:17:24,  1.48it/s]
  0%|          | 204/65536 [02:18<12:27:35,  1.46it/s]
  0%|          | 205/65536 [02:18<12:43:59,  1.43it/s]
  0%|          | 206/65536 [02:19<12:21:41,  1.47it/s]
  0%|          | 207/65536 [02:20<12:12:59,  1.49it/s]
  0%|          | 208/65536 [02:20<12:15:57,  1.48it/s]
  0%|          | 209/65536 [02:21<12:03:51,  1.50it/s]
  0%|          | 210/65536 [02:22<12:13:02,  1.49it/s]
  0%|          | 211/65536 [02:22<12:21:50,  1.47it/s]
  0%|          | 212/65536 [02:23<12:20:14,  1.47it/s]
  0%|          | 213/65536 [02:24<12:25:38,  1.46it/s]
  0%|          | 214/65536 [02:25<12:41:43,  1.43it/s]
  0%|          | 215/65536 [02:25<12:32:16,  1.45it/s]
  0%|          | 216/65536 [02:26<12:32:06,  1.45it/s]
  0%|          | 217/65536 [02:27<12:15:27,  1.48it/s]
  0%|          | 218/65536 [02:27<12:10:18,  1.49it/s]
  0%|          | 219/65536 [02:28<12:00:55,  1.51it/s]
  0%|          | 220/65536 [02:28<12:07:38,  1.50it/s]
                                                      
{'loss': 2.8955, 'learning_rate': 9.997245010407738e-07, 'epoch': 13.58}

  0%|          | 220/65536 [02:29<12:07:38,  1.50it/s]
  0%|          | 221/65536 [02:29<12:20:13,  1.47it/s]
  0%|          | 222/65536 [02:30<12:20:24,  1.47it/s]
  0%|          | 223/65536 [02:31<12:02:30,  1.51it/s]
  0%|          | 224/65536 [02:31<12:23:18,  1.46it/s]
  0%|          | 225/65536 [02:32<12:08:43,  1.49it/s]
  0%|          | 226/65536 [02:33<12:10:04,  1.49it/s]
  0%|          | 227/65536 [02:33<12:13:43,  1.48it/s]
  0%|          | 228/65536 [02:34<12:13:47,  1.48it/s]
  0%|          | 229/65536 [02:35<12:10:59,  1.49it/s]
  0%|          | 230/65536 [02:35<12:04:05,  1.50it/s]
  0%|          | 231/65536 [02:36<11:48:25,  1.54it/s]
  0%|          | 232/65536 [02:37<12:24:44,  1.46it/s]
  0%|          | 233/65536 [02:37<12:08:25,  1.49it/s]
  0%|          | 234/65536 [02:38<12:02:11,  1.51it/s]
  0%|          | 235/65536 [02:39<12:20:27,  1.47it/s]
  0%|          | 236/65536 [02:39<12:04:09,  1.50it/s]
  0%|          | 237/65536 [02:40<11:43:10,  1.55it/s]
  0%|          | 238/65536 [02:41<12:10:15,  1.49it/s]
  0%|          | 239/65536 [02:41<12:04:18,  1.50it/s]
  0%|          | 240/65536 [02:42<11:51:50,  1.53it/s]
                                                      
{'loss': 2.8306, 'learning_rate': 9.994490020815477e-07, 'epoch': 14.81}

  0%|          | 240/65536 [02:42<11:51:50,  1.53it/s]
  0%|          | 241/65536 [02:43<11:51:52,  1.53it/s]
  0%|          | 242/65536 [02:43<11:56:49,  1.52it/s]
  0%|          | 243/65536 [02:44<12:09:37,  1.49it/s]
  0%|          | 244/65536 [02:45<12:25:56,  1.46it/s]
  0%|          | 245/65536 [02:45<12:09:56,  1.49it/s]
  0%|          | 246/65536 [02:46<11:59:17,  1.51it/s]
  0%|          | 247/65536 [02:47<12:13:49,  1.48it/s]
  0%|          | 248/65536 [02:47<12:25:07,  1.46it/s]
  0%|          | 249/65536 [02:48<12:15:50,  1.48it/s]
  0%|          | 250/65536 [02:49<12:01:09,  1.51it/s]
  0%|          | 251/65536 [02:49<11:59:43,  1.51it/s]
  0%|          | 252/65536 [02:50<11:44:37,  1.54it/s]
  0%|          | 253/65536 [02:51<11:53:20,  1.53it/s]
  0%|          | 254/65536 [02:51<12:14:18,  1.48it/s]
  0%|          | 255/65536 [02:52<12:33:28,  1.44it/s]
  0%|          | 256/65536 [02:53<12:37:56,  1.44it/s]
  0%|          | 257/65536 [02:53<12:21:14,  1.47it/s]
  0%|          | 258/65536 [02:54<12:17:46,  1.47it/s]
  0%|          | 259/65536 [02:55<12:07:29,  1.50it/s]
  0%|          | 260/65536 [02:55<12:33:38,  1.44it/s]
                                                      
{'loss': 2.6681, 'learning_rate': 9.991735031223215e-07, 'epoch': 16.05}

  0%|          | 260/65536 [02:55<12:33:38,  1.44it/s]
  0%|          | 261/65536 [02:56<12:21:07,  1.47it/s]
  0%|          | 262/65536 [02:57<12:30:26,  1.45it/s]
  0%|          | 263/65536 [02:57<12:23:53,  1.46it/s]
  0%|          | 264/65536 [02:58<12:10:37,  1.49it/s]
  0%|          | 265/65536 [02:59<12:11:08,  1.49it/s]
  0%|          | 266/65536 [02:59<11:56:20,  1.52it/s]
  0%|          | 267/65536 [03:00<12:04:27,  1.50it/s]
  0%|          | 268/65536 [03:01<12:08:55,  1.49it/s]
  0%|          | 269/65536 [03:01<12:18:15,  1.47it/s]
  0%|          | 270/65536 [03:02<12:18:51,  1.47it/s]
  0%|          | 271/65536 [03:03<12:08:54,  1.49it/s]
  0%|          | 272/65536 [03:03<11:48:09,  1.54it/s]
  0%|          | 273/65536 [03:04<12:14:31,  1.48it/s]
  0%|          | 274/65536 [03:05<12:21:57,  1.47it/s]
  0%|          | 275/65536 [03:05<12:10:23,  1.49it/s]
  0%|          | 276/65536 [03:06<12:14:23,  1.48it/s]
  0%|          | 277/65536 [03:07<12:10:58,  1.49it/s]
  0%|          | 278/65536 [03:07<12:09:47,  1.49it/s]
  0%|          | 279/65536 [03:08<12:22:16,  1.47it/s]
  0%|          | 280/65536 [03:09<12:28:57,  1.45it/s]
                                                      
{'loss': 2.5885, 'learning_rate': 9.988980041630952e-07, 'epoch': 17.28}

  0%|          | 280/65536 [03:09<12:28:57,  1.45it/s]
  0%|          | 281/65536 [03:10<12:52:59,  1.41it/s]
  0%|          | 282/65536 [03:10<12:24:11,  1.46it/s]
  0%|          | 283/65536 [03:11<12:02:13,  1.51it/s]
  0%|          | 284/65536 [03:12<11:55:41,  1.52it/s]
  0%|          | 285/65536 [03:12<11:59:47,  1.51it/s]
  0%|          | 286/65536 [03:13<11:54:50,  1.52it/s]
  0%|          | 287/65536 [03:13<11:40:33,  1.55it/s]
  0%|          | 288/65536 [03:14<11:38:00,  1.56it/s]
  0%|          | 289/65536 [03:15<11:55:35,  1.52it/s]
  0%|          | 290/65536 [03:15<12:07:00,  1.50it/s]
  0%|          | 291/65536 [03:16<12:16:00,  1.48it/s]
  0%|          | 292/65536 [03:17<12:47:51,  1.42it/s]
  0%|          | 293/65536 [03:18<12:46:51,  1.42it/s]
  0%|          | 294/65536 [03:18<12:37:14,  1.44it/s]
  0%|          | 295/65536 [03:19<12:53:40,  1.41it/s]
  0%|          | 296/65536 [03:20<12:38:42,  1.43it/s]
  0%|          | 297/65536 [03:20<12:21:24,  1.47it/s]
  0%|          | 298/65536 [03:21<12:27:53,  1.45it/s]
  0%|          | 299/65536 [03:22<12:24:32,  1.46it/s]
  0%|          | 300/65536 [03:22<12:13:29,  1.48it/s]
                                                      
{'loss': 2.4487, 'learning_rate': 9.986225052038692e-07, 'epoch': 18.52}

  0%|          | 300/65536 [03:22<12:13:29,  1.48it/s]
  0%|          | 301/65536 [03:23<12:03:25,  1.50it/s]
  0%|          | 302/65536 [03:24<12:06:51,  1.50it/s]
  0%|          | 303/65536 [03:24<12:11:09,  1.49it/s]
  0%|          | 304/65536 [03:25<12:26:30,  1.46it/s]
  0%|          | 305/65536 [03:26<12:13:12,  1.48it/s]
  0%|          | 306/65536 [03:26<12:12:32,  1.48it/s]
  0%|          | 307/65536 [03:27<12:00:07,  1.51it/s]
  0%|          | 308/65536 [03:28<12:04:58,  1.50it/s]
  0%|          | 309/65536 [03:28<11:47:54,  1.54it/s]
  0%|          | 310/65536 [03:29<11:53:23,  1.52it/s]
  0%|          | 311/65536 [03:30<11:55:05,  1.52it/s]
  0%|          | 312/65536 [03:30<11:49:33,  1.53it/s]
  0%|          | 313/65536 [03:31<11:51:36,  1.53it/s]
  0%|          | 314/65536 [03:32<12:07:08,  1.49it/s]
  0%|          | 315/65536 [03:32<12:29:50,  1.45it/s]
  0%|          | 316/65536 [03:33<12:24:11,  1.46it/s]
  0%|          | 317/65536 [03:34<12:14:02,  1.48it/s]
  0%|          | 318/65536 [03:34<12:06:15,  1.50it/s]
  0%|          | 319/65536 [03:35<12:27:10,  1.45it/s]
  0%|          | 320/65536 [03:36<12:24:23,  1.46it/s]
                                                      
{'loss': 2.3682, 'learning_rate': 9.98347006244643e-07, 'epoch': 19.75}

  0%|          | 320/65536 [03:36<12:24:23,  1.46it/s]
  0%|          | 321/65536 [03:37<12:28:41,  1.45it/s]
  0%|          | 322/65536 [03:37<12:20:34,  1.47it/s]
  0%|          | 323/65536 [03:38<12:33:11,  1.44it/s]
  0%|          | 324/65536 [03:39<12:31:04,  1.45it/s]
  0%|          | 325/65536 [03:39<12:35:17,  1.44it/s]
  0%|          | 326/65536 [03:40<12:11:04,  1.49it/s]
  0%|          | 327/65536 [03:41<12:15:30,  1.48it/s]
  1%|          | 328/65536 [03:41<12:03:24,  1.50it/s]
  1%|          | 329/65536 [03:42<12:24:39,  1.46it/s]
  1%|          | 330/65536 [03:43<12:25:03,  1.46it/s]
  1%|          | 331/65536 [03:43<12:31:54,  1.45it/s]
  1%|          | 332/65536 [03:44<12:15:17,  1.48it/s]
  1%|          | 333/65536 [03:45<12:13:52,  1.48it/s]
  1%|          | 334/65536 [03:45<12:03:01,  1.50it/s]
  1%|          | 335/65536 [03:46<11:55:40,  1.52it/s]
  1%|          | 336/65536 [03:47<11:53:56,  1.52it/s]
  1%|          | 337/65536 [03:47<11:43:50,  1.54it/s]
  1%|          | 338/65536 [03:48<12:01:51,  1.51it/s]
  1%|          | 339/65536 [03:49<11:50:05,  1.53it/s]
  1%|          | 340/65536 [03:49<12:10:11,  1.49it/s]
                                                      
{'loss': 2.3481, 'learning_rate': 9.98071507285417e-07, 'epoch': 20.99}

  1%|          | 340/65536 [03:49<12:10:11,  1.49it/s]
  1%|          | 341/65536 [03:50<12:24:14,  1.46it/s]
  1%|          | 342/65536 [03:51<11:55:23,  1.52it/s]
  1%|          | 343/65536 [03:51<12:01:13,  1.51it/s]
  1%|          | 344/65536 [03:52<11:57:40,  1.51it/s]
  1%|          | 345/65536 [03:53<12:09:06,  1.49it/s]
  1%|          | 346/65536 [03:53<12:10:22,  1.49it/s]
  1%|          | 347/65536 [03:54<12:06:31,  1.50it/s]
  1%|          | 348/65536 [03:55<12:13:01,  1.48it/s]
  1%|          | 349/65536 [03:55<12:12:06,  1.48it/s]
  1%|          | 350/65536 [03:56<11:53:34,  1.52it/s]
  1%|          | 351/65536 [03:57<12:06:53,  1.49it/s]
  1%|          | 352/65536 [03:57<12:04:58,  1.50it/s]
  1%|          | 353/65536 [03:58<12:33:54,  1.44it/s]
  1%|          | 354/65536 [03:59<12:11:12,  1.49it/s]
  1%|          | 355/65536 [03:59<12:29:59,  1.45it/s]
  1%|          | 356/65536 [04:00<12:23:18,  1.46it/s]
  1%|          | 357/65536 [04:01<12:32:38,  1.44it/s]
  1%|          | 358/65536 [04:02<12:45:28,  1.42it/s]
  1%|          | 359/65536 [04:02<12:59:20,  1.39it/s]
  1%|          | 360/65536 [04:03<12:31:18,  1.45it/s]
                                                      
{'loss': 2.3241, 'learning_rate': 9.977960083261906e-07, 'epoch': 22.22}

  1%|          | 360/65536 [04:03<12:31:18,  1.45it/s]
  1%|          | 361/65536 [04:04<12:20:20,  1.47it/s]
  1%|          | 362/65536 [04:04<12:07:27,  1.49it/s]
  1%|          | 363/65536 [04:05<11:57:30,  1.51it/s]
  1%|          | 364/65536 [04:06<12:06:27,  1.50it/s]
  1%|          | 365/65536 [04:06<11:51:05,  1.53it/s]
  1%|          | 366/65536 [04:07<11:51:29,  1.53it/s]
  1%|          | 367/65536 [04:07<11:49:35,  1.53it/s]
  1%|          | 368/65536 [04:08<11:58:09,  1.51it/s]
  1%|          | 369/65536 [04:09<12:04:52,  1.50it/s]
  1%|          | 370/65536 [04:10<12:21:52,  1.46it/s]
  1%|          | 371/65536 [04:10<11:55:18,  1.52it/s]
  1%|          | 372/65536 [04:11<12:00:52,  1.51it/s]
  1%|          | 373/65536 [04:12<12:20:41,  1.47it/s]
  1%|          | 374/65536 [04:12<12:00:42,  1.51it/s]
  1%|          | 375/65536 [04:13<12:08:50,  1.49it/s]
  1%|          | 376/65536 [04:14<12:19:33,  1.47it/s]
  1%|          | 377/65536 [04:14<11:51:16,  1.53it/s]
  1%|          | 378/65536 [04:15<11:48:47,  1.53it/s]
  1%|          | 379/65536 [04:15<12:00:24,  1.51it/s]
  1%|          | 380/65536 [04:16<11:59:53,  1.51it/s]
                                                      
{'loss': 2.238, 'learning_rate': 9.975205093669647e-07, 'epoch': 23.46}

  1%|          | 380/65536 [04:16<11:59:53,  1.51it/s]
  1%|          | 381/65536 [04:17<12:02:20,  1.50it/s]
  1%|          | 382/65536 [04:18<12:06:11,  1.50it/s]
  1%|          | 383/65536 [04:18<12:02:04,  1.50it/s]
  1%|          | 384/65536 [04:19<12:23:19,  1.46it/s]
  1%|          | 385/65536 [04:20<12:29:21,  1.45it/s]
  1%|          | 386/65536 [04:20<12:15:11,  1.48it/s]
  1%|          | 387/65536 [04:21<11:57:27,  1.51it/s]
  1%|          | 388/65536 [04:22<12:14:55,  1.48it/s]
  1%|          | 389/65536 [04:22<12:12:12,  1.48it/s]
  1%|          | 390/65536 [04:23<12:20:20,  1.47it/s]
  1%|          | 391/65536 [04:24<12:26:01,  1.46it/s]
  1%|          | 392/65536 [04:24<12:30:59,  1.45it/s]
  1%|          | 393/65536 [04:25<12:34:00,  1.44it/s]
  1%|          | 394/65536 [04:26<12:46:40,  1.42it/s]
  1%|          | 395/65536 [04:26<12:45:46,  1.42it/s]
  1%|          | 396/65536 [04:27<12:20:54,  1.47it/s]
  1%|          | 397/65536 [04:28<11:59:51,  1.51it/s]
  1%|          | 398/65536 [04:28<12:04:24,  1.50it/s]
  1%|          | 399/65536 [04:29<11:52:40,  1.52it/s]
  1%|          | 400/65536 [04:30<11:54:28,  1.52it/s]
                                                      
{'loss': 2.1978, 'learning_rate': 9.972450104077383e-07, 'epoch': 24.69}

  1%|          | 400/65536 [04:30<11:54:28,  1.52it/s]
  1%|          | 401/65536 [04:30<11:38:42,  1.55it/s]
  1%|          | 402/65536 [04:31<11:44:29,  1.54it/s]
  1%|          | 403/65536 [04:32<11:32:02,  1.57it/s]
  1%|          | 404/65536 [04:32<11:45:58,  1.54it/s]
  1%|          | 405/65536 [04:33<11:55:50,  1.52it/s]
  1%|          | 406/65536 [04:34<12:16:30,  1.47it/s]
  1%|          | 407/65536 [04:34<12:31:19,  1.44it/s]
  1%|          | 408/65536 [04:35<12:18:10,  1.47it/s]
  1%|          | 409/65536 [04:36<12:11:25,  1.48it/s]
  1%|          | 410/65536 [04:36<12:05:25,  1.50it/s]
  1%|          | 411/65536 [04:37<12:11:00,  1.48it/s]
  1%|          | 412/65536 [04:38<11:56:42,  1.51it/s]
  1%|          | 413/65536 [04:38<11:42:41,  1.54it/s]
  1%|          | 414/65536 [04:39<11:35:26,  1.56it/s]
  1%|          | 415/65536 [04:40<12:04:00,  1.50it/s]
  1%|          | 416/65536 [04:40<12:00:48,  1.51it/s]
  1%|          | 417/65536 [04:41<12:02:32,  1.50it/s]
  1%|          | 418/65536 [04:42<12:22:11,  1.46it/s]
  1%|          | 419/65536 [04:42<12:29:29,  1.45it/s]
  1%|          | 420/65536 [04:43<12:31:10,  1.44it/s]
                                                      
{'loss': 2.1961, 'learning_rate': 9.969695114485122e-07, 'epoch': 25.93}

  1%|          | 420/65536 [04:43<12:31:10,  1.44it/s]
  1%|          | 421/65536 [04:44<12:29:14,  1.45it/s]
  1%|          | 422/65536 [04:44<12:30:18,  1.45it/s]
  1%|          | 423/65536 [04:45<12:33:38,  1.44it/s]
  1%|          | 424/65536 [04:46<12:39:34,  1.43it/s]
  1%|          | 425/65536 [04:47<12:55:12,  1.40it/s]
  1%|          | 426/65536 [04:47<12:13:27,  1.48it/s]
  1%|          | 427/65536 [04:48<11:59:45,  1.51it/s]
  1%|          | 428/65536 [04:49<12:03:47,  1.50it/s]
  1%|          | 429/65536 [04:49<12:11:38,  1.48it/s]
  1%|          | 430/65536 [04:50<11:48:51,  1.53it/s]
  1%|          | 431/65536 [04:51<11:58:35,  1.51it/s]
  1%|          | 432/65536 [04:51<12:07:24,  1.49it/s]
  1%|          | 433/65536 [04:52<12:20:18,  1.47it/s]
  1%|          | 434/65536 [04:53<12:13:04,  1.48it/s]
  1%|          | 435/65536 [04:53<12:02:07,  1.50it/s]
  1%|          | 436/65536 [04:54<11:45:28,  1.54it/s]
  1%|          | 437/65536 [04:55<11:54:22,  1.52it/s]
  1%|          | 438/65536 [04:55<12:25:49,  1.45it/s]
  1%|          | 439/65536 [04:56<12:11:36,  1.48it/s]
  1%|          | 440/65536 [04:57<11:58:09,  1.51it/s]
                                                      
{'loss': 2.1405, 'learning_rate': 9.96694012489286e-07, 'epoch': 27.16}

  1%|          | 440/65536 [04:57<11:58:09,  1.51it/s]
  1%|          | 441/65536 [04:57<11:58:01,  1.51it/s]
  1%|          | 442/65536 [04:58<11:58:39,  1.51it/s]
  1%|          | 443/65536 [04:59<11:55:25,  1.52it/s]
  1%|          | 444/65536 [04:59<11:43:52,  1.54it/s]
  1%|          | 445/65536 [05:00<12:19:26,  1.47it/s]
  1%|          | 446/65536 [05:01<12:17:11,  1.47it/s]
  1%|          | 447/65536 [05:01<12:18:42,  1.47it/s]
  1%|          | 448/65536 [05:02<12:16:23,  1.47it/s]
  1%|          | 449/65536 [05:03<12:13:16,  1.48it/s]
  1%|          | 450/65536 [05:03<12:23:54,  1.46it/s]
  1%|          | 451/65536 [05:04<12:10:27,  1.49it/s]
  1%|          | 452/65536 [05:05<12:22:38,  1.46it/s]
  1%|          | 453/65536 [05:05<12:34:52,  1.44it/s]
  1%|          | 454/65536 [05:06<12:22:14,  1.46it/s]
  1%|          | 455/65536 [05:07<12:21:31,  1.46it/s]
  1%|          | 456/65536 [05:07<12:06:25,  1.49it/s]
  1%|          | 457/65536 [05:08<12:02:35,  1.50it/s]
  1%|          | 458/65536 [05:09<12:14:11,  1.48it/s]
  1%|          | 459/65536 [05:09<12:03:31,  1.50it/s]
  1%|          | 460/65536 [05:10<12:02:31,  1.50it/s]
                                                      
{'loss': 2.0997, 'learning_rate': 9.9641851353006e-07, 'epoch': 28.4}

  1%|          | 460/65536 [05:10<12:02:31,  1.50it/s]
  1%|          | 461/65536 [05:11<11:56:17,  1.51it/s]
  1%|          | 462/65536 [05:11<11:57:56,  1.51it/s]
  1%|          | 463/65536 [05:12<11:54:59,  1.52it/s]
  1%|          | 464/65536 [05:13<11:37:02,  1.56it/s]
  1%|          | 465/65536 [05:13<11:33:59,  1.56it/s]
  1%|          | 466/65536 [05:14<11:50:19,  1.53it/s]
  1%|          | 467/65536 [05:15<11:45:08,  1.54it/s]
  1%|          | 468/65536 [05:15<12:07:09,  1.49it/s]
  1%|          | 469/65536 [05:16<12:10:07,  1.49it/s]
  1%|          | 470/65536 [05:17<12:32:14,  1.44it/s]
  1%|          | 471/65536 [05:17<12:37:42,  1.43it/s]
  1%|          | 472/65536 [05:18<12:13:48,  1.48it/s]
  1%|          | 473/65536 [05:19<12:19:57,  1.47it/s]
  1%|          | 474/65536 [05:19<12:07:34,  1.49it/s]
  1%|          | 475/65536 [05:20<12:03:32,  1.50it/s]
  1%|          | 476/65536 [05:21<12:16:20,  1.47it/s]
  1%|          | 477/65536 [05:21<12:02:21,  1.50it/s]
  1%|          | 478/65536 [05:22<12:14:39,  1.48it/s]
  1%|          | 479/65536 [05:23<12:09:01,  1.49it/s]
  1%|          | 480/65536 [05:23<12:23:43,  1.46it/s]
                                                      
{'loss': 2.0858, 'learning_rate': 9.961430145708338e-07, 'epoch': 29.63}

  1%|          | 480/65536 [05:23<12:23:43,  1.46it/s]
  1%|          | 481/65536 [05:24<12:24:47,  1.46it/s]
  1%|          | 482/65536 [05:25<12:20:49,  1.46it/s]
  1%|          | 483/65536 [05:25<12:07:23,  1.49it/s]
  1%|          | 484/65536 [05:26<12:09:59,  1.49it/s]
  1%|          | 485/65536 [05:27<11:58:22,  1.51it/s]
  1%|          | 486/65536 [05:27<12:03:04,  1.50it/s]
  1%|          | 487/65536 [05:28<12:18:04,  1.47it/s]
  1%|          | 488/65536 [05:29<12:04:22,  1.50it/s]
  1%|          | 489/65536 [05:30<12:19:08,  1.47it/s]
  1%|          | 490/65536 [05:30<12:40:31,  1.43it/s]
  1%|          | 491/65536 [05:31<12:27:25,  1.45it/s]
  1%|          | 492/65536 [05:32<12:17:06,  1.47it/s]
  1%|          | 493/65536 [05:32<12:03:30,  1.50it/s]
  1%|          | 494/65536 [05:33<11:51:56,  1.52it/s]
  1%|          | 495/65536 [05:34<11:56:00,  1.51it/s]
  1%|          | 496/65536 [05:34<12:11:55,  1.48it/s]
  1%|          | 497/65536 [05:35<11:54:36,  1.52it/s]
  1%|          | 498/65536 [05:36<11:53:37,  1.52it/s]
  1%|          | 499/65536 [05:36<11:49:23,  1.53it/s]
  1%|          | 500/65536 [05:37<11:55:50,  1.51it/s]
                                                      
{'loss': 2.0372, 'learning_rate': 9.958675156116076e-07, 'epoch': 30.86}

  1%|          | 500/65536 [05:37<11:55:50,  1.51it/s]
  1%|          | 501/65536 [05:38<11:58:17,  1.51it/s]
  1%|          | 502/65536 [05:38<12:03:36,  1.50it/s]
  1%|          | 503/65536 [05:39<12:37:14,  1.43it/s]
  1%|          | 504/65536 [05:40<12:05:35,  1.49it/s]
  1%|          | 505/65536 [05:40<12:00:52,  1.50it/s]
  1%|          | 506/65536 [05:41<12:12:48,  1.48it/s]
  1%|          | 507/65536 [05:42<12:00:51,  1.50it/s]
  1%|          | 508/65536 [05:42<12:00:13,  1.50it/s]
  1%|          | 509/65536 [05:43<11:57:19,  1.51it/s]
  1%|          | 510/65536 [05:44<11:53:20,  1.52it/s]
  1%|          | 511/65536 [05:44<11:50:38,  1.53it/s]
  1%|          | 512/65536 [05:45<12:25:51,  1.45it/s]
  1%|          | 513/65536 [05:46<12:28:37,  1.45it/s]
  1%|          | 514/65536 [05:46<12:16:47,  1.47it/s]
  1%|          | 515/65536 [05:47<12:11:17,  1.48it/s]
  1%|          | 516/65536 [05:48<12:08:23,  1.49it/s]
  1%|          | 517/65536 [05:48<11:59:17,  1.51it/s]
  1%|          | 518/65536 [05:49<11:55:03,  1.52it/s]
  1%|          | 519/65536 [05:50<11:58:27,  1.51it/s]
  1%|          | 520/65536 [05:50<12:25:38,  1.45it/s]
                                                      
{'loss': 2.0512, 'learning_rate': 9.955920166523815e-07, 'epoch': 32.1}

  1%|          | 520/65536 [05:50<12:25:38,  1.45it/s]
  1%|          | 521/65536 [05:51<12:11:28,  1.48it/s]
  1%|          | 522/65536 [05:52<12:12:20,  1.48it/s]
  1%|          | 523/65536 [05:52<11:58:26,  1.51it/s]
  1%|          | 524/65536 [05:53<11:57:36,  1.51it/s]
  1%|          | 525/65536 [05:54<11:47:19,  1.53it/s]
  1%|          | 526/65536 [05:54<11:53:39,  1.52it/s]
  1%|          | 527/65536 [05:55<11:39:39,  1.55it/s]
  1%|          | 528/65536 [05:56<11:57:46,  1.51it/s]
  1%|          | 529/65536 [05:56<12:06:38,  1.49it/s]
  1%|          | 530/65536 [05:57<12:00:09,  1.50it/s]
  1%|          | 531/65536 [05:58<11:58:31,  1.51it/s]
  1%|          | 532/65536 [05:58<12:10:30,  1.48it/s]
  1%|          | 533/65536 [05:59<12:06:51,  1.49it/s]
  1%|          | 534/65536 [06:00<12:01:41,  1.50it/s]
  1%|          | 535/65536 [06:00<12:20:31,  1.46it/s]
  1%|          | 536/65536 [06:01<12:07:30,  1.49it/s]
  1%|          | 537/65536 [06:02<12:05:45,  1.49it/s]
  1%|          | 538/65536 [06:02<12:15:54,  1.47it/s]
  1%|          | 539/65536 [06:03<12:16:09,  1.47it/s]
  1%|          | 540/65536 [06:04<12:20:57,  1.46it/s]
                                                      
{'loss': 2.0068, 'learning_rate': 9.953165176931551e-07, 'epoch': 33.33}

  1%|          | 540/65536 [06:04<12:20:57,  1.46it/s]
  1%|          | 541/65536 [06:04<12:10:48,  1.48it/s]
  1%|          | 542/65536 [06:05<12:18:03,  1.47it/s]
  1%|          | 543/65536 [06:06<11:53:59,  1.52it/s]
  1%|          | 544/65536 [06:06<11:50:12,  1.53it/s]
  1%|          | 545/65536 [06:07<11:57:32,  1.51it/s]
  1%|          | 546/65536 [06:08<11:48:41,  1.53it/s]
  1%|          | 547/65536 [06:08<11:47:49,  1.53it/s]
  1%|          | 548/65536 [06:09<11:51:13,  1.52it/s]
  1%|          | 549/65536 [06:10<11:55:00,  1.51it/s]
  1%|          | 550/65536 [06:10<12:09:39,  1.48it/s]
  1%|          | 551/65536 [06:11<12:21:18,  1.46it/s]
  1%|          | 552/65536 [06:12<12:17:29,  1.47it/s]
  1%|          | 553/65536 [06:12<12:00:37,  1.50it/s]
  1%|          | 554/65536 [06:13<11:56:47,  1.51it/s]
  1%|          | 555/65536 [06:14<12:05:37,  1.49it/s]
  1%|          | 556/65536 [06:14<12:08:42,  1.49it/s]
  1%|          | 557/65536 [06:15<12:01:04,  1.50it/s]
  1%|          | 558/65536 [06:16<11:55:42,  1.51it/s]
  1%|          | 559/65536 [06:16<12:09:38,  1.48it/s]
  1%|          | 560/65536 [06:17<11:50:13,  1.52it/s]
                                                      
{'loss': 1.9641, 'learning_rate': 9.950410187339292e-07, 'epoch': 34.57}

  1%|          | 560/65536 [06:17<11:50:13,  1.52it/s]
  1%|          | 561/65536 [06:18<11:49:37,  1.53it/s]
  1%|          | 562/65536 [06:18<12:00:03,  1.50it/s]
  1%|          | 563/65536 [06:19<12:01:36,  1.50it/s]
  1%|          | 564/65536 [06:20<12:03:22,  1.50it/s]
  1%|          | 565/65536 [06:20<12:28:18,  1.45it/s]
  1%|          | 566/65536 [06:21<12:32:18,  1.44it/s]
  1%|          | 567/65536 [06:22<12:25:28,  1.45it/s]
  1%|          | 568/65536 [06:23<12:47:05,  1.41it/s]
  1%|          | 569/65536 [06:23<12:41:49,  1.42it/s]
  1%|          | 570/65536 [06:24<12:26:27,  1.45it/s]
  1%|          | 571/65536 [06:25<12:31:07,  1.44it/s]
  1%|          | 572/65536 [06:25<12:13:09,  1.48it/s]
  1%|          | 573/65536 [06:26<12:09:16,  1.48it/s]
  1%|          | 574/65536 [06:27<12:29:16,  1.44it/s]
  1%|          | 575/65536 [06:27<12:03:53,  1.50it/s]
  1%|          | 576/65536 [06:28<12:23:12,  1.46it/s]
  1%|          | 577/65536 [06:29<11:53:52,  1.52it/s]
  1%|          | 578/65536 [06:29<12:04:30,  1.49it/s]
  1%|          | 579/65536 [06:30<12:00:25,  1.50it/s]
  1%|          | 580/65536 [06:31<11:54:31,  1.52it/s]
                                                      
{'loss': 1.8995, 'learning_rate': 9.94765519774703e-07, 'epoch': 35.8}

  1%|          | 580/65536 [06:31<11:54:31,  1.52it/s]
  1%|          | 581/65536 [06:31<11:48:32,  1.53it/s]
  1%|          | 582/65536 [06:32<11:48:24,  1.53it/s]
  1%|          | 583/65536 [06:33<11:52:29,  1.52it/s]
  1%|          | 584/65536 [06:33<12:07:36,  1.49it/s]
  1%|          | 585/65536 [06:34<11:53:51,  1.52it/s]
  1%|          | 586/65536 [06:35<11:57:43,  1.51it/s]
  1%|          | 587/65536 [06:35<12:11:58,  1.48it/s]
  1%|          | 588/65536 [06:36<12:08:40,  1.49it/s]
  1%|          | 589/65536 [06:37<11:55:06,  1.51it/s]
  1%|          | 590/65536 [06:37<12:07:23,  1.49it/s]
  1%|          | 591/65536 [06:38<12:05:24,  1.49it/s]
  1%|          | 592/65536 [06:39<12:40:26,  1.42it/s]
  1%|          | 593/65536 [06:39<12:13:47,  1.48it/s]
  1%|          | 594/65536 [06:40<12:00:41,  1.50it/s]
  1%|          | 595/65536 [06:41<11:48:13,  1.53it/s]
  1%|          | 596/65536 [06:41<11:56:28,  1.51it/s]
  1%|          | 597/65536 [06:42<11:58:41,  1.51it/s]
  1%|          | 598/65536 [06:43<12:00:38,  1.50it/s]
  1%|          | 599/65536 [06:43<12:00:49,  1.50it/s]
  1%|          | 600/65536 [06:44<12:10:53,  1.48it/s]
                                                      
{'loss': 1.9464, 'learning_rate': 9.94490020815477e-07, 'epoch': 37.04}

  1%|          | 600/65536 [06:44<12:10:53,  1.48it/s]
  1%|          | 601/65536 [06:45<12:15:08,  1.47it/s]
  1%|          | 602/65536 [06:45<12:12:55,  1.48it/s]
  1%|          | 603/65536 [06:46<12:02:53,  1.50it/s]
  1%|          | 604/65536 [06:47<12:06:00,  1.49it/s]
  1%|          | 605/65536 [06:47<12:09:37,  1.48it/s]
  1%|          | 606/65536 [06:48<12:07:40,  1.49it/s]
  1%|          | 607/65536 [06:49<12:03:35,  1.50it/s]
  1%|          | 608/65536 [06:49<12:00:36,  1.50it/s]
  1%|          | 609/65536 [06:50<12:10:37,  1.48it/s]
  1%|          | 610/65536 [06:51<12:01:30,  1.50it/s]
  1%|          | 611/65536 [06:51<11:58:28,  1.51it/s]
  1%|          | 612/65536 [06:52<12:19:38,  1.46it/s]
  1%|          | 613/65536 [06:53<12:29:55,  1.44it/s]
  1%|          | 614/65536 [06:53<12:20:59,  1.46it/s]
  1%|          | 615/65536 [06:54<12:00:59,  1.50it/s]
  1%|          | 616/65536 [06:55<12:26:41,  1.45it/s]
  1%|          | 617/65536 [06:55<12:01:01,  1.50it/s]
  1%|          | 618/65536 [06:56<11:56:12,  1.51it/s]
  1%|          | 619/65536 [06:57<11:31:49,  1.56it/s]
  1%|          | 620/65536 [06:57<11:43:12,  1.54it/s]
                                                      
{'loss': 1.8826, 'learning_rate': 9.942145218562508e-07, 'epoch': 38.27}

  1%|          | 620/65536 [06:57<11:43:12,  1.54it/s]
  1%|          | 621/65536 [06:58<12:00:52,  1.50it/s]
  1%|          | 622/65536 [06:59<12:20:57,  1.46it/s]
  1%|          | 623/65536 [06:59<12:04:35,  1.49it/s]
  1%|          | 624/65536 [07:00<11:53:15,  1.52it/s]
  1%|          | 625/65536 [07:01<12:03:10,  1.50it/s]
  1%|          | 626/65536 [07:01<12:20:03,  1.46it/s]
  1%|          | 627/65536 [07:02<12:21:50,  1.46it/s]
  1%|          | 628/65536 [07:03<12:08:25,  1.49it/s]
  1%|          | 629/65536 [07:03<12:06:09,  1.49it/s]
  1%|          | 630/65536 [07:04<12:04:26,  1.49it/s]
  1%|          | 631/65536 [07:05<11:57:18,  1.51it/s]
  1%|          | 632/65536 [07:05<12:18:53,  1.46it/s]
  1%|          | 633/65536 [07:06<12:00:37,  1.50it/s]
  1%|          | 634/65536 [07:07<11:53:17,  1.52it/s]
  1%|          | 635/65536 [07:07<11:51:58,  1.52it/s]
  1%|          | 636/65536 [07:08<11:48:30,  1.53it/s]
  1%|          | 637/65536 [07:09<11:51:29,  1.52it/s]
  1%|          | 638/65536 [07:09<12:27:58,  1.45it/s]
  1%|          | 639/65536 [07:10<12:21:37,  1.46it/s]
  1%|          | 640/65536 [07:11<12:04:12,  1.49it/s]
                                                      
{'loss': 1.8745, 'learning_rate': 9.939390228970246e-07, 'epoch': 39.51}

  1%|          | 640/65536 [07:11<12:04:12,  1.49it/s]
  1%|          | 641/65536 [07:11<12:08:57,  1.48it/s]
  1%|          | 642/65536 [07:12<12:16:31,  1.47it/s]
  1%|          | 643/65536 [07:13<12:12:12,  1.48it/s]
  1%|          | 644/65536 [07:13<12:03:45,  1.49it/s]
  1%|          | 645/65536 [07:14<12:22:24,  1.46it/s]
  1%|          | 646/65536 [07:15<12:41:17,  1.42it/s]
  1%|          | 647/65536 [07:16<12:31:38,  1.44it/s]
  1%|          | 648/65536 [07:16<12:12:18,  1.48it/s]
  1%|          | 649/65536 [07:17<12:12:59,  1.48it/s]
  1%|          | 650/65536 [07:18<12:02:55,  1.50it/s]
  1%|          | 651/65536 [07:18<12:09:59,  1.48it/s]
  1%|          | 652/65536 [07:19<12:37:54,  1.43it/s]
  1%|          | 653/65536 [07:20<12:14:22,  1.47it/s]
  1%|          | 654/65536 [07:20<12:11:00,  1.48it/s]
  1%|          | 655/65536 [07:21<12:20:29,  1.46it/s]
  1%|          | 656/65536 [07:22<12:01:00,  1.50it/s]
  1%|          | 657/65536 [07:22<12:15:54,  1.47it/s]
  1%|          | 658/65536 [07:23<12:02:14,  1.50it/s]
  1%|          | 659/65536 [07:24<11:52:55,  1.52it/s]
  1%|          | 660/65536 [07:24<11:55:17,  1.51it/s]
                                                      
{'loss': 1.8612, 'learning_rate': 9.936635239377985e-07, 'epoch': 40.74}

  1%|          | 660/65536 [07:24<11:55:17,  1.51it/s]
  1%|          | 661/65536 [07:25<12:06:18,  1.49it/s]
  1%|          | 662/65536 [07:26<12:06:38,  1.49it/s]
  1%|          | 663/65536 [07:26<11:59:46,  1.50it/s]
  1%|          | 664/65536 [07:27<12:03:40,  1.49it/s]
  1%|          | 665/65536 [07:28<12:08:36,  1.48it/s]
  1%|          | 666/65536 [07:28<11:53:43,  1.51it/s]
  1%|          | 667/65536 [07:29<11:48:48,  1.53it/s]
  1%|          | 668/65536 [07:30<11:47:37,  1.53it/s]
  1%|          | 669/65536 [07:30<11:52:45,  1.52it/s]
  1%|          | 670/65536 [07:31<11:53:38,  1.51it/s]
  1%|          | 671/65536 [07:32<11:55:05,  1.51it/s]
  1%|          | 672/65536 [07:32<12:11:34,  1.48it/s]
  1%|          | 673/65536 [07:33<12:20:58,  1.46it/s]
  1%|          | 674/65536 [07:34<12:15:55,  1.47it/s]
  1%|          | 675/65536 [07:34<12:14:47,  1.47it/s]
  1%|          | 676/65536 [07:35<12:22:26,  1.46it/s]
  1%|          | 677/65536 [07:36<12:22:33,  1.46it/s]
  1%|          | 678/65536 [07:36<12:23:18,  1.45it/s]
  1%|          | 679/65536 [07:37<12:01:30,  1.50it/s]
  1%|          | 680/65536 [07:38<12:06:03,  1.49it/s]
                                                      
{'loss': 1.8142, 'learning_rate': 9.933880249785724e-07, 'epoch': 41.98}

  1%|          | 680/65536 [07:38<12:06:03,  1.49it/s]
  1%|          | 681/65536 [07:38<12:14:21,  1.47it/s]
  1%|          | 682/65536 [07:39<11:59:02,  1.50it/s]
  1%|          | 683/65536 [07:40<11:56:21,  1.51it/s]
  1%|          | 684/65536 [07:40<12:08:51,  1.48it/s]
  1%|          | 685/65536 [07:41<12:23:20,  1.45it/s]
  1%|          | 686/65536 [07:42<12:12:51,  1.47it/s]
  1%|          | 687/65536 [07:43<12:20:24,  1.46it/s]
  1%|          | 688/65536 [07:43<12:20:33,  1.46it/s]
  1%|          | 689/65536 [07:44<12:09:41,  1.48it/s]
  1%|          | 690/65536 [07:44<11:50:31,  1.52it/s]
  1%|          | 691/65536 [07:45<12:02:37,  1.50it/s]
  1%|          | 692/65536 [07:46<12:09:43,  1.48it/s]
  1%|          | 693/65536 [07:47<12:14:37,  1.47it/s]
  1%|          | 694/65536 [07:47<12:04:42,  1.49it/s]
  1%|          | 695/65536 [07:48<12:00:06,  1.50it/s]
  1%|          | 696/65536 [07:49<11:58:30,  1.50it/s]
  1%|          | 697/65536 [07:49<12:12:58,  1.47it/s]
  1%|          | 698/65536 [07:50<12:17:25,  1.47it/s]
  1%|          | 699/65536 [07:51<12:29:00,  1.44it/s]
  1%|          | 700/65536 [07:51<12:43:14,  1.42it/s]
                                                      
{'loss': 1.8127, 'learning_rate': 9.93112526019346e-07, 'epoch': 43.21}

  1%|          | 700/65536 [07:51<12:43:14,  1.42it/s]
  1%|          | 701/65536 [07:52<12:30:18,  1.44it/s]
  1%|          | 702/65536 [07:53<12:21:41,  1.46it/s]
  1%|          | 703/65536 [07:53<12:11:24,  1.48it/s]
  1%|          | 704/65536 [07:54<12:19:13,  1.46it/s]
  1%|          | 705/65536 [07:55<12:06:01,  1.49it/s]
  1%|          | 706/65536 [07:55<12:03:46,  1.49it/s]
  1%|          | 707/65536 [07:56<11:54:34,  1.51it/s]
  1%|          | 708/65536 [07:57<11:57:28,  1.51it/s]
  1%|          | 709/65536 [07:57<11:47:54,  1.53it/s]
  1%|          | 710/65536 [07:58<11:51:15,  1.52it/s]
  1%|          | 711/65536 [07:59<11:48:32,  1.52it/s]
  1%|          | 712/65536 [07:59<11:56:11,  1.51it/s]
  1%|          | 713/65536 [08:00<12:08:04,  1.48it/s]
  1%|          | 714/65536 [08:01<12:19:16,  1.46it/s]
  1%|          | 715/65536 [08:01<12:28:07,  1.44it/s]
  1%|          | 716/65536 [08:02<12:10:26,  1.48it/s]
  1%|          | 717/65536 [08:03<12:15:25,  1.47it/s]
  1%|          | 718/65536 [08:03<12:21:31,  1.46it/s]
  1%|          | 719/65536 [08:04<12:06:00,  1.49it/s]
  1%|          | 720/65536 [08:05<12:10:00,  1.48it/s]
                                                      
{'loss': 1.7793, 'learning_rate': 9.9283702706012e-07, 'epoch': 44.44}

  1%|          | 720/65536 [08:05<12:10:00,  1.48it/s]
  1%|          | 721/65536 [08:05<11:54:33,  1.51it/s]
  1%|          | 722/65536 [08:06<12:11:56,  1.48it/s]
  1%|          | 723/65536 [08:07<11:53:34,  1.51it/s]
  1%|          | 724/65536 [08:07<11:40:08,  1.54it/s]
  1%|          | 725/65536 [08:08<11:40:14,  1.54it/s]
  1%|          | 726/65536 [08:09<11:49:30,  1.52it/s]
  1%|          | 727/65536 [08:09<11:46:43,  1.53it/s]
  1%|          | 728/65536 [08:10<12:10:59,  1.48it/s]
  1%|          | 729/65536 [08:11<11:57:36,  1.51it/s]
  1%|          | 730/65536 [08:11<12:24:49,  1.45it/s]
  1%|          | 731/65536 [08:12<12:23:08,  1.45it/s]
  1%|          | 732/65536 [08:13<12:07:13,  1.49it/s]
  1%|          | 733/65536 [08:13<11:57:32,  1.51it/s]
  1%|          | 734/65536 [08:14<12:02:09,  1.50it/s]
  1%|          | 735/65536 [08:15<12:11:05,  1.48it/s]
  1%|          | 736/65536 [08:15<12:04:16,  1.49it/s]
  1%|          | 737/65536 [08:16<12:21:54,  1.46it/s]
  1%|          | 738/65536 [08:17<12:14:53,  1.47it/s]
  1%|          | 739/65536 [08:17<11:57:51,  1.50it/s]
  1%|          | 740/65536 [08:18<11:42:53,  1.54it/s]
                                                      
{'loss': 1.8325, 'learning_rate': 9.925615281008937e-07, 'epoch': 45.68}

  1%|          | 740/65536 [08:18<11:42:53,  1.54it/s]
  1%|          | 741/65536 [08:19<11:48:48,  1.52it/s]
  1%|          | 742/65536 [08:19<11:52:27,  1.52it/s]
  1%|          | 743/65536 [08:20<11:49:54,  1.52it/s]
  1%|          | 744/65536 [08:21<12:12:27,  1.47it/s]
  1%|          | 745/65536 [08:21<11:43:10,  1.54it/s]
  1%|          | 746/65536 [08:22<11:54:29,  1.51it/s]
  1%|          | 747/65536 [08:23<12:13:03,  1.47it/s]
  1%|          | 748/65536 [08:23<12:11:13,  1.48it/s]
  1%|          | 749/65536 [08:24<12:30:09,  1.44it/s]
  1%|          | 750/65536 [08:25<12:25:49,  1.45it/s]
  1%|          | 751/65536 [08:26<12:12:14,  1.47it/s]
  1%|          | 752/65536 [08:26<12:19:05,  1.46it/s]
  1%|          | 753/65536 [08:27<12:06:28,  1.49it/s]
  1%|          | 754/65536 [08:28<12:04:11,  1.49it/s]
  1%|          | 755/65536 [08:28<11:41:31,  1.54it/s]
  1%|          | 756/65536 [08:29<11:47:14,  1.53it/s]
  1%|          | 757/65536 [08:29<11:34:00,  1.56it/s]
  1%|          | 758/65536 [08:30<11:32:05,  1.56it/s]
  1%|          | 759/65536 [08:31<11:45:17,  1.53it/s]
  1%|          | 760/65536 [08:31<11:48:14,  1.52it/s]
                                                      
{'loss': 1.7801, 'learning_rate': 9.922860291416678e-07, 'epoch': 46.91}

  1%|          | 760/65536 [08:31<11:48:14,  1.52it/s]
  1%|          | 761/65536 [08:32<12:10:00,  1.48it/s]
  1%|          | 762/65536 [08:33<12:12:54,  1.47it/s]
  1%|          | 763/65536 [08:33<12:14:20,  1.47it/s]
  1%|          | 764/65536 [08:34<11:55:54,  1.51it/s]
  1%|          | 765/65536 [08:35<12:19:36,  1.46it/s]
  1%|          | 766/65536 [08:36<12:15:08,  1.47it/s]
  1%|          | 767/65536 [08:36<12:06:49,  1.49it/s]
  1%|          | 768/65536 [08:37<11:54:46,  1.51it/s]
  1%|          | 769/65536 [08:38<12:08:01,  1.48it/s]
  1%|          | 770/65536 [08:38<12:07:24,  1.48it/s]
  1%|          | 771/65536 [08:39<12:20:17,  1.46it/s]
  1%|          | 772/65536 [08:40<12:16:17,  1.47it/s]
  1%|          | 773/65536 [08:40<12:11:16,  1.48it/s]
  1%|          | 774/65536 [08:41<12:05:08,  1.49it/s]
  1%|          | 775/65536 [08:41<11:35:53,  1.55it/s]
  1%|          | 776/65536 [08:42<11:44:38,  1.53it/s]
  1%|          | 777/65536 [08:43<11:44:24,  1.53it/s]
  1%|          | 778/65536 [08:44<12:15:06,  1.47it/s]
  1%|          | 779/65536 [08:44<11:59:12,  1.50it/s]
  1%|          | 780/65536 [08:45<12:07:15,  1.48it/s]
                                                      
{'loss': 1.796, 'learning_rate': 9.920105301824414e-07, 'epoch': 48.15}

  1%|          | 780/65536 [08:45<12:07:15,  1.48it/s]
  1%|          | 781/65536 [08:46<12:01:29,  1.50it/s]
  1%|          | 782/65536 [08:46<12:08:42,  1.48it/s]
  1%|          | 783/65536 [08:47<12:05:44,  1.49it/s]
  1%|          | 784/65536 [08:48<11:44:52,  1.53it/s]
  1%|          | 785/65536 [08:48<11:50:33,  1.52it/s]
  1%|          | 786/65536 [08:49<12:06:35,  1.49it/s]
  1%|          | 787/65536 [08:50<11:55:43,  1.51it/s]
  1%|          | 788/65536 [08:50<12:01:51,  1.49it/s]
  1%|          | 789/65536 [08:51<11:55:10,  1.51it/s]
  1%|          | 790/65536 [08:52<11:56:26,  1.51it/s]
  1%|          | 791/65536 [08:52<11:57:18,  1.50it/s]
  1%|          | 792/65536 [08:53<11:46:09,  1.53it/s]
  1%|          | 793/65536 [08:53<11:55:36,  1.51it/s]
  1%|          | 794/65536 [08:54<12:31:59,  1.43it/s]
  1%|          | 795/65536 [08:55<12:16:03,  1.47it/s]
  1%|          | 796/65536 [08:56<12:16:31,  1.46it/s]
  1%|          | 797/65536 [08:56<12:09:06,  1.48it/s]
  1%|          | 798/65536 [08:57<11:59:37,  1.50it/s]
  1%|          | 799/65536 [08:58<11:49:35,  1.52it/s]
  1%|          | 800/65536 [08:58<11:58:08,  1.50it/s]
                                                      
{'loss': 1.7148, 'learning_rate': 9.917350312232155e-07, 'epoch': 49.38}

  1%|          | 800/65536 [08:58<11:58:08,  1.50it/s]
  1%|          | 801/65536 [08:59<12:33:46,  1.43it/s]
  1%|          | 802/65536 [09:00<12:09:41,  1.48it/s]
  1%|          | 803/65536 [09:00<11:55:55,  1.51it/s]
  1%|          | 804/65536 [09:01<12:11:10,  1.48it/s]
  1%|          | 805/65536 [09:02<12:04:18,  1.49it/s]
  1%|          | 806/65536 [09:02<12:02:55,  1.49it/s]
  1%|          | 807/65536 [09:03<11:47:18,  1.53it/s]
  1%|          | 808/65536 [09:04<11:57:11,  1.50it/s]
  1%|          | 809/65536 [09:04<12:07:45,  1.48it/s]
  1%|          | 810/65536 [09:05<12:00:53,  1.50it/s]
  1%|          | 811/65536 [09:06<12:13:19,  1.47it/s]
  1%|          | 812/65536 [09:06<12:22:52,  1.45it/s]
  1%|          | 813/65536 [09:07<12:25:36,  1.45it/s]
  1%|          | 814/65536 [09:08<12:13:10,  1.47it/s]
  1%|          | 815/65536 [09:08<12:04:23,  1.49it/s]
  1%|          | 816/65536 [09:09<12:23:32,  1.45it/s]
  1%|          | 817/65536 [09:10<12:01:57,  1.49it/s]
  1%|          | 818/65536 [09:10<11:58:44,  1.50it/s]
  1%|          | 819/65536 [09:11<11:50:24,  1.52it/s]
  1%|▏         | 820/65536 [09:12<11:46:04,  1.53it/s]
                                                      
{'loss': 1.7332, 'learning_rate': 9.914595322639892e-07, 'epoch': 50.62}

  1%|▏         | 820/65536 [09:12<11:46:04,  1.53it/s]
  1%|▏         | 821/65536 [09:12<11:41:00,  1.54it/s]
  1%|▏         | 822/65536 [09:13<11:47:39,  1.52it/s]
  1%|▏         | 823/65536 [09:14<11:58:23,  1.50it/s]
  1%|▏         | 824/65536 [09:14<12:20:38,  1.46it/s]
  1%|▏         | 825/65536 [09:15<12:13:35,  1.47it/s]
  1%|▏         | 826/65536 [09:16<11:52:50,  1.51it/s]
  1%|▏         | 827/65536 [09:16<12:10:10,  1.48it/s]
  1%|▏         | 828/65536 [09:17<12:03:05,  1.49it/s]
  1%|▏         | 829/65536 [09:18<12:38:20,  1.42it/s]
  1%|▏         | 830/65536 [09:18<12:08:55,  1.48it/s]
  1%|▏         | 831/65536 [09:19<12:08:41,  1.48it/s]
  1%|▏         | 832/65536 [09:20<12:05:17,  1.49it/s]
  1%|▏         | 833/65536 [09:20<11:51:23,  1.52it/s]
  1%|▏         | 834/65536 [09:21<12:11:00,  1.48it/s]
  1%|▏         | 835/65536 [09:22<11:58:06,  1.50it/s]
  1%|▏         | 836/65536 [09:22<12:00:15,  1.50it/s]
  1%|▏         | 837/65536 [09:23<12:09:28,  1.48it/s]
  1%|▏         | 838/65536 [09:24<12:16:24,  1.46it/s]
  1%|▏         | 839/65536 [09:25<12:19:14,  1.46it/s]
  1%|▏         | 840/65536 [09:25<12:01:27,  1.49it/s]
                                                      
{'loss': 1.7341, 'learning_rate': 9.91184033304763e-07, 'epoch': 51.85}

  1%|▏         | 840/65536 [09:25<12:01:27,  1.49it/s]
  1%|▏         | 841/65536 [09:26<11:49:19,  1.52it/s]
  1%|▏         | 842/65536 [09:26<11:34:12,  1.55it/s]
  1%|▏         | 843/65536 [09:27<11:55:33,  1.51it/s]
  1%|▏         | 844/65536 [09:28<12:09:31,  1.48it/s]
  1%|▏         | 845/65536 [09:29<12:11:33,  1.47it/s]
  1%|▏         | 846/65536 [09:29<12:24:02,  1.45it/s]
  1%|▏         | 847/65536 [09:30<12:14:44,  1.47it/s]
  1%|▏         | 848/65536 [09:31<12:03:54,  1.49it/s]
  1%|▏         | 849/65536 [09:31<11:55:31,  1.51it/s]
  1%|▏         | 850/65536 [09:32<12:08:50,  1.48it/s]
  1%|▏         | 851/65536 [09:33<11:55:40,  1.51it/s]
  1%|▏         | 852/65536 [09:33<12:00:51,  1.50it/s]
  1%|▏         | 853/65536 [09:34<11:44:58,  1.53it/s]
  1%|▏         | 854/65536 [09:35<12:01:22,  1.49it/s]
  1%|▏         | 855/65536 [09:35<11:59:06,  1.50it/s]
  1%|▏         | 856/65536 [09:36<12:08:50,  1.48it/s]
  1%|▏         | 857/65536 [09:37<12:08:14,  1.48it/s]
  1%|▏         | 858/65536 [09:37<11:48:16,  1.52it/s]
  1%|▏         | 859/65536 [09:38<12:07:01,  1.48it/s]
  1%|▏         | 860/65536 [09:39<11:57:19,  1.50it/s]
                                                      
{'loss': 1.7118, 'learning_rate': 9.909085343455369e-07, 'epoch': 53.09}

  1%|▏         | 860/65536 [09:39<11:57:19,  1.50it/s]
  1%|▏         | 861/65536 [09:39<11:40:55,  1.54it/s]
  1%|▏         | 862/65536 [09:40<11:40:04,  1.54it/s]
  1%|▏         | 863/65536 [09:40<11:32:24,  1.56it/s]
  1%|▏         | 864/65536 [09:41<11:41:32,  1.54it/s]
  1%|▏         | 865/65536 [09:42<12:08:20,  1.48it/s]
  1%|▏         | 866/65536 [09:43<12:18:17,  1.46it/s]
  1%|▏         | 867/65536 [09:43<12:16:24,  1.46it/s]
  1%|▏         | 868/65536 [09:44<12:07:40,  1.48it/s]
  1%|▏         | 869/65536 [09:45<12:00:59,  1.49it/s]
  1%|▏         | 870/65536 [09:45<12:29:05,  1.44it/s]
  1%|▏         | 871/65536 [09:46<12:23:19,  1.45it/s]
  1%|▏         | 872/65536 [09:47<12:20:44,  1.45it/s]
  1%|▏         | 873/65536 [09:47<12:10:37,  1.48it/s]
  1%|▏         | 874/65536 [09:48<12:26:44,  1.44it/s]
  1%|▏         | 875/65536 [09:49<12:31:54,  1.43it/s]
  1%|▏         | 876/65536 [09:49<12:21:04,  1.45it/s]
  1%|▏         | 877/65536 [09:50<12:18:30,  1.46it/s]
  1%|▏         | 878/65536 [09:51<12:02:39,  1.49it/s]
  1%|▏         | 879/65536 [09:51<11:55:44,  1.51it/s]
  1%|▏         | 880/65536 [09:52<11:44:28,  1.53it/s]
                                                      
{'loss': 1.6752, 'learning_rate': 9.906330353863107e-07, 'epoch': 54.32}

  1%|▏         | 880/65536 [09:52<11:44:28,  1.53it/s]
  1%|▏         | 881/65536 [09:53<11:41:18,  1.54it/s]
  1%|▏         | 882/65536 [09:53<11:54:04,  1.51it/s]
  1%|▏         | 883/65536 [09:54<11:39:25,  1.54it/s]
  1%|▏         | 884/65536 [09:55<11:39:51,  1.54it/s]
  1%|▏         | 885/65536 [09:55<12:18:54,  1.46it/s]
  1%|▏         | 886/65536 [09:56<12:28:35,  1.44it/s]
  1%|▏         | 887/65536 [09:57<12:16:03,  1.46it/s]
  1%|▏         | 888/65536 [09:57<12:15:39,  1.46it/s]
  1%|▏         | 889/65536 [09:58<12:22:11,  1.45it/s]
  1%|▏         | 890/65536 [09:59<12:31:42,  1.43it/s]
  1%|▏         | 891/65536 [09:59<12:17:43,  1.46it/s]
  1%|▏         | 892/65536 [10:00<12:51:57,  1.40it/s]
  1%|▏         | 893/65536 [10:01<12:27:31,  1.44it/s]
  1%|▏         | 894/65536 [10:02<12:26:51,  1.44it/s]
  1%|▏         | 895/65536 [10:02<12:13:16,  1.47it/s]
  1%|▏         | 896/65536 [10:03<11:48:14,  1.52it/s]
  1%|▏         | 897/65536 [10:04<11:45:16,  1.53it/s]
  1%|▏         | 898/65536 [10:04<11:48:29,  1.52it/s]
  1%|▏         | 899/65536 [10:05<11:59:47,  1.50it/s]
  1%|▏         | 900/65536 [10:06<12:03:50,  1.49it/s]
                                                      
{'loss': 1.6891, 'learning_rate': 9.903575364270846e-07, 'epoch': 55.56}

  1%|▏         | 900/65536 [10:06<12:03:50,  1.49it/s]
  1%|▏         | 901/65536 [10:06<12:08:51,  1.48it/s]
  1%|▏         | 902/65536 [10:07<12:23:27,  1.45it/s]
  1%|▏         | 903/65536 [10:08<12:17:00,  1.46it/s]
  1%|▏         | 904/65536 [10:08<12:02:12,  1.49it/s]
  1%|▏         | 905/65536 [10:09<11:57:55,  1.50it/s]
  1%|▏         | 906/65536 [10:10<11:34:57,  1.55it/s]
  1%|▏         | 907/65536 [10:10<11:24:47,  1.57it/s]
  1%|▏         | 908/65536 [10:11<11:41:22,  1.54it/s]
  1%|▏         | 909/65536 [10:11<11:37:28,  1.54it/s]
  1%|▏         | 910/65536 [10:12<11:37:43,  1.54it/s]
  1%|▏         | 911/65536 [10:13<11:43:52,  1.53it/s]
  1%|▏         | 912/65536 [10:14<12:15:17,  1.46it/s]
  1%|▏         | 913/65536 [10:14<12:10:25,  1.47it/s]
  1%|▏         | 914/65536 [10:15<12:15:48,  1.46it/s]
  1%|▏         | 915/65536 [10:16<12:04:25,  1.49it/s]
  1%|▏         | 916/65536 [10:16<12:01:40,  1.49it/s]
  1%|▏         | 917/65536 [10:17<12:07:16,  1.48it/s]
  1%|▏         | 918/65536 [10:18<11:57:23,  1.50it/s]
  1%|▏         | 919/65536 [10:18<12:15:35,  1.46it/s]
  1%|▏         | 920/65536 [10:19<12:08:37,  1.48it/s]
                                                      
{'loss': 1.668, 'learning_rate': 9.900820374678584e-07, 'epoch': 56.79}

  1%|▏         | 920/65536 [10:19<12:08:37,  1.48it/s]
  1%|▏         | 921/65536 [10:20<12:17:31,  1.46it/s]
  1%|▏         | 922/65536 [10:20<12:08:55,  1.48it/s]
  1%|▏         | 923/65536 [10:21<11:56:55,  1.50it/s]
  1%|▏         | 924/65536 [10:22<12:01:01,  1.49it/s]
  1%|▏         | 925/65536 [10:22<12:02:27,  1.49it/s]
  1%|▏         | 926/65536 [10:23<11:44:08,  1.53it/s]
  1%|▏         | 927/65536 [10:24<11:59:39,  1.50it/s]
  1%|▏         | 928/65536 [10:24<11:58:51,  1.50it/s]
  1%|▏         | 929/65536 [10:25<12:11:40,  1.47it/s]
  1%|▏         | 930/65536 [10:26<12:14:33,  1.47it/s]
  1%|▏         | 931/65536 [10:26<11:52:35,  1.51it/s]
  1%|▏         | 932/65536 [10:27<12:14:25,  1.47it/s]
  1%|▏         | 933/65536 [10:28<11:58:48,  1.50it/s]
  1%|▏         | 934/65536 [10:28<12:01:21,  1.49it/s]
  1%|▏         | 935/65536 [10:29<11:49:51,  1.52it/s]
  1%|▏         | 936/65536 [10:30<12:06:47,  1.48it/s]
  1%|▏         | 937/65536 [10:30<12:00:28,  1.49it/s]
  1%|▏         | 938/65536 [10:31<11:54:31,  1.51it/s]
  1%|▏         | 939/65536 [10:32<12:12:15,  1.47it/s]
  1%|▏         | 940/65536 [10:32<12:34:38,  1.43it/s]
                                                      
{'loss': 1.6915, 'learning_rate': 9.898065385086323e-07, 'epoch': 58.02}

  1%|▏         | 940/65536 [10:32<12:34:38,  1.43it/s]
  1%|▏         | 941/65536 [10:33<12:09:28,  1.48it/s]
  1%|▏         | 942/65536 [10:34<11:48:58,  1.52it/s]
  1%|▏         | 943/65536 [10:34<12:07:21,  1.48it/s]
  1%|▏         | 944/65536 [10:35<11:59:16,  1.50it/s]
  1%|▏         | 945/65536 [10:36<12:01:51,  1.49it/s]
  1%|▏         | 946/65536 [10:36<12:26:53,  1.44it/s]
  1%|▏         | 947/65536 [10:37<12:21:22,  1.45it/s]
  1%|▏         | 948/65536 [10:38<12:14:27,  1.47it/s]
  1%|▏         | 949/65536 [10:38<12:07:11,  1.48it/s]
  1%|▏         | 950/65536 [10:39<12:05:47,  1.48it/s]
  1%|▏         | 951/65536 [10:40<11:57:11,  1.50it/s]
  1%|▏         | 952/65536 [10:40<11:42:15,  1.53it/s]
  1%|▏         | 953/65536 [10:41<11:47:53,  1.52it/s]
  1%|▏         | 954/65536 [10:42<11:45:41,  1.53it/s]
  1%|▏         | 955/65536 [10:42<11:34:50,  1.55it/s]
  1%|▏         | 956/65536 [10:43<11:57:58,  1.50it/s]
  1%|▏         | 957/65536 [10:44<11:53:52,  1.51it/s]
  1%|▏         | 958/65536 [10:44<12:07:18,  1.48it/s]
  1%|▏         | 959/65536 [10:45<12:25:08,  1.44it/s]
  1%|▏         | 960/65536 [10:46<12:35:21,  1.42it/s]
                                                      
{'loss': 1.6608, 'learning_rate': 9.89531039549406e-07, 'epoch': 59.26}

  1%|▏         | 960/65536 [10:46<12:35:21,  1.42it/s]
  1%|▏         | 961/65536 [10:46<12:05:49,  1.48it/s]
  1%|▏         | 962/65536 [10:47<12:05:13,  1.48it/s]
  1%|▏         | 963/65536 [10:48<12:04:14,  1.49it/s]
  1%|▏         | 964/65536 [10:49<12:13:36,  1.47it/s]
  1%|▏         | 965/65536 [10:49<12:01:35,  1.49it/s]
  1%|▏         | 966/65536 [10:50<11:51:01,  1.51it/s]
  1%|▏         | 967/65536 [10:50<11:51:06,  1.51it/s]
  1%|▏         | 968/65536 [10:51<11:41:03,  1.54it/s]
  1%|▏         | 969/65536 [10:52<11:39:58,  1.54it/s]
  1%|▏         | 970/65536 [10:52<11:53:12,  1.51it/s]
  1%|▏         | 971/65536 [10:53<11:42:22,  1.53it/s]
  1%|▏         | 972/65536 [10:54<11:36:31,  1.54it/s]
  1%|▏         | 973/65536 [10:54<11:53:12,  1.51it/s]
  1%|▏         | 974/65536 [10:55<11:59:01,  1.50it/s]
  1%|▏         | 975/65536 [10:56<11:34:16,  1.55it/s]
  1%|▏         | 976/65536 [10:56<11:47:39,  1.52it/s]
  1%|▏         | 977/65536 [10:57<11:32:17,  1.55it/s]
  1%|▏         | 978/65536 [10:58<12:03:21,  1.49it/s]
  1%|▏         | 979/65536 [10:58<11:53:25,  1.51it/s]
  1%|▏         | 980/65536 [10:59<11:59:09,  1.50it/s]
                                                      
{'loss': 1.6739, 'learning_rate': 9.8925554059018e-07, 'epoch': 60.49}

  1%|▏         | 980/65536 [10:59<11:59:09,  1.50it/s]
  1%|▏         | 981/65536 [11:00<11:55:15,  1.50it/s]
  1%|▏         | 982/65536 [11:00<11:43:51,  1.53it/s]
  1%|▏         | 983/65536 [11:01<11:48:09,  1.52it/s]
  2%|▏         | 984/65536 [11:02<11:59:38,  1.50it/s]
  2%|▏         | 985/65536 [11:02<11:51:55,  1.51it/s]
  2%|▏         | 986/65536 [11:03<11:45:31,  1.52it/s]
  2%|▏         | 987/65536 [11:04<12:11:44,  1.47it/s]
  2%|▏         | 988/65536 [11:04<12:20:08,  1.45it/s]
  2%|▏         | 989/65536 [11:05<13:06:41,  1.37it/s]
  2%|▏         | 990/65536 [11:06<12:31:09,  1.43it/s]
  2%|▏         | 991/65536 [11:07<12:18:40,  1.46it/s]
  2%|▏         | 992/65536 [11:07<12:28:15,  1.44it/s]
  2%|▏         | 993/65536 [11:08<12:04:12,  1.49it/s]
  2%|▏         | 994/65536 [11:09<12:18:41,  1.46it/s]
  2%|▏         | 995/65536 [11:09<12:22:00,  1.45it/s]
  2%|▏         | 996/65536 [11:10<12:07:17,  1.48it/s]
  2%|▏         | 997/65536 [11:11<12:18:39,  1.46it/s]
  2%|▏         | 998/65536 [11:11<12:05:57,  1.48it/s]
  2%|▏         | 999/65536 [11:12<11:54:39,  1.51it/s]
  2%|▏         | 1000/65536 [11:13<11:51:47,  1.51it/s]
                                                       
{'loss': 1.6102, 'learning_rate': 9.889800416309537e-07, 'epoch': 61.73}

  2%|▏         | 1000/65536 [11:13<11:51:47,  1.51it/s]
  2%|▏         | 1001/65536 [11:13<11:54:34,  1.51it/s]
  2%|▏         | 1002/65536 [11:14<11:39:23,  1.54it/s]
  2%|▏         | 1003/65536 [11:15<11:38:32,  1.54it/s]
  2%|▏         | 1004/65536 [11:15<11:36:25,  1.54it/s]
  2%|▏         | 1005/65536 [11:16<11:41:25,  1.53it/s]
  2%|▏         | 1006/65536 [11:16<11:48:41,  1.52it/s]
  2%|▏         | 1007/65536 [11:17<11:55:25,  1.50it/s]
  2%|▏         | 1008/65536 [11:18<11:52:25,  1.51it/s]
  2%|▏         | 1009/65536 [11:19<12:13:41,  1.47it/s]
  2%|▏         | 1010/65536 [11:19<12:15:25,  1.46it/s]
  2%|▏         | 1011/65536 [11:20<12:06:48,  1.48it/s]
  2%|▏         | 1012/65536 [11:21<12:10:18,  1.47it/s]
  2%|▏         | 1013/65536 [11:21<12:15:24,  1.46it/s]
  2%|▏         | 1014/65536 [11:22<12:29:25,  1.43it/s]
  2%|▏         | 1015/65536 [11:23<12:19:43,  1.45it/s]
  2%|▏         | 1016/65536 [11:23<12:15:30,  1.46it/s]
  2%|▏         | 1017/65536 [11:24<12:10:34,  1.47it/s]
  2%|▏         | 1018/65536 [11:25<12:02:20,  1.49it/s]
  2%|▏         | 1019/65536 [11:25<11:55:47,  1.50it/s]
  2%|▏         | 1020/65536 [11:26<11:45:57,  1.52it/s]
                                                       
{'loss': 1.641, 'learning_rate': 9.887045426717277e-07, 'epoch': 62.96}

  2%|▏         | 1020/65536 [11:26<11:45:57,  1.52it/s]
  2%|▏         | 1021/65536 [11:27<11:56:38,  1.50it/s]
  2%|▏         | 1022/65536 [11:27<11:40:21,  1.54it/s]
  2%|▏         | 1023/65536 [11:28<11:46:02,  1.52it/s]
  2%|▏         | 1024/65536 [11:29<11:17:20,  1.59it/s]
  2%|▏         | 1025/65536 [11:29<11:18:33,  1.58it/s]
  2%|▏         | 1026/65536 [11:30<11:33:52,  1.55it/s]
  2%|▏         | 1027/65536 [11:30<11:20:18,  1.58it/s]
  2%|▏         | 1028/65536 [11:31<11:32:07,  1.55it/s]
  2%|▏         | 1029/65536 [11:32<11:37:35,  1.54it/s]
  2%|▏         | 1030/65536 [11:32<11:51:49,  1.51it/s]
  2%|▏         | 1031/65536 [11:33<12:15:18,  1.46it/s]
  2%|▏         | 1032/65536 [11:34<12:17:59,  1.46it/s]
  2%|▏         | 1033/65536 [11:35<12:30:20,  1.43it/s]
  2%|▏         | 1034/65536 [11:35<12:37:36,  1.42it/s]
  2%|▏         | 1035/65536 [11:36<12:11:51,  1.47it/s]
  2%|▏         | 1036/65536 [11:37<11:54:35,  1.50it/s]
  2%|▏         | 1037/65536 [11:37<12:05:47,  1.48it/s]
  2%|▏         | 1038/65536 [11:38<11:49:27,  1.52it/s]
  2%|▏         | 1039/65536 [11:39<11:31:58,  1.55it/s]
  2%|▏         | 1040/65536 [11:39<11:56:37,  1.50it/s]
                                                       
{'loss': 1.6541, 'learning_rate': 9.884290437125014e-07, 'epoch': 64.2}

  2%|▏         | 1040/65536 [11:39<11:56:37,  1.50it/s]
  2%|▏         | 1041/65536 [11:40<11:46:44,  1.52it/s]
  2%|▏         | 1042/65536 [11:40<11:35:41,  1.55it/s]
  2%|▏         | 1043/65536 [11:41<11:44:02,  1.53it/s]
  2%|▏         | 1044/65536 [11:42<12:00:48,  1.49it/s]
  2%|▏         | 1045/65536 [11:43<11:59:40,  1.49it/s]
  2%|▏         | 1046/65536 [11:43<12:05:24,  1.48it/s]
  2%|▏         | 1047/65536 [11:44<11:51:23,  1.51it/s]
  2%|▏         | 1048/65536 [11:45<12:08:08,  1.48it/s]
  2%|▏         | 1049/65536 [11:45<11:59:57,  1.49it/s]
  2%|▏         | 1050/65536 [11:46<12:03:31,  1.49it/s]
  2%|▏         | 1051/65536 [11:47<12:10:19,  1.47it/s]
  2%|▏         | 1052/65536 [11:47<12:18:24,  1.46it/s]
  2%|▏         | 1053/65536 [11:48<11:58:14,  1.50it/s]
  2%|▏         | 1054/65536 [11:49<12:06:14,  1.48it/s]
  2%|▏         | 1055/65536 [11:49<12:18:21,  1.46it/s]
  2%|▏         | 1056/65536 [11:50<12:34:14,  1.42it/s]
  2%|▏         | 1057/65536 [11:51<12:32:37,  1.43it/s]
  2%|▏         | 1058/65536 [11:51<12:27:06,  1.44it/s]
  2%|▏         | 1059/65536 [11:52<11:59:25,  1.49it/s]
  2%|▏         | 1060/65536 [11:53<11:50:53,  1.51it/s]
                                                       
{'loss': 1.6199, 'learning_rate': 9.881535447532755e-07, 'epoch': 65.43}

  2%|▏         | 1060/65536 [11:53<11:50:53,  1.51it/s]
  2%|▏         | 1061/65536 [11:53<11:48:52,  1.52it/s]
  2%|▏         | 1062/65536 [11:54<11:45:51,  1.52it/s]
  2%|▏         | 1063/65536 [11:55<11:36:43,  1.54it/s]
  2%|▏         | 1064/65536 [11:55<12:00:05,  1.49it/s]
  2%|▏         | 1065/65536 [11:56<11:54:06,  1.50it/s]
  2%|▏         | 1066/65536 [11:57<11:47:26,  1.52it/s]
  2%|▏         | 1067/65536 [11:57<12:01:00,  1.49it/s]
  2%|▏         | 1068/65536 [11:58<12:17:56,  1.46it/s]
  2%|▏         | 1069/65536 [11:59<11:49:08,  1.52it/s]
  2%|▏         | 1070/65536 [11:59<12:07:20,  1.48it/s]
  2%|▏         | 1071/65536 [12:00<11:51:37,  1.51it/s]
  2%|▏         | 1072/65536 [12:01<11:52:15,  1.51it/s]
  2%|▏         | 1073/65536 [12:01<12:03:56,  1.48it/s]
  2%|▏         | 1074/65536 [12:02<11:41:31,  1.53it/s]
  2%|▏         | 1075/65536 [12:03<11:56:19,  1.50it/s]
  2%|▏         | 1076/65536 [12:03<11:54:07,  1.50it/s]
  2%|▏         | 1077/65536 [12:04<11:57:24,  1.50it/s]
  2%|▏         | 1078/65536 [12:05<12:04:06,  1.48it/s]
  2%|▏         | 1079/65536 [12:05<12:28:09,  1.44it/s]
  2%|▏         | 1080/65536 [12:06<12:07:16,  1.48it/s]
                                                       
{'loss': 1.607, 'learning_rate': 9.878780457940491e-07, 'epoch': 66.67}

  2%|▏         | 1080/65536 [12:06<12:07:16,  1.48it/s]
  2%|▏         | 1081/65536 [12:07<12:12:39,  1.47it/s]
  2%|▏         | 1082/65536 [12:07<12:17:01,  1.46it/s]
  2%|▏         | 1083/65536 [12:08<12:11:28,  1.47it/s]
  2%|▏         | 1084/65536 [12:09<12:16:17,  1.46it/s]
  2%|▏         | 1085/65536 [12:09<12:04:35,  1.48it/s]
  2%|▏         | 1086/65536 [12:10<12:24:53,  1.44it/s]
  2%|▏         | 1087/65536 [12:11<12:26:24,  1.44it/s]
  2%|▏         | 1088/65536 [12:12<12:12:44,  1.47it/s]
  2%|▏         | 1089/65536 [12:12<11:57:07,  1.50it/s]
  2%|▏         | 1090/65536 [12:13<11:54:23,  1.50it/s]
  2%|▏         | 1091/65536 [12:14<11:51:04,  1.51it/s]
  2%|▏         | 1092/65536 [12:14<11:59:45,  1.49it/s]
  2%|▏         | 1093/65536 [12:15<12:00:53,  1.49it/s]
  2%|▏         | 1094/65536 [12:15<11:42:21,  1.53it/s]
  2%|▏         | 1095/65536 [12:16<11:47:53,  1.52it/s]
  2%|▏         | 1096/65536 [12:17<11:56:42,  1.50it/s]
  2%|▏         | 1097/65536 [12:18<12:13:57,  1.46it/s]
  2%|▏         | 1098/65536 [12:18<12:15:11,  1.46it/s]
  2%|▏         | 1099/65536 [12:19<11:57:15,  1.50it/s]
  2%|▏         | 1100/65536 [12:20<11:52:20,  1.51it/s]
                                                       
{'loss': 1.5502, 'learning_rate': 9.87602546834823e-07, 'epoch': 67.9}

  2%|▏         | 1100/65536 [12:20<11:52:20,  1.51it/s]
  2%|▏         | 1101/65536 [12:20<11:54:44,  1.50it/s]
  2%|▏         | 1102/65536 [12:21<12:26:52,  1.44it/s]
  2%|▏         | 1103/65536 [12:22<12:20:19,  1.45it/s]
  2%|▏         | 1104/65536 [12:22<11:53:55,  1.50it/s]
  2%|▏         | 1105/65536 [12:23<11:30:23,  1.56it/s]
  2%|▏         | 1106/65536 [12:24<11:46:36,  1.52it/s]
  2%|▏         | 1107/65536 [12:24<12:01:23,  1.49it/s]
  2%|▏         | 1108/65536 [12:25<11:58:01,  1.50it/s]
  2%|▏         | 1109/65536 [12:26<11:49:17,  1.51it/s]
  2%|▏         | 1110/65536 [12:26<11:55:57,  1.50it/s]
  2%|▏         | 1111/65536 [12:27<12:05:50,  1.48it/s]
  2%|▏         | 1112/65536 [12:28<12:01:54,  1.49it/s]
  2%|▏         | 1113/65536 [12:28<11:45:38,  1.52it/s]
  2%|▏         | 1114/65536 [12:29<11:48:17,  1.52it/s]
  2%|▏         | 1115/65536 [12:30<11:45:19,  1.52it/s]
  2%|▏         | 1116/65536 [12:30<11:52:36,  1.51it/s]
  2%|▏         | 1117/65536 [12:31<12:17:42,  1.46it/s]
  2%|▏         | 1118/65536 [12:32<12:37:29,  1.42it/s]
  2%|▏         | 1119/65536 [12:32<12:26:15,  1.44it/s]
  2%|▏         | 1120/65536 [12:33<12:18:34,  1.45it/s]
                                                       
{'loss': 1.589, 'learning_rate': 9.873270478755968e-07, 'epoch': 69.14}

  2%|▏         | 1120/65536 [12:33<12:18:34,  1.45it/s]
  2%|▏         | 1121/65536 [12:34<11:56:36,  1.50it/s]
  2%|▏         | 1122/65536 [12:34<11:56:38,  1.50it/s]
  2%|▏         | 1123/65536 [12:35<12:19:31,  1.45it/s]
  2%|▏         | 1124/65536 [12:36<12:09:56,  1.47it/s]
  2%|▏         | 1125/65536 [12:36<11:40:17,  1.53it/s]
  2%|▏         | 1126/65536 [12:37<11:58:28,  1.49it/s]
  2%|▏         | 1127/65536 [12:38<12:02:56,  1.48it/s]
  2%|▏         | 1128/65536 [12:38<11:59:28,  1.49it/s]
  2%|▏         | 1129/65536 [12:39<12:03:10,  1.48it/s]
  2%|▏         | 1130/65536 [12:40<11:58:12,  1.49it/s]
  2%|▏         | 1131/65536 [12:40<11:57:57,  1.50it/s]
  2%|▏         | 1132/65536 [12:41<11:55:56,  1.50it/s]
  2%|▏         | 1133/65536 [12:42<11:56:23,  1.50it/s]
  2%|▏         | 1134/65536 [12:42<11:46:42,  1.52it/s]
  2%|▏         | 1135/65536 [12:43<12:19:59,  1.45it/s]
  2%|▏         | 1136/65536 [12:44<12:12:22,  1.47it/s]
  2%|▏         | 1137/65536 [12:44<12:09:44,  1.47it/s]
  2%|▏         | 1138/65536 [12:45<12:05:44,  1.48it/s]
  2%|▏         | 1139/65536 [12:46<12:02:51,  1.48it/s]
  2%|▏         | 1140/65536 [12:46<11:55:41,  1.50it/s]
                                                       
{'loss': 1.592, 'learning_rate': 9.870515489163707e-07, 'epoch': 70.37}

  2%|▏         | 1140/65536 [12:46<11:55:41,  1.50it/s]
  2%|▏         | 1141/65536 [12:47<11:48:12,  1.52it/s]
  2%|▏         | 1142/65536 [12:48<11:44:01,  1.52it/s]
  2%|▏         | 1143/65536 [12:48<11:24:52,  1.57it/s]
  2%|▏         | 1144/65536 [12:49<11:31:57,  1.55it/s]
  2%|▏         | 1145/65536 [12:50<11:46:00,  1.52it/s]
  2%|▏         | 1146/65536 [12:50<12:08:20,  1.47it/s]
  2%|▏         | 1147/65536 [12:51<12:04:55,  1.48it/s]
  2%|▏         | 1148/65536 [12:52<11:56:38,  1.50it/s]
  2%|▏         | 1149/65536 [12:52<12:02:10,  1.49it/s]
  2%|▏         | 1150/65536 [12:53<12:27:35,  1.44it/s]
  2%|▏         | 1151/65536 [12:54<12:29:57,  1.43it/s]
  2%|▏         | 1152/65536 [12:55<12:45:20,  1.40it/s]
  2%|▏         | 1153/65536 [12:55<12:49:56,  1.39it/s]
  2%|▏         | 1154/65536 [12:56<12:14:31,  1.46it/s]
  2%|▏         | 1155/65536 [12:57<12:01:33,  1.49it/s]
  2%|▏         | 1156/65536 [12:57<12:11:30,  1.47it/s]
  2%|▏         | 1157/65536 [12:58<11:49:47,  1.51it/s]
  2%|▏         | 1158/65536 [12:59<11:53:52,  1.50it/s]
  2%|▏         | 1159/65536 [12:59<11:57:57,  1.49it/s]
  2%|▏         | 1160/65536 [13:00<11:59:53,  1.49it/s]
                                                       
{'loss': 1.5619, 'learning_rate': 9.867760499571445e-07, 'epoch': 71.6}

  2%|▏         | 1160/65536 [13:00<11:59:53,  1.49it/s]
  2%|▏         | 1161/65536 [13:01<12:00:36,  1.49it/s]
  2%|▏         | 1162/65536 [13:01<11:54:18,  1.50it/s]
  2%|▏         | 1163/65536 [13:02<11:48:48,  1.51it/s]
  2%|▏         | 1164/65536 [13:03<11:51:37,  1.51it/s]
  2%|▏         | 1165/65536 [13:03<11:39:02,  1.53it/s]
  2%|▏         | 1166/65536 [13:04<11:42:38,  1.53it/s]
  2%|▏         | 1167/65536 [13:05<12:15:25,  1.46it/s]
  2%|▏         | 1168/65536 [13:05<12:09:12,  1.47it/s]
  2%|▏         | 1169/65536 [13:06<11:57:30,  1.50it/s]
  2%|▏         | 1170/65536 [13:07<12:12:15,  1.47it/s]
  2%|▏         | 1171/65536 [13:07<12:09:22,  1.47it/s]
  2%|▏         | 1172/65536 [13:08<12:01:07,  1.49it/s]
  2%|▏         | 1173/65536 [13:09<11:59:58,  1.49it/s]
  2%|▏         | 1174/65536 [13:09<11:48:30,  1.51it/s]
  2%|▏         | 1175/65536 [13:10<11:53:39,  1.50it/s]
  2%|▏         | 1176/65536 [13:11<11:46:17,  1.52it/s]
  2%|▏         | 1177/65536 [13:11<11:39:57,  1.53it/s]
  2%|▏         | 1178/65536 [13:12<11:51:34,  1.51it/s]
  2%|▏         | 1179/65536 [13:13<11:50:06,  1.51it/s]
  2%|▏         | 1180/65536 [13:13<12:13:02,  1.46it/s]
                                                       
{'loss': 1.5497, 'learning_rate': 9.865005509979184e-07, 'epoch': 72.84}

  2%|▏         | 1180/65536 [13:13<12:13:02,  1.46it/s]
  2%|▏         | 1181/65536 [13:14<12:10:30,  1.47it/s]
  2%|▏         | 1182/65536 [13:15<11:59:34,  1.49it/s]
  2%|▏         | 1183/65536 [13:15<12:08:33,  1.47it/s]
  2%|▏         | 1184/65536 [13:16<12:03:15,  1.48it/s]
  2%|▏         | 1185/65536 [13:17<12:00:03,  1.49it/s]
  2%|▏         | 1186/65536 [13:17<12:17:02,  1.46it/s]
  2%|▏         | 1187/65536 [13:18<12:08:34,  1.47it/s]
  2%|▏         | 1188/65536 [13:19<12:15:45,  1.46it/s]
  2%|▏         | 1189/65536 [13:19<12:06:42,  1.48it/s]
  2%|▏         | 1190/65536 [13:20<12:00:49,  1.49it/s]
  2%|▏         | 1191/65536 [13:21<11:49:19,  1.51it/s]
  2%|▏         | 1192/65536 [13:21<12:10:36,  1.47it/s]
  2%|▏         | 1193/65536 [13:22<11:59:29,  1.49it/s]
  2%|▏         | 1194/65536 [13:23<11:52:49,  1.50it/s]
  2%|▏         | 1195/65536 [13:23<12:16:09,  1.46it/s]
  2%|▏         | 1196/65536 [13:24<12:17:04,  1.45it/s]
  2%|▏         | 1197/65536 [13:25<11:48:10,  1.51it/s]
  2%|▏         | 1198/65536 [13:25<12:09:19,  1.47it/s]
  2%|▏         | 1199/65536 [13:26<12:11:27,  1.47it/s]
  2%|▏         | 1200/65536 [13:27<12:17:23,  1.45it/s]
                                                       
{'loss': 1.5425, 'learning_rate': 9.862250520386923e-07, 'epoch': 74.07}

  2%|▏         | 1200/65536 [13:27<12:17:23,  1.45it/s]
  2%|▏         | 1201/65536 [13:27<11:52:24,  1.51it/s]
  2%|▏         | 1202/65536 [13:28<11:51:55,  1.51it/s]
  2%|▏         | 1203/65536 [13:29<12:01:34,  1.49it/s]
  2%|▏         | 1204/65536 [13:30<12:03:28,  1.48it/s]
  2%|▏         | 1205/65536 [13:30<12:03:34,  1.48it/s]
  2%|▏         | 1206/65536 [13:31<12:24:02,  1.44it/s]
  2%|▏         | 1207/65536 [13:32<12:03:48,  1.48it/s]
  2%|▏         | 1208/65536 [13:32<11:50:46,  1.51it/s]
  2%|▏         | 1209/65536 [13:33<11:42:32,  1.53it/s]
  2%|▏         | 1210/65536 [13:34<11:48:35,  1.51it/s]
  2%|▏         | 1211/65536 [13:34<11:33:38,  1.55it/s]
  2%|▏         | 1212/65536 [13:35<11:42:42,  1.53it/s]
  2%|▏         | 1213/65536 [13:35<11:34:51,  1.54it/s]
  2%|▏         | 1214/65536 [13:36<11:34:24,  1.54it/s]
  2%|▏         | 1215/65536 [13:37<11:51:57,  1.51it/s]
  2%|▏         | 1216/65536 [13:37<12:03:25,  1.48it/s]
  2%|▏         | 1217/65536 [13:38<12:18:10,  1.45it/s]
  2%|▏         | 1218/65536 [13:39<12:31:49,  1.43it/s]
  2%|▏         | 1219/65536 [13:40<12:24:34,  1.44it/s]
  2%|▏         | 1220/65536 [13:40<11:52:04,  1.51it/s]
                                                       
{'loss': 1.5568, 'learning_rate': 9.85949553079466e-07, 'epoch': 75.31}

  2%|▏         | 1220/65536 [13:40<11:52:04,  1.51it/s]
  2%|▏         | 1221/65536 [13:41<11:31:07,  1.55it/s]
  2%|▏         | 1222/65536 [13:41<11:29:44,  1.55it/s]
  2%|▏         | 1223/65536 [13:42<11:42:39,  1.53it/s]
  2%|▏         | 1224/65536 [13:43<11:38:00,  1.54it/s]
  2%|▏         | 1225/65536 [13:43<11:50:44,  1.51it/s]
  2%|▏         | 1226/65536 [13:44<12:01:40,  1.49it/s]
  2%|▏         | 1227/65536 [13:45<11:43:46,  1.52it/s]
  2%|▏         | 1228/65536 [13:45<11:46:29,  1.52it/s]
  2%|▏         | 1229/65536 [13:46<11:47:07,  1.52it/s]
  2%|▏         | 1230/65536 [13:47<12:09:34,  1.47it/s]
  2%|▏         | 1231/65536 [13:48<12:07:36,  1.47it/s]
  2%|▏         | 1232/65536 [13:48<12:01:25,  1.49it/s]
  2%|▏         | 1233/65536 [13:49<11:49:38,  1.51it/s]
  2%|▏         | 1234/65536 [13:49<11:33:34,  1.55it/s]
  2%|▏         | 1235/65536 [13:50<11:59:56,  1.49it/s]
  2%|▏         | 1236/65536 [13:51<11:53:45,  1.50it/s]
  2%|▏         | 1237/65536 [13:52<12:12:37,  1.46it/s]
  2%|▏         | 1238/65536 [13:52<11:52:04,  1.50it/s]
  2%|▏         | 1239/65536 [13:53<11:47:37,  1.51it/s]
  2%|▏         | 1240/65536 [13:53<11:53:17,  1.50it/s]
                                                       
{'loss': 1.5845, 'learning_rate': 9.8567405412024e-07, 'epoch': 76.54}

  2%|▏         | 1240/65536 [13:53<11:53:17,  1.50it/s]
  2%|▏         | 1241/65536 [13:54<11:59:36,  1.49it/s]
  2%|▏         | 1242/65536 [13:55<12:04:57,  1.48it/s]
  2%|▏         | 1243/65536 [13:56<12:07:17,  1.47it/s]
  2%|▏         | 1244/65536 [13:56<12:01:12,  1.49it/s]
  2%|▏         | 1245/65536 [13:57<11:52:43,  1.50it/s]
  2%|▏         | 1246/65536 [13:57<11:51:38,  1.51it/s]
  2%|▏         | 1247/65536 [13:58<12:02:14,  1.48it/s]
  2%|▏         | 1248/65536 [13:59<12:11:39,  1.46it/s]
  2%|▏         | 1249/65536 [14:00<12:14:32,  1.46it/s]
  2%|▏         | 1250/65536 [14:00<12:06:16,  1.48it/s]
  2%|▏         | 1251/65536 [14:01<12:03:14,  1.48it/s]
  2%|▏         | 1252/65536 [14:02<11:57:16,  1.49it/s]
  2%|▏         | 1253/65536 [14:02<11:39:14,  1.53it/s]
  2%|▏         | 1254/65536 [14:03<11:39:10,  1.53it/s]
  2%|▏         | 1255/65536 [14:04<11:51:00,  1.51it/s]
  2%|▏         | 1256/65536 [14:04<12:07:09,  1.47it/s]
  2%|▏         | 1257/65536 [14:05<12:11:08,  1.47it/s]
  2%|▏         | 1258/65536 [14:06<12:11:09,  1.47it/s]
  2%|▏         | 1259/65536 [14:06<11:57:57,  1.49it/s]
  2%|▏         | 1260/65536 [14:07<12:12:48,  1.46it/s]
                                                       
{'loss': 1.5078, 'learning_rate': 9.853985551610136e-07, 'epoch': 77.78}

  2%|▏         | 1260/65536 [14:07<12:12:48,  1.46it/s]
  2%|▏         | 1261/65536 [14:08<12:01:34,  1.48it/s]
  2%|▏         | 1262/65536 [14:08<11:58:44,  1.49it/s]
  2%|▏         | 1263/65536 [14:09<12:10:37,  1.47it/s]
  2%|▏         | 1264/65536 [14:10<12:14:49,  1.46it/s]
  2%|▏         | 1265/65536 [14:10<11:52:04,  1.50it/s]
  2%|▏         | 1266/65536 [14:11<11:58:27,  1.49it/s]
  2%|▏         | 1267/65536 [14:12<11:53:11,  1.50it/s]
  2%|▏         | 1268/65536 [14:12<12:18:25,  1.45it/s]
  2%|▏         | 1269/65536 [14:13<12:18:44,  1.45it/s]
  2%|▏         | 1270/65536 [14:14<12:06:56,  1.47it/s]
  2%|▏         | 1271/65536 [14:14<11:54:50,  1.50it/s]
  2%|▏         | 1272/65536 [14:15<12:01:25,  1.48it/s]
  2%|▏         | 1273/65536 [14:16<12:09:37,  1.47it/s]
  2%|▏         | 1274/65536 [14:16<12:02:34,  1.48it/s]
  2%|▏         | 1275/65536 [14:17<11:54:21,  1.50it/s]
  2%|▏         | 1276/65536 [14:18<11:56:15,  1.50it/s]
  2%|▏         | 1277/65536 [14:18<11:51:27,  1.51it/s]
  2%|▏         | 1278/65536 [14:19<11:46:31,  1.52it/s]
  2%|▏         | 1279/65536 [14:20<12:07:36,  1.47it/s]
  2%|▏         | 1280/65536 [14:20<12:09:51,  1.47it/s]
                                                       
{'loss': 1.5289, 'learning_rate': 9.851230562017877e-07, 'epoch': 79.01}

  2%|▏         | 1280/65536 [14:20<12:09:51,  1.47it/s]
  2%|▏         | 1281/65536 [14:21<12:13:28,  1.46it/s]
  2%|▏         | 1282/65536 [14:22<12:09:03,  1.47it/s]
  2%|▏         | 1283/65536 [14:22<12:00:12,  1.49it/s]
  2%|▏         | 1284/65536 [14:23<12:12:02,  1.46it/s]
  2%|▏         | 1285/65536 [14:24<11:48:38,  1.51it/s]
  2%|▏         | 1286/65536 [14:24<11:59:26,  1.49it/s]
  2%|▏         | 1287/65536 [14:25<12:19:07,  1.45it/s]
  2%|▏         | 1288/65536 [14:26<12:23:08,  1.44it/s]
  2%|▏         | 1289/65536 [14:27<11:48:41,  1.51it/s]
  2%|▏         | 1290/65536 [14:27<11:41:53,  1.53it/s]
  2%|▏         | 1291/65536 [14:28<12:06:45,  1.47it/s]
  2%|▏         | 1292/65536 [14:29<11:50:07,  1.51it/s]
  2%|▏         | 1293/65536 [14:29<11:47:50,  1.51it/s]
  2%|▏         | 1294/65536 [14:30<11:54:38,  1.50it/s]
  2%|▏         | 1295/65536 [14:30<11:48:37,  1.51it/s]
  2%|▏         | 1296/65536 [14:31<11:43:41,  1.52it/s]
  2%|▏         | 1297/65536 [14:32<12:00:41,  1.49it/s]
  2%|▏         | 1298/65536 [14:32<11:50:21,  1.51it/s]
  2%|▏         | 1299/65536 [14:33<11:44:47,  1.52it/s]
  2%|▏         | 1300/65536 [14:34<11:37:36,  1.53it/s]
                                                       
{'loss': 1.5366, 'learning_rate': 9.848475572425613e-07, 'epoch': 80.25}

  2%|▏         | 1300/65536 [14:34<11:37:36,  1.53it/s]
  2%|▏         | 1301/65536 [14:34<11:37:43,  1.53it/s]
  2%|▏         | 1302/65536 [14:35<11:27:52,  1.56it/s]
  2%|▏         | 1303/65536 [14:36<11:40:13,  1.53it/s]
  2%|▏         | 1304/65536 [14:36<11:59:51,  1.49it/s]
  2%|▏         | 1305/65536 [14:37<12:12:12,  1.46it/s]
  2%|▏         | 1306/65536 [14:38<12:18:15,  1.45it/s]
  2%|▏         | 1307/65536 [14:39<12:20:33,  1.45it/s]
  2%|▏         | 1308/65536 [14:39<12:17:46,  1.45it/s]
  2%|▏         | 1309/65536 [14:40<12:08:59,  1.47it/s]
  2%|▏         | 1310/65536 [14:41<11:45:02,  1.52it/s]
  2%|▏         | 1311/65536 [14:41<11:50:32,  1.51it/s]
  2%|▏         | 1312/65536 [14:42<11:46:26,  1.52it/s]
  2%|▏         | 1313/65536 [14:43<12:30:59,  1.43it/s]
  2%|▏         | 1314/65536 [14:43<12:28:58,  1.43it/s]
  2%|▏         | 1315/65536 [14:44<12:08:54,  1.47it/s]
  2%|▏         | 1316/65536 [14:45<12:24:11,  1.44it/s]
  2%|▏         | 1317/65536 [14:45<12:12:10,  1.46it/s]
  2%|▏         | 1318/65536 [14:46<11:54:01,  1.50it/s]
  2%|▏         | 1319/65536 [14:47<11:58:50,  1.49it/s]
  2%|▏         | 1320/65536 [14:47<11:41:10,  1.53it/s]
                                                       
{'loss': 1.5238, 'learning_rate': 9.845720582833354e-07, 'epoch': 81.48}

  2%|▏         | 1320/65536 [14:47<11:41:10,  1.53it/s]
  2%|▏         | 1321/65536 [14:48<11:46:10,  1.52it/s]
  2%|▏         | 1322/65536 [14:49<11:43:24,  1.52it/s]
  2%|▏         | 1323/65536 [14:49<11:47:26,  1.51it/s]
  2%|▏         | 1324/65536 [14:50<11:50:00,  1.51it/s]
  2%|▏         | 1325/65536 [14:51<11:50:52,  1.51it/s]
  2%|▏         | 1326/65536 [14:51<11:39:50,  1.53it/s]
  2%|▏         | 1327/65536 [14:52<11:39:33,  1.53it/s]
  2%|▏         | 1328/65536 [14:53<11:34:10,  1.54it/s]
  2%|▏         | 1329/65536 [14:53<11:58:12,  1.49it/s]
  2%|▏         | 1330/65536 [14:54<11:56:54,  1.49it/s]
  2%|▏         | 1331/65536 [14:55<11:54:50,  1.50it/s]
  2%|▏         | 1332/65536 [14:55<11:55:16,  1.50it/s]
  2%|▏         | 1333/65536 [14:56<12:08:28,  1.47it/s]
  2%|▏         | 1334/65536 [14:57<12:05:37,  1.47it/s]
  2%|▏         | 1335/65536 [14:57<12:15:20,  1.46it/s]
  2%|▏         | 1336/65536 [14:58<12:15:33,  1.45it/s]
  2%|▏         | 1337/65536 [14:59<12:03:34,  1.48it/s]
  2%|▏         | 1338/65536 [14:59<12:14:39,  1.46it/s]
  2%|▏         | 1339/65536 [15:00<12:03:45,  1.48it/s]
  2%|▏         | 1340/65536 [15:01<12:01:34,  1.48it/s]
                                                       
{'loss': 1.4911, 'learning_rate': 9.842965593241093e-07, 'epoch': 82.72}

  2%|▏         | 1340/65536 [15:01<12:01:34,  1.48it/s]
  2%|▏         | 1341/65536 [15:01<11:54:26,  1.50it/s]
  2%|▏         | 1342/65536 [15:02<11:55:05,  1.50it/s]
  2%|▏         | 1343/65536 [15:03<11:38:46,  1.53it/s]
  2%|▏         | 1344/65536 [15:03<11:48:06,  1.51it/s]
  2%|▏         | 1345/65536 [15:04<12:03:43,  1.48it/s]
  2%|▏         | 1346/65536 [15:05<11:46:06,  1.52it/s]
  2%|▏         | 1347/65536 [15:05<11:33:34,  1.54it/s]
  2%|▏         | 1348/65536 [15:06<11:39:46,  1.53it/s]
  2%|▏         | 1349/65536 [15:07<11:27:11,  1.56it/s]
  2%|▏         | 1350/65536 [15:07<11:35:37,  1.54it/s]
  2%|▏         | 1351/65536 [15:08<11:42:05,  1.52it/s]
  2%|▏         | 1352/65536 [15:09<11:40:47,  1.53it/s]
  2%|▏         | 1353/65536 [15:09<11:45:57,  1.52it/s]
  2%|▏         | 1354/65536 [15:10<11:54:00,  1.50it/s]
  2%|▏         | 1355/65536 [15:11<11:48:04,  1.51it/s]
  2%|▏         | 1356/65536 [15:11<11:40:18,  1.53it/s]
  2%|▏         | 1357/65536 [15:12<11:56:52,  1.49it/s]
  2%|▏         | 1358/65536 [15:13<12:19:42,  1.45it/s]
  2%|▏         | 1359/65536 [15:13<12:20:48,  1.44it/s]
  2%|▏         | 1360/65536 [15:14<12:06:37,  1.47it/s]
                                                       
{'loss': 1.5304, 'learning_rate': 9.840210603648831e-07, 'epoch': 83.95}

  2%|▏         | 1360/65536 [15:14<12:06:37,  1.47it/s]
  2%|▏         | 1361/65536 [15:15<12:32:37,  1.42it/s]
  2%|▏         | 1362/65536 [15:15<12:26:18,  1.43it/s]
  2%|▏         | 1363/65536 [15:16<12:20:56,  1.44it/s]
  2%|▏         | 1364/65536 [15:17<12:10:19,  1.46it/s]
  2%|▏         | 1365/65536 [15:17<12:01:24,  1.48it/s]
  2%|▏         | 1366/65536 [15:18<11:59:00,  1.49it/s]
  2%|▏         | 1367/65536 [15:19<11:54:50,  1.50it/s]
  2%|▏         | 1368/65536 [15:19<11:59:33,  1.49it/s]
  2%|▏         | 1369/65536 [15:20<12:15:56,  1.45it/s]
  2%|▏         | 1370/65536 [15:21<12:30:48,  1.42it/s]
  2%|▏         | 1371/65536 [15:22<12:13:58,  1.46it/s]
  2%|▏         | 1372/65536 [15:22<11:59:26,  1.49it/s]
  2%|▏         | 1373/65536 [15:23<11:50:34,  1.50it/s]
  2%|▏         | 1374/65536 [15:23<11:44:50,  1.52it/s]
  2%|▏         | 1375/65536 [15:24<11:32:25,  1.54it/s]
  2%|▏         | 1376/65536 [15:25<11:57:02,  1.49it/s]
  2%|▏         | 1377/65536 [15:25<11:47:15,  1.51it/s]
  2%|▏         | 1378/65536 [15:26<11:59:24,  1.49it/s]
  2%|▏         | 1379/65536 [15:27<11:46:42,  1.51it/s]
  2%|▏         | 1380/65536 [15:28<12:01:16,  1.48it/s]
                                                       
{'loss': 1.5215, 'learning_rate': 9.837455614056568e-07, 'epoch': 85.19}

  2%|▏         | 1380/65536 [15:28<12:01:16,  1.48it/s]
  2%|▏         | 1381/65536 [15:28<12:15:20,  1.45it/s]
  2%|▏         | 1382/65536 [15:29<12:01:10,  1.48it/s]
  2%|▏         | 1383/65536 [15:30<11:47:03,  1.51it/s]
  2%|▏         | 1384/65536 [15:30<12:13:14,  1.46it/s]
  2%|▏         | 1385/65536 [15:31<11:54:43,  1.50it/s]
  2%|▏         | 1386/65536 [15:32<11:55:05,  1.50it/s]
  2%|▏         | 1387/65536 [15:32<12:08:20,  1.47it/s]
  2%|▏         | 1388/65536 [15:33<11:56:59,  1.49it/s]
  2%|▏         | 1389/65536 [15:34<12:02:49,  1.48it/s]
  2%|▏         | 1390/65536 [15:34<12:01:29,  1.48it/s]
  2%|▏         | 1391/65536 [15:35<12:03:39,  1.48it/s]
  2%|▏         | 1392/65536 [15:36<12:02:30,  1.48it/s]
  2%|▏         | 1393/65536 [15:36<12:04:10,  1.48it/s]
  2%|▏         | 1394/65536 [15:37<12:17:05,  1.45it/s]
  2%|▏         | 1395/65536 [15:38<12:28:46,  1.43it/s]
  2%|▏         | 1396/65536 [15:38<12:22:08,  1.44it/s]
  2%|▏         | 1397/65536 [15:39<12:14:18,  1.46it/s]
  2%|▏         | 1398/65536 [15:40<12:08:16,  1.47it/s]
  2%|▏         | 1399/65536 [15:40<11:54:59,  1.50it/s]
  2%|▏         | 1400/65536 [15:41<11:39:55,  1.53it/s]
                                                       
{'loss': 1.482, 'learning_rate': 9.834700624464309e-07, 'epoch': 86.42}

  2%|▏         | 1400/65536 [15:41<11:39:55,  1.53it/s]
  2%|▏         | 1401/65536 [15:42<11:46:24,  1.51it/s]
  2%|▏         | 1402/65536 [15:42<11:42:38,  1.52it/s]
  2%|▏         | 1403/65536 [15:43<11:33:14,  1.54it/s]
  2%|▏         | 1404/65536 [15:44<11:43:02,  1.52it/s]
  2%|▏         | 1405/65536 [15:44<11:55:41,  1.49it/s]
  2%|▏         | 1406/65536 [15:45<11:51:22,  1.50it/s]
  2%|▏         | 1407/65536 [15:46<11:55:33,  1.49it/s]
  2%|▏         | 1408/65536 [15:46<11:53:56,  1.50it/s]
  2%|▏         | 1409/65536 [15:47<12:04:54,  1.47it/s]
  2%|▏         | 1410/65536 [15:48<12:03:46,  1.48it/s]
  2%|▏         | 1411/65536 [15:48<11:55:50,  1.49it/s]
  2%|▏         | 1412/65536 [15:49<11:57:47,  1.49it/s]
  2%|▏         | 1413/65536 [15:50<11:48:59,  1.51it/s]
  2%|▏         | 1414/65536 [15:50<11:38:00,  1.53it/s]
  2%|▏         | 1415/65536 [15:51<11:49:50,  1.51it/s]
  2%|▏         | 1416/65536 [15:52<12:09:58,  1.46it/s]
  2%|▏         | 1417/65536 [15:52<12:01:49,  1.48it/s]
  2%|▏         | 1418/65536 [15:53<11:55:38,  1.49it/s]
  2%|▏         | 1419/65536 [15:54<11:38:03,  1.53it/s]
  2%|▏         | 1420/65536 [15:54<11:36:35,  1.53it/s]
                                                       
{'loss': 1.4875, 'learning_rate': 9.831945634872045e-07, 'epoch': 87.65}

  2%|▏         | 1420/65536 [15:54<11:36:35,  1.53it/s]
  2%|▏         | 1421/65536 [15:55<11:44:37,  1.52it/s]
  2%|▏         | 1422/65536 [15:56<11:32:42,  1.54it/s]
  2%|▏         | 1423/65536 [15:56<11:52:44,  1.50it/s]
  2%|▏         | 1424/65536 [15:57<11:58:06,  1.49it/s]
  2%|▏         | 1425/65536 [15:58<11:43:45,  1.52it/s]
  2%|▏         | 1426/65536 [15:58<12:01:40,  1.48it/s]
  2%|▏         | 1427/65536 [15:59<11:56:09,  1.49it/s]
  2%|▏         | 1428/65536 [16:00<11:54:19,  1.50it/s]
  2%|▏         | 1429/65536 [16:00<11:40:03,  1.53it/s]
  2%|▏         | 1430/65536 [16:01<11:55:44,  1.49it/s]
  2%|▏         | 1431/65536 [16:02<11:40:01,  1.53it/s]
  2%|▏         | 1432/65536 [16:02<11:44:54,  1.52it/s]
  2%|▏         | 1433/65536 [16:03<11:43:18,  1.52it/s]
  2%|▏         | 1434/65536 [16:04<11:32:31,  1.54it/s]
  2%|▏         | 1435/65536 [16:04<11:46:59,  1.51it/s]
  2%|▏         | 1436/65536 [16:05<11:56:45,  1.49it/s]
  2%|▏         | 1437/65536 [16:06<12:14:02,  1.46it/s]
  2%|▏         | 1438/65536 [16:06<12:03:59,  1.48it/s]
  2%|▏         | 1439/65536 [16:07<11:50:44,  1.50it/s]
  2%|▏         | 1440/65536 [16:08<11:43:39,  1.52it/s]
                                                       
{'loss': 1.4923, 'learning_rate': 9.829190645279786e-07, 'epoch': 88.89}

  2%|▏         | 1440/65536 [16:08<11:43:39,  1.52it/s]
  2%|▏         | 1441/65536 [16:08<11:38:53,  1.53it/s]
  2%|▏         | 1442/65536 [16:09<12:08:49,  1.47it/s]
  2%|▏         | 1443/65536 [16:10<12:15:46,  1.45it/s]
  2%|▏         | 1444/65536 [16:10<12:10:26,  1.46it/s]
  2%|▏         | 1445/65536 [16:11<12:04:01,  1.48it/s]
  2%|▏         | 1446/65536 [16:12<11:45:32,  1.51it/s]
  2%|▏         | 1447/65536 [16:12<12:09:27,  1.46it/s]
  2%|▏         | 1448/65536 [16:13<12:08:20,  1.47it/s]
  2%|▏         | 1449/65536 [16:14<12:18:51,  1.45it/s]
  2%|▏         | 1450/65536 [16:14<12:04:23,  1.47it/s]
  2%|▏         | 1451/65536 [16:15<11:47:10,  1.51it/s]
  2%|▏         | 1452/65536 [16:16<11:30:14,  1.55it/s]
  2%|▏         | 1453/65536 [16:16<11:16:27,  1.58it/s]
  2%|▏         | 1454/65536 [16:17<11:21:51,  1.57it/s]
  2%|▏         | 1455/65536 [16:18<11:44:50,  1.52it/s]
  2%|▏         | 1456/65536 [16:18<11:54:37,  1.49it/s]
  2%|▏         | 1457/65536 [16:19<11:55:48,  1.49it/s]
  2%|▏         | 1458/65536 [16:20<11:43:16,  1.52it/s]
  2%|▏         | 1459/65536 [16:20<12:06:20,  1.47it/s]
  2%|▏         | 1460/65536 [16:21<12:17:26,  1.45it/s]
                                                       
{'loss': 1.4847, 'learning_rate': 9.826435655687522e-07, 'epoch': 90.12}

  2%|▏         | 1460/65536 [16:21<12:17:26,  1.45it/s]
  2%|▏         | 1461/65536 [16:22<12:11:34,  1.46it/s]
  2%|▏         | 1462/65536 [16:22<12:03:03,  1.48it/s]
  2%|▏         | 1463/65536 [16:23<12:26:10,  1.43it/s]
  2%|▏         | 1464/65536 [16:24<12:05:32,  1.47it/s]
  2%|▏         | 1465/65536 [16:24<11:58:44,  1.49it/s]
  2%|▏         | 1466/65536 [16:25<11:53:34,  1.50it/s]
  2%|▏         | 1467/65536 [16:26<12:02:08,  1.48it/s]
  2%|▏         | 1468/65536 [16:26<11:57:20,  1.49it/s]
  2%|▏         | 1469/65536 [16:27<11:51:10,  1.50it/s]
  2%|▏         | 1470/65536 [16:28<11:51:02,  1.50it/s]
  2%|▏         | 1471/65536 [16:28<11:43:54,  1.52it/s]
  2%|▏         | 1472/65536 [16:29<11:48:18,  1.51it/s]
  2%|▏         | 1473/65536 [16:30<11:49:44,  1.50it/s]
  2%|▏         | 1474/65536 [16:30<11:53:14,  1.50it/s]
  2%|▏         | 1475/65536 [16:31<12:10:28,  1.46it/s]
  2%|▏         | 1476/65536 [16:32<12:01:05,  1.48it/s]
  2%|▏         | 1477/65536 [16:33<12:01:12,  1.48it/s]
  2%|▏         | 1478/65536 [16:33<12:19:25,  1.44it/s]
  2%|▏         | 1479/65536 [16:34<12:02:18,  1.48it/s]
  2%|▏         | 1480/65536 [16:35<11:57:52,  1.49it/s]
                                                       
{'loss': 1.454, 'learning_rate': 9.82368066609526e-07, 'epoch': 91.36}

  2%|▏         | 1480/65536 [16:35<11:57:52,  1.49it/s]
  2%|▏         | 1481/65536 [16:35<12:11:46,  1.46it/s]
  2%|▏         | 1482/65536 [16:36<12:07:41,  1.47it/s]
  2%|▏         | 1483/65536 [16:37<12:06:37,  1.47it/s]
  2%|▏         | 1484/65536 [16:37<12:00:49,  1.48it/s]
  2%|▏         | 1485/65536 [16:38<11:55:32,  1.49it/s]
  2%|▏         | 1486/65536 [16:39<11:53:21,  1.50it/s]
  2%|▏         | 1487/65536 [16:39<11:48:11,  1.51it/s]
  2%|▏         | 1488/65536 [16:40<11:53:07,  1.50it/s]
  2%|▏         | 1489/65536 [16:41<11:59:22,  1.48it/s]
  2%|▏         | 1490/65536 [16:41<11:58:23,  1.49it/s]
  2%|▏         | 1491/65536 [16:42<12:01:00,  1.48it/s]
  2%|▏         | 1492/65536 [16:43<11:52:42,  1.50it/s]
  2%|▏         | 1493/65536 [16:43<12:02:10,  1.48it/s]
  2%|▏         | 1494/65536 [16:44<12:22:16,  1.44it/s]
  2%|▏         | 1495/65536 [16:45<12:03:46,  1.47it/s]
  2%|▏         | 1496/65536 [16:45<12:10:29,  1.46it/s]
  2%|▏         | 1497/65536 [16:46<11:57:17,  1.49it/s]
  2%|▏         | 1498/65536 [16:47<11:50:28,  1.50it/s]
  2%|▏         | 1499/65536 [16:47<11:43:20,  1.52it/s]
  2%|▏         | 1500/65536 [16:48<11:45:48,  1.51it/s]
                                                       
{'loss': 1.4597, 'learning_rate': 9.820925676503e-07, 'epoch': 92.59}

  2%|▏         | 1500/65536 [16:48<11:45:48,  1.51it/s]
  2%|▏         | 1501/65536 [16:49<11:38:29,  1.53it/s]
  2%|▏         | 1502/65536 [16:49<11:50:26,  1.50it/s]
  2%|▏         | 1503/65536 [16:50<11:47:19,  1.51it/s]
  2%|▏         | 1504/65536 [16:51<11:42:21,  1.52it/s]
  2%|▏         | 1505/65536 [16:51<11:58:05,  1.49it/s]
  2%|▏         | 1506/65536 [16:52<12:08:02,  1.47it/s]
  2%|▏         | 1507/65536 [16:53<12:15:37,  1.45it/s]
  2%|▏         | 1508/65536 [16:53<12:07:49,  1.47it/s]
  2%|▏         | 1509/65536 [16:54<12:00:26,  1.48it/s]
  2%|▏         | 1510/65536 [16:55<11:45:54,  1.51it/s]
  2%|▏         | 1511/65536 [16:55<11:47:41,  1.51it/s]
  2%|▏         | 1512/65536 [16:56<12:00:18,  1.48it/s]
  2%|▏         | 1513/65536 [16:57<11:51:44,  1.50it/s]
  2%|▏         | 1514/65536 [16:57<11:54:24,  1.49it/s]
  2%|▏         | 1515/65536 [16:58<12:06:21,  1.47it/s]
  2%|▏         | 1516/65536 [16:59<12:05:33,  1.47it/s]
  2%|▏         | 1517/65536 [16:59<11:49:48,  1.50it/s]
  2%|▏         | 1518/65536 [17:00<11:52:07,  1.50it/s]
  2%|▏         | 1519/65536 [17:01<11:57:40,  1.49it/s]
  2%|▏         | 1520/65536 [17:01<12:15:50,  1.45it/s]
                                                       
{'loss': 1.4372, 'learning_rate': 9.818170686910738e-07, 'epoch': 93.83}

  2%|▏         | 1520/65536 [17:01<12:15:50,  1.45it/s]
  2%|▏         | 1521/65536 [17:02<12:08:52,  1.46it/s]
  2%|▏         | 1522/65536 [17:03<12:11:19,  1.46it/s]
  2%|▏         | 1523/65536 [17:04<12:26:32,  1.43it/s]
  2%|▏         | 1524/65536 [17:04<12:23:12,  1.44it/s]
  2%|▏         | 1525/65536 [17:05<12:28:37,  1.43it/s]
  2%|▏         | 1526/65536 [17:06<12:05:39,  1.47it/s]
  2%|▏         | 1527/65536 [17:06<12:02:09,  1.48it/s]
  2%|▏         | 1528/65536 [17:07<11:56:38,  1.49it/s]
  2%|▏         | 1529/65536 [17:08<11:34:51,  1.54it/s]
  2%|▏         | 1530/65536 [17:08<11:56:39,  1.49it/s]
  2%|▏         | 1531/65536 [17:09<11:43:27,  1.52it/s]
  2%|▏         | 1532/65536 [17:09<11:21:15,  1.57it/s]
  2%|▏         | 1533/65536 [17:10<11:44:41,  1.51it/s]
  2%|▏         | 1534/65536 [17:11<12:09:14,  1.46it/s]
  2%|▏         | 1535/65536 [17:12<12:01:48,  1.48it/s]
  2%|▏         | 1536/65536 [17:12<12:03:31,  1.47it/s]
  2%|▏         | 1537/65536 [17:13<11:39:44,  1.52it/s]
  2%|▏         | 1538/65536 [17:14<11:46:26,  1.51it/s]
  2%|▏         | 1539/65536 [17:14<11:49:58,  1.50it/s]
  2%|▏         | 1540/65536 [17:15<11:57:54,  1.49it/s]
                                                       
{'loss': 1.4701, 'learning_rate': 9.815415697318477e-07, 'epoch': 95.06}

  2%|▏         | 1540/65536 [17:15<11:57:54,  1.49it/s]
  2%|▏         | 1541/65536 [17:16<11:52:26,  1.50it/s]
  2%|▏         | 1542/65536 [17:16<11:42:54,  1.52it/s]
  2%|▏         | 1543/65536 [17:17<11:53:36,  1.49it/s]
  2%|▏         | 1544/65536 [17:18<12:08:53,  1.46it/s]
  2%|▏         | 1545/65536 [17:18<11:44:58,  1.51it/s]
  2%|▏         | 1546/65536 [17:19<11:48:42,  1.50it/s]
  2%|▏         | 1547/65536 [17:20<11:35:08,  1.53it/s]
  2%|▏         | 1548/65536 [17:20<11:47:12,  1.51it/s]
  2%|▏         | 1549/65536 [17:21<11:42:02,  1.52it/s]
  2%|▏         | 1550/65536 [17:22<11:55:59,  1.49it/s]
  2%|▏         | 1551/65536 [17:22<11:46:15,  1.51it/s]
  2%|▏         | 1552/65536 [17:23<12:00:32,  1.48it/s]
  2%|▏         | 1553/65536 [17:24<12:06:44,  1.47it/s]
  2%|▏         | 1554/65536 [17:24<12:00:14,  1.48it/s]
  2%|▏         | 1555/65536 [17:25<12:01:28,  1.48it/s]
  2%|▏         | 1556/65536 [17:26<12:08:41,  1.46it/s]
  2%|▏         | 1557/65536 [17:26<12:04:43,  1.47it/s]
  2%|▏         | 1558/65536 [17:27<12:00:56,  1.48it/s]
  2%|▏         | 1559/65536 [17:28<11:55:31,  1.49it/s]
  2%|▏         | 1560/65536 [17:28<11:49:16,  1.50it/s]
                                                       
{'loss': 1.4573, 'learning_rate': 9.812660707726215e-07, 'epoch': 96.3}

  2%|▏         | 1560/65536 [17:28<11:49:16,  1.50it/s]
  2%|▏         | 1561/65536 [17:29<11:42:31,  1.52it/s]
  2%|▏         | 1562/65536 [17:30<11:32:00,  1.54it/s]
  2%|▏         | 1563/65536 [17:30<12:03:46,  1.47it/s]
  2%|▏         | 1564/65536 [17:31<12:25:19,  1.43it/s]
  2%|▏         | 1565/65536 [17:32<12:13:55,  1.45it/s]
  2%|▏         | 1566/65536 [17:32<12:21:25,  1.44it/s]
  2%|▏         | 1567/65536 [17:33<12:17:18,  1.45it/s]
  2%|▏         | 1568/65536 [17:34<12:10:14,  1.46it/s]
  2%|▏         | 1569/65536 [17:34<12:16:22,  1.45it/s]
  2%|▏         | 1570/65536 [17:35<12:10:25,  1.46it/s]
  2%|▏         | 1571/65536 [17:36<11:59:17,  1.48it/s]
  2%|▏         | 1572/65536 [17:37<12:06:58,  1.47it/s]
  2%|▏         | 1573/65536 [17:37<11:52:58,  1.50it/s]
  2%|▏         | 1574/65536 [17:38<11:37:29,  1.53it/s]
  2%|▏         | 1575/65536 [17:38<11:46:09,  1.51it/s]
  2%|▏         | 1576/65536 [17:39<11:51:59,  1.50it/s]
  2%|▏         | 1577/65536 [17:40<11:51:32,  1.50it/s]
  2%|▏         | 1578/65536 [17:41<12:09:19,  1.46it/s]
  2%|▏         | 1579/65536 [17:41<11:55:28,  1.49it/s]
  2%|▏         | 1580/65536 [17:42<11:50:56,  1.50it/s]
                                                       
{'loss': 1.4274, 'learning_rate': 9.809905718133954e-07, 'epoch': 97.53}

  2%|▏         | 1580/65536 [17:42<11:50:56,  1.50it/s]
  2%|▏         | 1581/65536 [17:42<11:39:51,  1.52it/s]
  2%|▏         | 1582/65536 [17:43<11:43:26,  1.52it/s]
  2%|▏         | 1583/65536 [17:44<11:49:07,  1.50it/s]
  2%|▏         | 1584/65536 [17:45<12:17:32,  1.45it/s]
  2%|▏         | 1585/65536 [17:45<12:13:12,  1.45it/s]
  2%|▏         | 1586/65536 [17:46<12:04:41,  1.47it/s]
  2%|▏         | 1587/65536 [17:47<12:07:09,  1.47it/s]
  2%|▏         | 1588/65536 [17:47<12:17:39,  1.44it/s]
  2%|▏         | 1589/65536 [17:48<12:13:18,  1.45it/s]
  2%|▏         | 1590/65536 [17:49<12:21:22,  1.44it/s]
  2%|▏         | 1591/65536 [17:49<11:59:40,  1.48it/s]
  2%|▏         | 1592/65536 [17:50<11:47:03,  1.51it/s]
  2%|▏         | 1593/65536 [17:51<11:44:43,  1.51it/s]
  2%|▏         | 1594/65536 [17:51<11:40:26,  1.52it/s]
  2%|▏         | 1595/65536 [17:52<11:32:54,  1.54it/s]
  2%|▏         | 1596/65536 [17:53<11:39:08,  1.52it/s]
  2%|▏         | 1597/65536 [17:53<11:52:45,  1.50it/s]
  2%|▏         | 1598/65536 [17:54<12:11:46,  1.46it/s]
  2%|▏         | 1599/65536 [17:55<12:07:01,  1.47it/s]
  2%|▏         | 1600/65536 [17:55<12:23:21,  1.43it/s]
                                                       
{'loss': 1.4362, 'learning_rate': 9.807150728541692e-07, 'epoch': 98.77}

  2%|▏         | 1600/65536 [17:55<12:23:21,  1.43it/s]
  2%|▏         | 1601/65536 [17:56<11:58:19,  1.48it/s]
  2%|▏         | 1602/65536 [17:57<11:48:03,  1.50it/s]
  2%|▏         | 1603/65536 [17:57<11:54:39,  1.49it/s]
  2%|▏         | 1604/65536 [17:58<12:00:48,  1.48it/s]
  2%|▏         | 1605/65536 [17:59<11:55:26,  1.49it/s]
  2%|▏         | 1606/65536 [17:59<11:49:11,  1.50it/s]
  2%|▏         | 1607/65536 [18:00<11:43:48,  1.51it/s]
  2%|▏         | 1608/65536 [18:01<11:36:29,  1.53it/s]
  2%|▏         | 1609/65536 [18:01<11:48:14,  1.50it/s]
  2%|▏         | 1610/65536 [18:02<11:42:33,  1.52it/s]
  2%|▏         | 1611/65536 [18:03<11:37:38,  1.53it/s]
  2%|▏         | 1612/65536 [18:03<11:53:43,  1.49it/s]
  2%|▏         | 1613/65536 [18:04<11:43:58,  1.51it/s]
  2%|▏         | 1614/65536 [18:05<12:04:48,  1.47it/s]
  2%|▏         | 1615/65536 [18:05<12:10:07,  1.46it/s]
  2%|▏         | 1616/65536 [18:06<12:06:34,  1.47it/s]
  2%|▏         | 1617/65536 [18:07<11:49:55,  1.50it/s]
  2%|▏         | 1618/65536 [18:07<11:57:01,  1.49it/s]
  2%|▏         | 1619/65536 [18:08<11:57:30,  1.48it/s]
  2%|▏         | 1620/65536 [18:09<11:49:00,  1.50it/s]
                                                       
{'loss': 1.449, 'learning_rate': 9.80439573894943e-07, 'epoch': 100.0}

  2%|▏         | 1620/65536 [18:09<11:49:00,  1.50it/s]
  2%|▏         | 1621/65536 [18:09<12:12:44,  1.45it/s]
  2%|▏         | 1622/65536 [18:10<12:06:21,  1.47it/s]
  2%|▏         | 1623/65536 [18:11<12:15:27,  1.45it/s]
  2%|▏         | 1624/65536 [18:11<11:56:43,  1.49it/s]
  2%|▏         | 1625/65536 [18:12<12:06:55,  1.47it/s]
  2%|▏         | 1626/65536 [18:13<11:51:25,  1.50it/s]
  2%|▏         | 1627/65536 [18:13<11:56:20,  1.49it/s]
  2%|▏         | 1628/65536 [18:14<11:47:58,  1.50it/s]
  2%|▏         | 1629/65536 [18:15<12:03:22,  1.47it/s]
  2%|▏         | 1630/65536 [18:15<11:46:59,  1.51it/s]
  2%|▏         | 1631/65536 [18:16<11:40:03,  1.52it/s]
  2%|▏         | 1632/65536 [18:17<11:49:58,  1.50it/s]
  2%|▏         | 1633/65536 [18:17<11:37:07,  1.53it/s]
  2%|▏         | 1634/65536 [18:18<11:22:18,  1.56it/s]
  2%|▏         | 1635/65536 [18:19<11:36:12,  1.53it/s]
  2%|▏         | 1636/65536 [18:19<11:49:13,  1.50it/s]
  2%|▏         | 1637/65536 [18:20<12:01:37,  1.48it/s]
  2%|▏         | 1638/65536 [18:21<11:44:38,  1.51it/s]
  3%|▎         | 1639/65536 [18:21<11:40:48,  1.52it/s]
  3%|▎         | 1640/65536 [18:22<11:30:01,  1.54it/s]
                                                       
{'loss': 1.4319, 'learning_rate': 9.801640749357167e-07, 'epoch': 101.23}

  3%|▎         | 1640/65536 [18:22<11:30:01,  1.54it/s]
  3%|▎         | 1641/65536 [18:23<11:26:52,  1.55it/s]
  3%|▎         | 1642/65536 [18:23<11:31:12,  1.54it/s]
  3%|▎         | 1643/65536 [18:24<11:39:12,  1.52it/s]
  3%|▎         | 1644/65536 [18:25<11:44:39,  1.51it/s]
  3%|▎         | 1645/65536 [18:25<11:59:22,  1.48it/s]
  3%|▎         | 1646/65536 [18:26<12:04:24,  1.47it/s]
  3%|▎         | 1647/65536 [18:27<12:17:54,  1.44it/s]
  3%|▎         | 1648/65536 [18:27<11:56:37,  1.49it/s]
  3%|▎         | 1649/65536 [18:28<11:44:08,  1.51it/s]
  3%|▎         | 1650/65536 [18:29<11:29:21,  1.54it/s]
  3%|▎         | 1651/65536 [18:29<12:08:06,  1.46it/s]
  3%|▎         | 1652/65536 [18:30<12:28:12,  1.42it/s]
  3%|▎         | 1653/65536 [18:31<12:42:15,  1.40it/s]
  3%|▎         | 1654/65536 [18:32<12:35:14,  1.41it/s]
  3%|▎         | 1655/65536 [18:32<12:14:39,  1.45it/s]
  3%|▎         | 1656/65536 [18:33<12:25:08,  1.43it/s]
  3%|▎         | 1657/65536 [18:34<12:13:52,  1.45it/s]
  3%|▎         | 1658/65536 [18:34<12:02:49,  1.47it/s]
  3%|▎         | 1659/65536 [18:35<12:02:45,  1.47it/s]
  3%|▎         | 1660/65536 [18:36<11:58:39,  1.48it/s]
                                                       
{'loss': 1.4113, 'learning_rate': 9.798885759764908e-07, 'epoch': 102.47}

  3%|▎         | 1660/65536 [18:36<11:58:39,  1.48it/s]
  3%|▎         | 1661/65536 [18:36<11:59:46,  1.48it/s]
  3%|▎         | 1662/65536 [18:37<11:57:40,  1.48it/s]
  3%|▎         | 1663/65536 [18:38<11:31:56,  1.54it/s]
  3%|▎         | 1664/65536 [18:38<11:48:01,  1.50it/s]
  3%|▎         | 1665/65536 [18:39<11:50:37,  1.50it/s]
  3%|▎         | 1666/65536 [18:40<11:44:22,  1.51it/s]
  3%|▎         | 1667/65536 [18:40<12:12:01,  1.45it/s]
  3%|▎         | 1668/65536 [18:41<11:41:20,  1.52it/s]
  3%|▎         | 1669/65536 [18:42<11:49:19,  1.50it/s]
  3%|▎         | 1670/65536 [18:42<11:32:33,  1.54it/s]
  3%|▎         | 1671/65536 [18:43<11:56:14,  1.49it/s]
  3%|▎         | 1672/65536 [18:44<11:59:13,  1.48it/s]
  3%|▎         | 1673/65536 [18:44<11:52:54,  1.49it/s]
  3%|▎         | 1674/65536 [18:45<11:51:39,  1.50it/s]
  3%|▎         | 1675/65536 [18:46<11:49:40,  1.50it/s]
  3%|▎         | 1676/65536 [18:46<12:18:10,  1.44it/s]
  3%|▎         | 1677/65536 [18:47<12:11:28,  1.46it/s]
  3%|▎         | 1678/65536 [18:48<11:57:04,  1.48it/s]
  3%|▎         | 1679/65536 [18:48<11:43:58,  1.51it/s]
  3%|▎         | 1680/65536 [18:49<11:38:22,  1.52it/s]
                                                       
{'loss': 1.421, 'learning_rate': 9.796130770172645e-07, 'epoch': 103.7}

  3%|▎         | 1680/65536 [18:49<11:38:22,  1.52it/s]
  3%|▎         | 1681/65536 [18:50<11:50:15,  1.50it/s]
  3%|▎         | 1682/65536 [18:50<11:43:39,  1.51it/s]
  3%|▎         | 1683/65536 [18:51<11:51:10,  1.50it/s]
  3%|▎         | 1684/65536 [18:52<11:58:24,  1.48it/s]
  3%|▎         | 1685/65536 [18:52<12:10:34,  1.46it/s]
  3%|▎         | 1686/65536 [18:53<12:12:44,  1.45it/s]
  3%|▎         | 1687/65536 [18:54<11:55:40,  1.49it/s]
  3%|▎         | 1688/65536 [18:54<12:00:31,  1.48it/s]
  3%|▎         | 1689/65536 [18:55<12:24:42,  1.43it/s]
  3%|▎         | 1690/65536 [18:56<12:16:32,  1.44it/s]
  3%|▎         | 1691/65536 [18:57<12:16:10,  1.45it/s]
  3%|▎         | 1692/65536 [18:57<11:58:08,  1.48it/s]
  3%|▎         | 1693/65536 [18:58<11:56:06,  1.49it/s]
  3%|▎         | 1694/65536 [18:59<11:55:16,  1.49it/s]
  3%|▎         | 1695/65536 [18:59<11:54:20,  1.49it/s]
  3%|▎         | 1696/65536 [19:00<11:55:11,  1.49it/s]
  3%|▎         | 1697/65536 [19:01<11:56:31,  1.48it/s]
  3%|▎         | 1698/65536 [19:01<12:05:34,  1.47it/s]
  3%|▎         | 1699/65536 [19:02<12:07:46,  1.46it/s]
  3%|▎         | 1700/65536 [19:03<11:58:52,  1.48it/s]
                                                       
{'loss': 1.3984, 'learning_rate': 9.793375780580385e-07, 'epoch': 104.94}

  3%|▎         | 1700/65536 [19:03<11:58:52,  1.48it/s]
  3%|▎         | 1701/65536 [19:03<11:38:17,  1.52it/s]
  3%|▎         | 1702/65536 [19:04<12:01:40,  1.47it/s]
  3%|▎         | 1703/65536 [19:05<11:30:58,  1.54it/s]
  3%|▎         | 1704/65536 [19:05<11:43:35,  1.51it/s]
  3%|▎         | 1705/65536 [19:06<11:46:58,  1.50it/s]
  3%|▎         | 1706/65536 [19:07<11:45:57,  1.51it/s]
  3%|▎         | 1707/65536 [19:07<11:43:53,  1.51it/s]
  3%|▎         | 1708/65536 [19:08<11:27:52,  1.55it/s]
  3%|▎         | 1709/65536 [19:08<11:37:30,  1.53it/s]
  3%|▎         | 1710/65536 [19:09<11:31:00,  1.54it/s]
  3%|▎         | 1711/65536 [19:10<11:28:37,  1.54it/s]
  3%|▎         | 1712/65536 [19:10<11:46:29,  1.51it/s]
  3%|▎         | 1713/65536 [19:11<11:49:12,  1.50it/s]
  3%|▎         | 1714/65536 [19:12<11:44:14,  1.51it/s]
  3%|▎         | 1715/65536 [19:12<11:37:30,  1.52it/s]
  3%|▎         | 1716/65536 [19:13<11:53:09,  1.49it/s]
  3%|▎         | 1717/65536 [19:14<12:10:39,  1.46it/s]
  3%|▎         | 1718/65536 [19:15<12:24:37,  1.43it/s]
  3%|▎         | 1719/65536 [19:15<11:59:51,  1.48it/s]
  3%|▎         | 1720/65536 [19:16<12:07:09,  1.46it/s]
                                                       
{'loss': 1.4411, 'learning_rate': 9.790620790988122e-07, 'epoch': 106.17}

  3%|▎         | 1720/65536 [19:16<12:07:09,  1.46it/s]
  3%|▎         | 1721/65536 [19:17<12:34:58,  1.41it/s]
  3%|▎         | 1722/65536 [19:17<12:34:24,  1.41it/s]
  3%|▎         | 1723/65536 [19:18<12:20:45,  1.44it/s]
  3%|▎         | 1724/65536 [19:19<12:14:36,  1.45it/s]
  3%|▎         | 1725/65536 [19:19<12:00:51,  1.48it/s]
  3%|▎         | 1726/65536 [19:20<11:55:09,  1.49it/s]
  3%|▎         | 1727/65536 [19:21<11:22:32,  1.56it/s]
  3%|▎         | 1728/65536 [19:21<11:32:40,  1.54it/s]
  3%|▎         | 1729/65536 [19:22<11:45:04,  1.51it/s]
  3%|▎         | 1730/65536 [19:23<11:38:11,  1.52it/s]
  3%|▎         | 1731/65536 [19:23<11:41:57,  1.51it/s]
  3%|▎         | 1732/65536 [19:24<11:47:05,  1.50it/s]
  3%|▎         | 1733/65536 [19:25<11:47:02,  1.50it/s]
  3%|▎         | 1734/65536 [19:25<12:13:24,  1.45it/s]
  3%|▎         | 1735/65536 [19:26<12:15:46,  1.45it/s]
  3%|▎         | 1736/65536 [19:27<12:17:19,  1.44it/s]
  3%|▎         | 1737/65536 [19:27<11:47:41,  1.50it/s]
  3%|▎         | 1738/65536 [19:28<11:47:14,  1.50it/s]
  3%|▎         | 1739/65536 [19:29<11:46:13,  1.51it/s]
  3%|▎         | 1740/65536 [19:29<11:36:51,  1.53it/s]
                                                       
{'loss': 1.4239, 'learning_rate': 9.787865801395862e-07, 'epoch': 107.41}

  3%|▎         | 1740/65536 [19:29<11:36:51,  1.53it/s]
  3%|▎         | 1741/65536 [19:30<11:41:18,  1.52it/s]
  3%|▎         | 1742/65536 [19:31<11:41:43,  1.52it/s]
  3%|▎         | 1743/65536 [19:31<11:35:04,  1.53it/s]
  3%|▎         | 1744/65536 [19:32<11:28:05,  1.55it/s]
  3%|▎         | 1745/65536 [19:33<11:55:17,  1.49it/s]
  3%|▎         | 1746/65536 [19:33<12:12:51,  1.45it/s]
  3%|▎         | 1747/65536 [19:34<12:07:40,  1.46it/s]
  3%|▎         | 1748/65536 [19:35<11:49:46,  1.50it/s]
  3%|▎         | 1749/65536 [19:35<11:54:56,  1.49it/s]
  3%|▎         | 1750/65536 [19:36<12:03:14,  1.47it/s]
  3%|▎         | 1751/65536 [19:37<11:49:36,  1.50it/s]
  3%|▎         | 1752/65536 [19:37<11:46:36,  1.50it/s]
  3%|▎         | 1753/65536 [19:38<11:50:53,  1.50it/s]
  3%|▎         | 1754/65536 [19:39<11:47:27,  1.50it/s]
  3%|▎         | 1755/65536 [19:39<11:56:16,  1.48it/s]
  3%|▎         | 1756/65536 [19:40<11:54:07,  1.49it/s]
  3%|▎         | 1757/65536 [19:41<11:46:23,  1.50it/s]
  3%|▎         | 1758/65536 [19:41<11:47:54,  1.50it/s]
  3%|▎         | 1759/65536 [19:42<12:07:45,  1.46it/s]
  3%|▎         | 1760/65536 [19:43<12:03:44,  1.47it/s]
                                                       
{'loss': 1.4101, 'learning_rate': 9.785110811803599e-07, 'epoch': 108.64}

  3%|▎         | 1760/65536 [19:43<12:03:44,  1.47it/s]
  3%|▎         | 1761/65536 [19:43<11:49:27,  1.50it/s]
  3%|▎         | 1762/65536 [19:44<11:50:40,  1.50it/s]
  3%|▎         | 1763/65536 [19:45<11:55:35,  1.49it/s]
  3%|▎         | 1764/65536 [19:45<12:00:56,  1.47it/s]
  3%|▎         | 1765/65536 [19:46<12:22:05,  1.43it/s]
  3%|▎         | 1766/65536 [19:47<12:13:28,  1.45it/s]
  3%|▎         | 1767/65536 [19:48<12:08:30,  1.46it/s]
  3%|▎         | 1768/65536 [19:48<11:51:50,  1.49it/s]
  3%|▎         | 1769/65536 [19:49<11:42:41,  1.51it/s]
  3%|▎         | 1770/65536 [19:50<11:53:57,  1.49it/s]
  3%|▎         | 1771/65536 [19:50<11:51:15,  1.49it/s]
  3%|▎         | 1772/65536 [19:51<12:01:02,  1.47it/s]
  3%|▎         | 1773/65536 [19:52<12:05:14,  1.47it/s]
  3%|▎         | 1774/65536 [19:52<11:47:02,  1.50it/s]
  3%|▎         | 1775/65536 [19:53<11:58:09,  1.48it/s]
  3%|▎         | 1776/65536 [19:54<11:46:17,  1.50it/s]
  3%|▎         | 1777/65536 [19:54<11:26:20,  1.55it/s]
  3%|▎         | 1778/65536 [19:55<11:28:51,  1.54it/s]
  3%|▎         | 1779/65536 [19:55<11:37:58,  1.52it/s]
  3%|▎         | 1780/65536 [19:56<11:52:45,  1.49it/s]
                                                       
{'loss': 1.4035, 'learning_rate': 9.782355822211337e-07, 'epoch': 109.88}

  3%|▎         | 1780/65536 [19:56<11:52:45,  1.49it/s]
  3%|▎         | 1781/65536 [19:57<11:46:41,  1.50it/s]
  3%|▎         | 1782/65536 [19:57<11:46:52,  1.50it/s]
  3%|▎         | 1783/65536 [19:58<12:02:42,  1.47it/s]
  3%|▎         | 1784/65536 [19:59<11:42:58,  1.51it/s]
  3%|▎         | 1785/65536 [19:59<11:43:23,  1.51it/s]
  3%|▎         | 1786/65536 [20:00<11:41:34,  1.51it/s]
  3%|▎         | 1787/65536 [20:01<11:22:21,  1.56it/s]
  3%|▎         | 1788/65536 [20:01<11:36:27,  1.53it/s]
  3%|▎         | 1789/65536 [20:02<11:41:35,  1.51it/s]
  3%|▎         | 1790/65536 [20:03<11:47:05,  1.50it/s]
  3%|▎         | 1791/65536 [20:03<11:46:01,  1.50it/s]
  3%|▎         | 1792/65536 [20:04<11:49:25,  1.50it/s]
  3%|▎         | 1793/65536 [20:05<11:58:30,  1.48it/s]
  3%|▎         | 1794/65536 [20:05<11:48:42,  1.50it/s]
  3%|▎         | 1795/65536 [20:06<11:25:52,  1.55it/s]
  3%|▎         | 1796/65536 [20:07<11:36:11,  1.53it/s]
  3%|▎         | 1797/65536 [20:07<11:41:52,  1.51it/s]
  3%|▎         | 1798/65536 [20:08<11:56:20,  1.48it/s]
  3%|▎         | 1799/65536 [20:09<12:30:32,  1.42it/s]
  3%|▎         | 1800/65536 [20:10<12:10:04,  1.46it/s]
                                                       
{'loss': 1.4335, 'learning_rate': 9.779600832619076e-07, 'epoch': 111.11}

  3%|▎         | 1800/65536 [20:10<12:10:04,  1.46it/s]
  3%|▎         | 1801/65536 [20:10<12:03:59,  1.47it/s]
  3%|▎         | 1802/65536 [20:11<11:58:01,  1.48it/s]
  3%|▎         | 1803/65536 [20:12<11:57:27,  1.48it/s]
  3%|▎         | 1804/65536 [20:12<11:55:32,  1.48it/s]
  3%|▎         | 1805/65536 [20:13<12:05:52,  1.46it/s]
  3%|▎         | 1806/65536 [20:14<12:29:20,  1.42it/s]
  3%|▎         | 1807/65536 [20:14<12:23:06,  1.43it/s]
  3%|▎         | 1808/65536 [20:15<12:26:58,  1.42it/s]
  3%|▎         | 1809/65536 [20:16<12:15:29,  1.44it/s]
  3%|▎         | 1810/65536 [20:16<11:59:00,  1.48it/s]
  3%|▎         | 1811/65536 [20:17<11:46:12,  1.50it/s]
  3%|▎         | 1812/65536 [20:18<11:47:34,  1.50it/s]
  3%|▎         | 1813/65536 [20:18<11:42:35,  1.51it/s]
  3%|▎         | 1814/65536 [20:19<11:40:21,  1.52it/s]
  3%|▎         | 1815/65536 [20:20<11:40:09,  1.52it/s]
  3%|▎         | 1816/65536 [20:20<11:59:40,  1.48it/s]
  3%|▎         | 1817/65536 [20:21<11:50:48,  1.49it/s]
  3%|▎         | 1818/65536 [20:22<11:51:06,  1.49it/s]
  3%|▎         | 1819/65536 [20:22<11:55:14,  1.48it/s]
  3%|▎         | 1820/65536 [20:23<12:05:32,  1.46it/s]
                                                       
{'loss': 1.3596, 'learning_rate': 9.776845843026815e-07, 'epoch': 112.35}

  3%|▎         | 1820/65536 [20:23<12:05:32,  1.46it/s]
  3%|▎         | 1821/65536 [20:24<12:02:36,  1.47it/s]
  3%|▎         | 1822/65536 [20:24<11:42:07,  1.51it/s]
  3%|▎         | 1823/65536 [20:25<11:38:12,  1.52it/s]
  3%|▎         | 1824/65536 [20:26<11:31:36,  1.54it/s]
  3%|▎         | 1825/65536 [20:26<11:54:35,  1.49it/s]
  3%|▎         | 1826/65536 [20:27<11:43:30,  1.51it/s]
  3%|▎         | 1827/65536 [20:28<11:47:23,  1.50it/s]
  3%|▎         | 1828/65536 [20:28<11:52:26,  1.49it/s]
  3%|▎         | 1829/65536 [20:29<12:15:47,  1.44it/s]
  3%|▎         | 1830/65536 [20:30<12:02:52,  1.47it/s]
  3%|▎         | 1831/65536 [20:30<12:04:34,  1.47it/s]
  3%|▎         | 1832/65536 [20:31<12:14:02,  1.45it/s]
  3%|▎         | 1833/65536 [20:32<11:57:58,  1.48it/s]
  3%|▎         | 1834/65536 [20:32<11:52:22,  1.49it/s]
  3%|▎         | 1835/65536 [20:33<12:04:08,  1.47it/s]
  3%|▎         | 1836/65536 [20:34<12:05:34,  1.46it/s]
  3%|▎         | 1837/65536 [20:35<12:08:09,  1.46it/s]
  3%|▎         | 1838/65536 [20:35<12:22:21,  1.43it/s]
  3%|▎         | 1839/65536 [20:36<12:13:57,  1.45it/s]
  3%|▎         | 1840/65536 [20:37<11:57:19,  1.48it/s]
                                                       
{'loss': 1.3717, 'learning_rate': 9.774090853434553e-07, 'epoch': 113.58}

  3%|▎         | 1840/65536 [20:37<11:57:19,  1.48it/s]
  3%|▎         | 1841/65536 [20:37<12:08:14,  1.46it/s]
  3%|▎         | 1842/65536 [20:38<11:55:48,  1.48it/s]
  3%|▎         | 1843/65536 [20:39<11:43:44,  1.51it/s]
  3%|▎         | 1844/65536 [20:39<11:49:53,  1.50it/s]
  3%|▎         | 1845/65536 [20:40<11:56:39,  1.48it/s]
  3%|▎         | 1846/65536 [20:41<11:44:29,  1.51it/s]
  3%|▎         | 1847/65536 [20:41<12:05:56,  1.46it/s]
  3%|▎         | 1848/65536 [20:42<11:53:42,  1.49it/s]
  3%|▎         | 1849/65536 [20:43<11:52:34,  1.49it/s]
  3%|▎         | 1850/65536 [20:43<11:25:59,  1.55it/s]
  3%|▎         | 1851/65536 [20:44<11:28:33,  1.54it/s]
  3%|▎         | 1852/65536 [20:45<11:39:19,  1.52it/s]
  3%|▎         | 1853/65536 [20:45<12:07:24,  1.46it/s]
  3%|▎         | 1854/65536 [20:46<11:48:11,  1.50it/s]
  3%|▎         | 1855/65536 [20:47<11:38:55,  1.52it/s]
  3%|▎         | 1856/65536 [20:47<11:50:43,  1.49it/s]
  3%|▎         | 1857/65536 [20:48<12:04:07,  1.47it/s]
  3%|▎         | 1858/65536 [20:49<11:56:12,  1.48it/s]
  3%|▎         | 1859/65536 [20:49<11:47:06,  1.50it/s]
  3%|▎         | 1860/65536 [20:50<12:05:37,  1.46it/s]
                                                       
{'loss': 1.4042, 'learning_rate': 9.771335863842292e-07, 'epoch': 114.81}

  3%|▎         | 1860/65536 [20:50<12:05:37,  1.46it/s]
  3%|▎         | 1861/65536 [20:51<11:45:06,  1.51it/s]
  3%|▎         | 1862/65536 [20:51<11:44:29,  1.51it/s]
  3%|▎         | 1863/65536 [20:52<11:25:25,  1.55it/s]
  3%|▎         | 1864/65536 [20:53<11:49:28,  1.50it/s]
  3%|▎         | 1865/65536 [20:53<11:49:15,  1.50it/s]
  3%|▎         | 1866/65536 [20:54<12:26:13,  1.42it/s]
  3%|▎         | 1867/65536 [20:55<12:21:57,  1.43it/s]
  3%|▎         | 1868/65536 [20:55<12:03:33,  1.47it/s]
  3%|▎         | 1869/65536 [20:56<11:44:55,  1.51it/s]
  3%|▎         | 1870/65536 [20:57<11:36:34,  1.52it/s]
  3%|▎         | 1871/65536 [20:57<11:42:27,  1.51it/s]
  3%|▎         | 1872/65536 [20:58<11:51:55,  1.49it/s]
  3%|▎         | 1873/65536 [20:59<11:49:27,  1.50it/s]
  3%|▎         | 1874/65536 [20:59<11:41:33,  1.51it/s]
  3%|▎         | 1875/65536 [21:00<11:21:36,  1.56it/s]
  3%|▎         | 1876/65536 [21:01<11:09:39,  1.58it/s]
  3%|▎         | 1877/65536 [21:01<11:37:26,  1.52it/s]
  3%|▎         | 1878/65536 [21:02<11:30:02,  1.54it/s]
  3%|▎         | 1879/65536 [21:03<11:27:29,  1.54it/s]
  3%|▎         | 1880/65536 [21:03<11:58:48,  1.48it/s]
                                                       
{'loss': 1.4239, 'learning_rate': 9.76858087425003e-07, 'epoch': 116.05}

  3%|▎         | 1880/65536 [21:03<11:58:48,  1.48it/s]
  3%|▎         | 1881/65536 [21:04<12:04:58,  1.46it/s]
  3%|▎         | 1882/65536 [21:05<11:55:04,  1.48it/s]
  3%|▎         | 1883/65536 [21:05<11:59:42,  1.47it/s]
  3%|▎         | 1884/65536 [21:06<11:51:52,  1.49it/s]
  3%|▎         | 1885/65536 [21:07<11:34:32,  1.53it/s]
  3%|▎         | 1886/65536 [21:07<11:52:45,  1.49it/s]
  3%|▎         | 1887/65536 [21:08<12:05:47,  1.46it/s]
  3%|▎         | 1888/65536 [21:09<11:59:32,  1.47it/s]
  3%|▎         | 1889/65536 [21:09<11:42:55,  1.51it/s]
  3%|▎         | 1890/65536 [21:10<11:34:26,  1.53it/s]
  3%|▎         | 1891/65536 [21:11<11:17:58,  1.56it/s]
  3%|▎         | 1892/65536 [21:11<11:26:42,  1.54it/s]
  3%|▎         | 1893/65536 [21:12<11:28:29,  1.54it/s]
  3%|▎         | 1894/65536 [21:13<11:41:54,  1.51it/s]
  3%|▎         | 1895/65536 [21:13<11:43:53,  1.51it/s]
  3%|▎         | 1896/65536 [21:14<12:24:01,  1.43it/s]
  3%|▎         | 1897/65536 [21:15<12:00:27,  1.47it/s]
  3%|▎         | 1898/65536 [21:15<11:58:43,  1.48it/s]
  3%|▎         | 1899/65536 [21:16<11:47:57,  1.50it/s]
  3%|▎         | 1900/65536 [21:17<11:34:08,  1.53it/s]
                                                       
{'loss': 1.4094, 'learning_rate': 9.765825884657767e-07, 'epoch': 117.28}

  3%|▎         | 1900/65536 [21:17<11:34:08,  1.53it/s]
  3%|▎         | 1901/65536 [21:17<11:39:56,  1.52it/s]
  3%|▎         | 1902/65536 [21:18<11:45:34,  1.50it/s]
  3%|▎         | 1903/65536 [21:19<11:34:12,  1.53it/s]
  3%|▎         | 1904/65536 [21:19<11:41:49,  1.51it/s]
  3%|▎         | 1905/65536 [21:20<11:36:48,  1.52it/s]
  3%|▎         | 1906/65536 [21:21<11:46:24,  1.50it/s]
  3%|▎         | 1907/65536 [21:21<12:03:46,  1.47it/s]
  3%|▎         | 1908/65536 [21:22<11:51:16,  1.49it/s]
  3%|▎         | 1909/65536 [21:23<11:43:22,  1.51it/s]
  3%|▎         | 1910/65536 [21:23<11:50:56,  1.49it/s]
  3%|▎         | 1911/65536 [21:24<11:53:54,  1.49it/s]
  3%|▎         | 1912/65536 [21:25<12:06:59,  1.46it/s]
  3%|▎         | 1913/65536 [21:25<11:52:08,  1.49it/s]
  3%|▎         | 1914/65536 [21:26<11:57:29,  1.48it/s]
  3%|▎         | 1915/65536 [21:27<11:52:50,  1.49it/s]
  3%|▎         | 1916/65536 [21:27<12:10:26,  1.45it/s]
  3%|▎         | 1917/65536 [21:28<12:13:06,  1.45it/s]
  3%|▎         | 1918/65536 [21:29<11:57:38,  1.48it/s]
  3%|▎         | 1919/65536 [21:29<11:53:12,  1.49it/s]
  3%|▎         | 1920/65536 [21:30<11:51:49,  1.49it/s]
                                                       
{'loss': 1.3748, 'learning_rate': 9.763070895065508e-07, 'epoch': 118.52}

  3%|▎         | 1920/65536 [21:30<11:51:49,  1.49it/s]
  3%|▎         | 1921/65536 [21:31<11:50:12,  1.49it/s]
  3%|▎         | 1922/65536 [21:31<11:53:41,  1.49it/s]
  3%|▎         | 1923/65536 [21:32<11:46:40,  1.50it/s]
  3%|▎         | 1924/65536 [21:33<11:53:39,  1.49it/s]
  3%|▎         | 1925/65536 [21:33<11:44:58,  1.50it/s]
  3%|▎         | 1926/65536 [21:34<11:40:17,  1.51it/s]
  3%|▎         | 1927/65536 [21:35<11:57:07,  1.48it/s]
  3%|▎         | 1928/65536 [21:35<11:54:38,  1.48it/s]
  3%|▎         | 1929/65536 [21:36<11:56:52,  1.48it/s]
  3%|▎         | 1930/65536 [21:37<11:43:55,  1.51it/s]
  3%|▎         | 1931/65536 [21:37<11:56:20,  1.48it/s]
  3%|▎         | 1932/65536 [21:38<11:58:30,  1.48it/s]
  3%|▎         | 1933/65536 [21:39<11:51:17,  1.49it/s]
  3%|▎         | 1934/65536 [21:39<11:49:36,  1.49it/s]
  3%|▎         | 1935/65536 [21:40<11:45:37,  1.50it/s]
  3%|▎         | 1936/65536 [21:41<11:45:41,  1.50it/s]
  3%|▎         | 1937/65536 [21:41<11:30:44,  1.53it/s]
  3%|▎         | 1938/65536 [21:42<11:47:37,  1.50it/s]
  3%|▎         | 1939/65536 [21:43<11:33:08,  1.53it/s]
  3%|▎         | 1940/65536 [21:43<11:45:57,  1.50it/s]
                                                       
{'loss': 1.379, 'learning_rate': 9.760315905473244e-07, 'epoch': 119.75}

  3%|▎         | 1940/65536 [21:43<11:45:57,  1.50it/s]
  3%|▎         | 1941/65536 [21:44<11:49:35,  1.49it/s]
  3%|▎         | 1942/65536 [21:45<12:05:57,  1.46it/s]
  3%|▎         | 1943/65536 [21:45<12:02:38,  1.47it/s]
  3%|▎         | 1944/65536 [21:46<11:55:58,  1.48it/s]
  3%|▎         | 1945/65536 [21:47<12:13:08,  1.45it/s]
  3%|▎         | 1946/65536 [21:48<12:09:10,  1.45it/s]
  3%|▎         | 1947/65536 [21:48<11:52:36,  1.49it/s]
  3%|▎         | 1948/65536 [21:49<11:21:38,  1.55it/s]
  3%|▎         | 1949/65536 [21:49<11:20:33,  1.56it/s]
  3%|▎         | 1950/65536 [21:50<11:19:37,  1.56it/s]
  3%|▎         | 1951/65536 [21:51<11:25:45,  1.55it/s]
  3%|▎         | 1952/65536 [21:51<11:37:32,  1.52it/s]
  3%|▎         | 1953/65536 [21:52<12:05:05,  1.46it/s]
  3%|▎         | 1954/65536 [21:53<12:03:15,  1.47it/s]
  3%|▎         | 1955/65536 [21:53<12:04:03,  1.46it/s]
  3%|▎         | 1956/65536 [21:54<12:02:30,  1.47it/s]
  3%|▎         | 1957/65536 [21:55<11:54:44,  1.48it/s]
  3%|▎         | 1958/65536 [21:56<12:03:14,  1.47it/s]
  3%|▎         | 1959/65536 [21:56<12:08:24,  1.45it/s]
  3%|▎         | 1960/65536 [21:57<11:59:49,  1.47it/s]
                                                       
{'loss': 1.3741, 'learning_rate': 9.757560915880985e-07, 'epoch': 120.99}

  3%|▎         | 1960/65536 [21:57<11:59:49,  1.47it/s]
  3%|▎         | 1961/65536 [21:58<12:14:30,  1.44it/s]
  3%|▎         | 1962/65536 [21:58<12:23:40,  1.42it/s]
  3%|▎         | 1963/65536 [21:59<12:22:06,  1.43it/s]
  3%|▎         | 1964/65536 [22:00<12:11:05,  1.45it/s]
  3%|▎         | 1965/65536 [22:00<12:10:18,  1.45it/s]
  3%|▎         | 1966/65536 [22:01<12:07:06,  1.46it/s]
  3%|▎         | 1967/65536 [22:02<12:05:19,  1.46it/s]
  3%|▎         | 1968/65536 [22:02<11:52:54,  1.49it/s]
  3%|▎         | 1969/65536 [22:03<11:46:58,  1.50it/s]
  3%|▎         | 1970/65536 [22:04<11:28:06,  1.54it/s]
  3%|▎         | 1971/65536 [22:04<11:20:14,  1.56it/s]
  3%|▎         | 1972/65536 [22:05<11:36:36,  1.52it/s]
  3%|▎         | 1973/65536 [22:06<11:51:34,  1.49it/s]
  3%|▎         | 1974/65536 [22:06<11:56:10,  1.48it/s]
  3%|▎         | 1975/65536 [22:07<11:39:32,  1.51it/s]
  3%|▎         | 1976/65536 [22:08<11:37:57,  1.52it/s]
  3%|▎         | 1977/65536 [22:08<11:49:58,  1.49it/s]
  3%|▎         | 1978/65536 [22:09<12:03:01,  1.47it/s]
  3%|▎         | 1979/65536 [22:10<12:00:48,  1.47it/s]
  3%|▎         | 1980/65536 [22:10<11:48:09,  1.50it/s]
                                                       
{'loss': 1.3649, 'learning_rate': 9.754805926288721e-07, 'epoch': 122.22}

  3%|▎         | 1980/65536 [22:10<11:48:09,  1.50it/s]
  3%|▎         | 1981/65536 [22:11<11:53:54,  1.48it/s]
  3%|▎         | 1982/65536 [22:12<11:43:36,  1.51it/s]
  3%|▎         | 1983/65536 [22:12<11:54:25,  1.48it/s]
  3%|▎         | 1984/65536 [22:13<11:43:12,  1.51it/s]
  3%|▎         | 1985/65536 [22:14<11:46:00,  1.50it/s]
  3%|▎         | 1986/65536 [22:14<11:35:40,  1.52it/s]
  3%|▎         | 1987/65536 [22:15<11:59:16,  1.47it/s]
  3%|▎         | 1988/65536 [22:16<11:43:41,  1.51it/s]
  3%|▎         | 1989/65536 [22:16<11:43:23,  1.51it/s]
  3%|▎         | 1990/65536 [22:17<11:35:25,  1.52it/s]
  3%|▎         | 1991/65536 [22:18<11:38:00,  1.52it/s]
  3%|▎         | 1992/65536 [22:18<11:39:58,  1.51it/s]
  3%|▎         | 1993/65536 [22:19<11:40:17,  1.51it/s]
  3%|▎         | 1994/65536 [22:20<11:32:35,  1.53it/s]
  3%|▎         | 1995/65536 [22:20<11:37:09,  1.52it/s]
  3%|▎         | 1996/65536 [22:21<11:42:31,  1.51it/s]
  3%|▎         | 1997/65536 [22:22<11:30:54,  1.53it/s]
  3%|▎         | 1998/65536 [22:22<11:24:20,  1.55it/s]
  3%|▎         | 1999/65536 [22:23<11:13:19,  1.57it/s]
  3%|▎         | 2000/65536 [22:24<11:29:20,  1.54it/s]
                                                       
{'loss': 1.4101, 'learning_rate': 9.752050936696462e-07, 'epoch': 123.46}

  3%|▎         | 2000/65536 [22:24<11:29:20,  1.54it/s]
  3%|▎         | 2001/65536 [22:24<11:33:59,  1.53it/s]
  3%|▎         | 2002/65536 [22:25<11:39:01,  1.51it/s]
  3%|▎         | 2003/65536 [22:26<11:42:39,  1.51it/s]
  3%|▎         | 2004/65536 [22:26<11:50:35,  1.49it/s]
  3%|▎         | 2005/65536 [22:27<11:58:22,  1.47it/s]
  3%|▎         | 2006/65536 [22:28<12:03:47,  1.46it/s]
  3%|▎         | 2007/65536 [22:28<11:50:48,  1.49it/s]
  3%|▎         | 2008/65536 [22:29<11:38:53,  1.51it/s]
  3%|▎         | 2009/65536 [22:30<12:05:47,  1.46it/s]
  3%|▎         | 2010/65536 [22:30<12:06:13,  1.46it/s]
  3%|▎         | 2011/65536 [22:31<12:02:39,  1.47it/s]
  3%|▎         | 2012/65536 [22:32<11:41:02,  1.51it/s]
  3%|▎         | 2013/65536 [22:32<11:34:03,  1.53it/s]
  3%|▎         | 2014/65536 [22:33<11:37:10,  1.52it/s]
  3%|▎         | 2015/65536 [22:34<11:34:29,  1.52it/s]
  3%|▎         | 2016/65536 [22:34<12:02:00,  1.47it/s]
  3%|▎         | 2017/65536 [22:35<12:01:29,  1.47it/s]
  3%|▎         | 2018/65536 [22:36<11:48:14,  1.49it/s]
  3%|▎         | 2019/65536 [22:36<11:57:53,  1.47it/s]
  3%|▎         | 2020/65536 [22:37<11:51:28,  1.49it/s]
                                                       
{'loss': 1.3815, 'learning_rate': 9.749295947104198e-07, 'epoch': 124.69}

  3%|▎         | 2020/65536 [22:37<11:51:28,  1.49it/s]
  3%|▎         | 2021/65536 [22:38<11:47:09,  1.50it/s]
  3%|▎         | 2022/65536 [22:38<11:46:48,  1.50it/s]
  3%|▎         | 2023/65536 [22:39<12:02:51,  1.46it/s]
  3%|▎         | 2024/65536 [22:40<11:56:43,  1.48it/s]
  3%|▎         | 2025/65536 [22:40<11:36:24,  1.52it/s]
  3%|▎         | 2026/65536 [22:41<12:18:25,  1.43it/s]
  3%|▎         | 2027/65536 [22:42<12:03:41,  1.46it/s]
  3%|▎         | 2028/65536 [22:42<12:08:08,  1.45it/s]
  3%|▎         | 2029/65536 [22:43<12:12:00,  1.45it/s]
  3%|▎         | 2030/65536 [22:44<12:01:03,  1.47it/s]
  3%|▎         | 2031/65536 [22:44<11:57:43,  1.47it/s]
  3%|▎         | 2032/65536 [22:45<11:46:35,  1.50it/s]
  3%|▎         | 2033/65536 [22:46<11:34:28,  1.52it/s]
  3%|▎         | 2034/65536 [22:46<11:29:22,  1.54it/s]
  3%|▎         | 2035/65536 [22:47<11:27:53,  1.54it/s]
  3%|▎         | 2036/65536 [22:48<11:35:59,  1.52it/s]
  3%|▎         | 2037/65536 [22:48<11:29:27,  1.53it/s]
  3%|▎         | 2038/65536 [22:49<11:28:08,  1.54it/s]
  3%|▎         | 2039/65536 [22:50<11:33:48,  1.53it/s]
  3%|▎         | 2040/65536 [22:50<11:36:11,  1.52it/s]
                                                       
{'loss': 1.3979, 'learning_rate': 9.746540957511937e-07, 'epoch': 125.93}

  3%|▎         | 2040/65536 [22:50<11:36:11,  1.52it/s]
  3%|▎         | 2041/65536 [22:51<11:31:38,  1.53it/s]
  3%|▎         | 2042/65536 [22:52<11:42:02,  1.51it/s]
  3%|▎         | 2043/65536 [22:52<11:42:30,  1.51it/s]
  3%|▎         | 2044/65536 [22:53<11:45:57,  1.50it/s]
  3%|▎         | 2045/65536 [22:54<12:01:53,  1.47it/s]
  3%|▎         | 2046/65536 [22:54<11:50:55,  1.49it/s]
  3%|▎         | 2047/65536 [22:55<11:36:22,  1.52it/s]
  3%|▎         | 2048/65536 [22:56<11:50:27,  1.49it/s]
  3%|▎         | 2049/65536 [22:56<11:52:29,  1.49it/s]
  3%|▎         | 2050/65536 [22:57<12:11:18,  1.45it/s]
  3%|▎         | 2051/65536 [22:58<12:00:02,  1.47it/s]
  3%|▎         | 2052/65536 [22:59<12:27:50,  1.41it/s]
  3%|▎         | 2053/65536 [22:59<12:06:07,  1.46it/s]
  3%|▎         | 2054/65536 [23:00<11:57:18,  1.48it/s]
  3%|▎         | 2055/65536 [23:01<11:59:47,  1.47it/s]
  3%|▎         | 2056/65536 [23:01<11:44:07,  1.50it/s]
  3%|▎         | 2057/65536 [23:02<11:40:09,  1.51it/s]
  3%|▎         | 2058/65536 [23:02<11:44:54,  1.50it/s]
  3%|▎         | 2059/65536 [23:03<11:45:50,  1.50it/s]
  3%|▎         | 2060/65536 [23:04<11:38:22,  1.51it/s]
                                                       
{'loss': 1.3451, 'learning_rate': 9.743785967919676e-07, 'epoch': 127.16}

  3%|▎         | 2060/65536 [23:04<11:38:22,  1.51it/s]
  3%|▎         | 2061/65536 [23:04<11:43:47,  1.50it/s]
  3%|▎         | 2062/65536 [23:05<11:38:16,  1.52it/s]
  3%|▎         | 2063/65536 [23:06<11:50:21,  1.49it/s]
  3%|▎         | 2064/65536 [23:06<11:48:35,  1.49it/s]
  3%|▎         | 2065/65536 [23:07<11:42:05,  1.51it/s]
  3%|▎         | 2066/65536 [23:08<11:48:52,  1.49it/s]
  3%|▎         | 2067/65536 [23:08<11:52:32,  1.48it/s]
  3%|▎         | 2068/65536 [23:09<11:41:38,  1.51it/s]
  3%|▎         | 2069/65536 [23:10<11:43:51,  1.50it/s]
  3%|▎         | 2070/65536 [23:10<11:40:43,  1.51it/s]
  3%|▎         | 2071/65536 [23:11<11:47:19,  1.50it/s]
  3%|▎         | 2072/65536 [23:12<11:51:45,  1.49it/s]
  3%|▎         | 2073/65536 [23:13<11:53:49,  1.48it/s]
  3%|▎         | 2074/65536 [23:13<12:03:22,  1.46it/s]
  3%|▎         | 2075/65536 [23:14<11:41:57,  1.51it/s]
  3%|▎         | 2076/65536 [23:15<11:54:40,  1.48it/s]
  3%|▎         | 2077/65536 [23:15<11:49:20,  1.49it/s]
  3%|▎         | 2078/65536 [23:16<11:54:54,  1.48it/s]
  3%|▎         | 2079/65536 [23:17<11:59:21,  1.47it/s]
  3%|▎         | 2080/65536 [23:17<11:58:33,  1.47it/s]
                                                       
{'loss': 1.3825, 'learning_rate': 9.741030978327416e-07, 'epoch': 128.4}

  3%|▎         | 2080/65536 [23:17<11:58:33,  1.47it/s]
  3%|▎         | 2081/65536 [23:18<12:22:30,  1.42it/s]
  3%|▎         | 2082/65536 [23:19<12:01:17,  1.47it/s]
  3%|▎         | 2083/65536 [23:19<11:48:16,  1.49it/s]
  3%|▎         | 2084/65536 [23:20<11:29:06,  1.53it/s]
  3%|▎         | 2085/65536 [23:21<11:29:06,  1.53it/s]
  3%|▎         | 2086/65536 [23:21<11:53:41,  1.48it/s]
  3%|▎         | 2087/65536 [23:22<11:37:57,  1.52it/s]
  3%|▎         | 2088/65536 [23:22<11:21:00,  1.55it/s]
  3%|▎         | 2089/65536 [23:23<11:32:06,  1.53it/s]
  3%|▎         | 2090/65536 [23:24<11:47:49,  1.49it/s]
  3%|▎         | 2091/65536 [23:25<11:46:41,  1.50it/s]
  3%|▎         | 2092/65536 [23:25<11:59:57,  1.47it/s]
  3%|▎         | 2093/65536 [23:26<11:43:29,  1.50it/s]
  3%|▎         | 2094/65536 [23:27<11:47:48,  1.49it/s]
  3%|▎         | 2095/65536 [23:27<11:26:40,  1.54it/s]
  3%|▎         | 2096/65536 [23:28<11:55:21,  1.48it/s]
  3%|▎         | 2097/65536 [23:29<11:43:03,  1.50it/s]
  3%|▎         | 2098/65536 [23:29<11:17:37,  1.56it/s]
  3%|▎         | 2099/65536 [23:30<11:22:51,  1.55it/s]
  3%|▎         | 2100/65536 [23:30<11:31:59,  1.53it/s]
                                                       
{'loss': 1.3819, 'learning_rate': 9.738275988735153e-07, 'epoch': 129.63}

  3%|▎         | 2100/65536 [23:30<11:31:59,  1.53it/s]
  3%|▎         | 2101/65536 [23:31<11:38:23,  1.51it/s]
  3%|▎         | 2102/65536 [23:32<11:50:49,  1.49it/s]
  3%|▎         | 2103/65536 [23:33<12:07:51,  1.45it/s]
  3%|▎         | 2104/65536 [23:33<12:22:18,  1.42it/s]
  3%|▎         | 2105/65536 [23:34<12:08:14,  1.45it/s]
  3%|▎         | 2106/65536 [23:35<11:58:39,  1.47it/s]
  3%|▎         | 2107/65536 [23:35<12:00:05,  1.47it/s]
  3%|▎         | 2108/65536 [23:36<11:56:07,  1.48it/s]
  3%|▎         | 2109/65536 [23:37<11:51:07,  1.49it/s]
  3%|▎         | 2110/65536 [23:37<11:52:34,  1.48it/s]
  3%|▎         | 2111/65536 [23:38<12:06:43,  1.45it/s]
  3%|▎         | 2112/65536 [23:39<11:57:19,  1.47it/s]
  3%|▎         | 2113/65536 [23:39<12:00:01,  1.47it/s]
  3%|▎         | 2114/65536 [23:40<12:00:21,  1.47it/s]
  3%|▎         | 2115/65536 [23:41<11:50:03,  1.49it/s]
  3%|▎         | 2116/65536 [23:41<11:29:35,  1.53it/s]
  3%|▎         | 2117/65536 [23:42<11:29:22,  1.53it/s]
  3%|▎         | 2118/65536 [23:43<11:50:34,  1.49it/s]
  3%|▎         | 2119/65536 [23:43<11:59:40,  1.47it/s]
  3%|▎         | 2120/65536 [23:44<11:50:59,  1.49it/s]
                                                       
{'loss': 1.3405, 'learning_rate': 9.735520999142893e-07, 'epoch': 130.86}

  3%|▎         | 2120/65536 [23:44<11:50:59,  1.49it/s]
  3%|▎         | 2121/65536 [23:45<12:06:51,  1.45it/s]
  3%|▎         | 2122/65536 [23:45<12:07:25,  1.45it/s]
  3%|▎         | 2123/65536 [23:46<12:13:41,  1.44it/s]
  3%|▎         | 2124/65536 [23:47<12:06:23,  1.45it/s]
  3%|▎         | 2125/65536 [23:47<11:51:24,  1.49it/s]
  3%|▎         | 2126/65536 [23:48<12:00:55,  1.47it/s]
  3%|▎         | 2127/65536 [23:49<11:44:24,  1.50it/s]
  3%|▎         | 2128/65536 [23:50<11:58:59,  1.47it/s]
  3%|▎         | 2129/65536 [23:50<11:57:54,  1.47it/s]
  3%|▎         | 2130/65536 [23:51<11:54:34,  1.48it/s]
  3%|▎         | 2131/65536 [23:52<11:48:18,  1.49it/s]
  3%|▎         | 2132/65536 [23:52<11:52:14,  1.48it/s]
  3%|▎         | 2133/65536 [23:53<12:17:48,  1.43it/s]
  3%|▎         | 2134/65536 [23:54<12:09:08,  1.45it/s]
  3%|▎         | 2135/65536 [23:54<11:55:32,  1.48it/s]
  3%|▎         | 2136/65536 [23:55<11:51:43,  1.48it/s]
  3%|▎         | 2137/65536 [23:56<11:44:16,  1.50it/s]
  3%|▎         | 2138/65536 [23:56<11:39:39,  1.51it/s]
  3%|▎         | 2139/65536 [23:57<11:48:59,  1.49it/s]
  3%|▎         | 2140/65536 [23:58<11:41:18,  1.51it/s]
                                                       
{'loss': 1.34, 'learning_rate': 9.73276600955063e-07, 'epoch': 132.1}

  3%|▎         | 2140/65536 [23:58<11:41:18,  1.51it/s]
  3%|▎         | 2141/65536 [23:58<11:45:11,  1.50it/s]
  3%|▎         | 2142/65536 [23:59<11:57:29,  1.47it/s]
  3%|▎         | 2143/65536 [24:00<12:04:46,  1.46it/s]
  3%|▎         | 2144/65536 [24:00<11:40:32,  1.51it/s]
  3%|▎         | 2145/65536 [24:01<11:35:22,  1.52it/s]
  3%|▎         | 2146/65536 [24:02<11:57:28,  1.47it/s]
  3%|▎         | 2147/65536 [24:02<12:13:18,  1.44it/s]
  3%|▎         | 2148/65536 [24:03<11:56:04,  1.48it/s]
  3%|▎         | 2149/65536 [24:04<11:53:43,  1.48it/s]
  3%|▎         | 2150/65536 [24:04<11:55:15,  1.48it/s]
  3%|▎         | 2151/65536 [24:05<11:48:49,  1.49it/s]
  3%|▎         | 2152/65536 [24:06<11:47:43,  1.49it/s]
  3%|▎         | 2153/65536 [24:06<11:32:50,  1.52it/s]
  3%|▎         | 2154/65536 [24:07<11:23:37,  1.55it/s]
  3%|▎         | 2155/65536 [24:08<11:34:29,  1.52it/s]
  3%|▎         | 2156/65536 [24:08<11:31:07,  1.53it/s]
  3%|▎         | 2157/65536 [24:09<11:31:34,  1.53it/s]
  3%|▎         | 2158/65536 [24:10<11:19:04,  1.56it/s]
  3%|▎         | 2159/65536 [24:10<11:43:19,  1.50it/s]
  3%|▎         | 2160/65536 [24:11<11:43:01,  1.50it/s]
                                                       
{'loss': 1.3426, 'learning_rate': 9.730011019958369e-07, 'epoch': 133.33}

  3%|▎         | 2160/65536 [24:11<11:43:01,  1.50it/s]
  3%|▎         | 2161/65536 [24:12<11:51:37,  1.48it/s]
  3%|▎         | 2162/65536 [24:12<11:51:19,  1.48it/s]
  3%|▎         | 2163/65536 [24:13<11:44:47,  1.50it/s]
  3%|▎         | 2164/65536 [24:14<11:37:04,  1.52it/s]
  3%|▎         | 2165/65536 [24:14<11:46:38,  1.49it/s]
  3%|▎         | 2166/65536 [24:15<11:48:04,  1.49it/s]
  3%|▎         | 2167/65536 [24:16<11:54:40,  1.48it/s]
  3%|▎         | 2168/65536 [24:16<11:53:57,  1.48it/s]
  3%|▎         | 2169/65536 [24:17<11:34:38,  1.52it/s]
  3%|▎         | 2170/65536 [24:18<11:48:51,  1.49it/s]
  3%|▎         | 2171/65536 [24:18<11:58:08,  1.47it/s]
  3%|▎         | 2172/65536 [24:19<11:47:22,  1.49it/s]
  3%|▎         | 2173/65536 [24:20<11:40:31,  1.51it/s]
  3%|▎         | 2174/65536 [24:20<11:37:39,  1.51it/s]
  3%|▎         | 2175/65536 [24:21<11:46:51,  1.49it/s]
  3%|▎         | 2176/65536 [24:22<11:57:31,  1.47it/s]
  3%|▎         | 2177/65536 [24:22<12:08:26,  1.45it/s]
  3%|▎         | 2178/65536 [24:23<11:49:14,  1.49it/s]
  3%|▎         | 2179/65536 [24:24<11:43:01,  1.50it/s]
  3%|▎         | 2180/65536 [24:24<12:05:23,  1.46it/s]
                                                       
{'loss': 1.3434, 'learning_rate': 9.727256030366107e-07, 'epoch': 134.57}

  3%|▎         | 2180/65536 [24:24<12:05:23,  1.46it/s]
  3%|▎         | 2181/65536 [24:25<12:00:12,  1.47it/s]
  3%|▎         | 2182/65536 [24:26<11:58:31,  1.47it/s]
  3%|▎         | 2183/65536 [24:26<11:51:37,  1.48it/s]
  3%|▎         | 2184/65536 [24:27<11:49:13,  1.49it/s]
  3%|▎         | 2185/65536 [24:28<11:45:38,  1.50it/s]
  3%|▎         | 2186/65536 [24:28<11:39:24,  1.51it/s]
  3%|▎         | 2187/65536 [24:29<11:36:26,  1.52it/s]
  3%|▎         | 2188/65536 [24:30<12:04:53,  1.46it/s]
  3%|▎         | 2189/65536 [24:30<12:00:23,  1.47it/s]
  3%|▎         | 2190/65536 [24:31<11:47:46,  1.49it/s]
  3%|▎         | 2191/65536 [24:32<11:54:59,  1.48it/s]
  3%|▎         | 2192/65536 [24:32<11:58:08,  1.47it/s]
  3%|▎         | 2193/65536 [24:33<11:39:50,  1.51it/s]
  3%|▎         | 2194/65536 [24:34<11:35:21,  1.52it/s]
  3%|▎         | 2195/65536 [24:34<11:43:29,  1.50it/s]
  3%|▎         | 2196/65536 [24:35<11:47:45,  1.49it/s]
  3%|▎         | 2197/65536 [24:36<11:27:19,  1.54it/s]
  3%|▎         | 2198/65536 [24:36<11:28:53,  1.53it/s]
  3%|▎         | 2199/65536 [24:37<11:30:38,  1.53it/s]
  3%|▎         | 2200/65536 [24:38<11:36:15,  1.52it/s]
                                                       
{'loss': 1.3183, 'learning_rate': 9.724501040773846e-07, 'epoch': 135.8}

  3%|▎         | 2200/65536 [24:38<11:36:15,  1.52it/s]
  3%|▎         | 2201/65536 [24:38<11:50:52,  1.48it/s]
  3%|▎         | 2202/65536 [24:39<12:02:00,  1.46it/s]
  3%|▎         | 2203/65536 [24:40<12:22:41,  1.42it/s]
  3%|▎         | 2204/65536 [24:41<12:44:54,  1.38it/s]
  3%|▎         | 2205/65536 [24:41<12:21:50,  1.42it/s]
  3%|▎         | 2206/65536 [24:42<12:03:21,  1.46it/s]
  3%|▎         | 2207/65536 [24:43<12:12:35,  1.44it/s]
  3%|▎         | 2208/65536 [24:43<12:01:22,  1.46it/s]
  3%|▎         | 2209/65536 [24:44<11:44:49,  1.50it/s]
  3%|▎         | 2210/65536 [24:45<12:04:31,  1.46it/s]
  3%|▎         | 2211/65536 [24:45<12:01:26,  1.46it/s]
  3%|▎         | 2212/65536 [24:46<11:29:19,  1.53it/s]
  3%|▎         | 2213/65536 [24:47<11:31:55,  1.53it/s]
  3%|▎         | 2214/65536 [24:47<11:41:05,  1.51it/s]
  3%|▎         | 2215/65536 [24:48<11:34:36,  1.52it/s]
  3%|▎         | 2216/65536 [24:49<11:26:28,  1.54it/s]
  3%|▎         | 2217/65536 [24:49<11:52:37,  1.48it/s]
  3%|▎         | 2218/65536 [24:50<11:36:34,  1.51it/s]
  3%|▎         | 2219/65536 [24:51<11:21:13,  1.55it/s]
  3%|▎         | 2220/65536 [24:51<11:41:39,  1.50it/s]
                                                       
{'loss': 1.3452, 'learning_rate': 9.721746051181584e-07, 'epoch': 137.04}

  3%|▎         | 2220/65536 [24:51<11:41:39,  1.50it/s]
  3%|▎         | 2221/65536 [24:52<11:49:01,  1.49it/s]
  3%|▎         | 2222/65536 [24:53<11:59:55,  1.47it/s]
  3%|▎         | 2223/65536 [24:53<11:46:02,  1.49it/s]
  3%|▎         | 2224/65536 [24:54<11:54:13,  1.48it/s]
  3%|▎         | 2225/65536 [24:55<12:11:29,  1.44it/s]
  3%|▎         | 2226/65536 [24:55<12:01:02,  1.46it/s]
  3%|▎         | 2227/65536 [24:56<11:54:48,  1.48it/s]
  3%|▎         | 2228/65536 [24:57<11:34:35,  1.52it/s]
  3%|▎         | 2229/65536 [24:57<11:31:32,  1.53it/s]
  3%|▎         | 2230/65536 [24:58<11:27:41,  1.53it/s]
  3%|▎         | 2231/65536 [24:59<11:38:43,  1.51it/s]
  3%|▎         | 2232/65536 [24:59<11:32:27,  1.52it/s]
  3%|▎         | 2233/65536 [25:00<11:08:45,  1.58it/s]
  3%|▎         | 2234/65536 [25:01<11:40:42,  1.51it/s]
  3%|▎         | 2235/65536 [25:01<11:38:57,  1.51it/s]
  3%|▎         | 2236/65536 [25:02<11:53:49,  1.48it/s]
  3%|▎         | 2237/65536 [25:03<11:34:32,  1.52it/s]
  3%|▎         | 2238/65536 [25:03<11:43:50,  1.50it/s]
  3%|▎         | 2239/65536 [25:04<11:32:15,  1.52it/s]
  3%|▎         | 2240/65536 [25:05<11:34:23,  1.52it/s]
                                                       
{'loss': 1.3478, 'learning_rate': 9.718991061589323e-07, 'epoch': 138.27}

  3%|▎         | 2240/65536 [25:05<11:34:23,  1.52it/s]
  3%|▎         | 2241/65536 [25:05<11:42:10,  1.50it/s]
  3%|▎         | 2242/65536 [25:06<11:51:27,  1.48it/s]
  3%|▎         | 2243/65536 [25:07<11:51:40,  1.48it/s]
  3%|▎         | 2244/65536 [25:07<12:07:53,  1.45it/s]
  3%|▎         | 2245/65536 [25:08<11:50:52,  1.48it/s]
  3%|▎         | 2246/65536 [25:09<11:41:59,  1.50it/s]
  3%|▎         | 2247/65536 [25:09<11:46:10,  1.49it/s]
  3%|▎         | 2248/65536 [25:10<11:33:30,  1.52it/s]
  3%|▎         | 2249/65536 [25:11<11:31:16,  1.53it/s]
  3%|▎         | 2250/65536 [25:11<11:41:16,  1.50it/s]
  3%|▎         | 2251/65536 [25:12<11:36:55,  1.51it/s]
  3%|▎         | 2252/65536 [25:13<12:01:55,  1.46it/s]
  3%|▎         | 2253/65536 [25:13<11:51:31,  1.48it/s]
  3%|▎         | 2254/65536 [25:14<11:35:37,  1.52it/s]
  3%|▎         | 2255/65536 [25:15<11:37:34,  1.51it/s]
  3%|▎         | 2256/65536 [25:15<11:46:16,  1.49it/s]
  3%|▎         | 2257/65536 [25:16<11:37:23,  1.51it/s]
  3%|▎         | 2258/65536 [25:17<11:39:10,  1.51it/s]
  3%|▎         | 2259/65536 [25:17<11:46:50,  1.49it/s]
  3%|▎         | 2260/65536 [25:18<11:53:14,  1.48it/s]
                                                       
{'loss': 1.3841, 'learning_rate': 9.716236071997061e-07, 'epoch': 139.51}

  3%|▎         | 2260/65536 [25:18<11:53:14,  1.48it/s]
  3%|▎         | 2261/65536 [25:19<11:35:13,  1.52it/s]
  3%|▎         | 2262/65536 [25:19<11:55:01,  1.47it/s]
  3%|▎         | 2263/65536 [25:20<11:48:53,  1.49it/s]
  3%|▎         | 2264/65536 [25:21<12:02:31,  1.46it/s]
  3%|▎         | 2265/65536 [25:21<11:58:34,  1.47it/s]
  3%|▎         | 2266/65536 [25:22<11:47:36,  1.49it/s]
  3%|▎         | 2267/65536 [25:23<11:34:35,  1.52it/s]
  3%|▎         | 2268/65536 [25:23<11:28:30,  1.53it/s]
  3%|▎         | 2269/65536 [25:24<12:00:43,  1.46it/s]
  3%|▎         | 2270/65536 [25:25<12:21:05,  1.42it/s]
  3%|▎         | 2271/65536 [25:25<12:12:32,  1.44it/s]
  3%|▎         | 2272/65536 [25:26<11:58:46,  1.47it/s]
  3%|▎         | 2273/65536 [25:27<12:01:18,  1.46it/s]
  3%|▎         | 2274/65536 [25:27<12:10:27,  1.44it/s]
  3%|▎         | 2275/65536 [25:28<12:05:17,  1.45it/s]
  3%|▎         | 2276/65536 [25:29<12:06:07,  1.45it/s]
  3%|▎         | 2277/65536 [25:30<12:05:46,  1.45it/s]
  3%|▎         | 2278/65536 [25:30<11:55:58,  1.47it/s]
  3%|▎         | 2279/65536 [25:31<11:49:06,  1.49it/s]
  3%|▎         | 2280/65536 [25:31<11:34:06,  1.52it/s]
                                                       
{'loss': 1.3114, 'learning_rate': 9.7134810824048e-07, 'epoch': 140.74}

  3%|▎         | 2280/65536 [25:31<11:34:06,  1.52it/s]
  3%|▎         | 2281/65536 [25:32<11:48:05,  1.49it/s]
  3%|▎         | 2282/65536 [25:33<11:44:21,  1.50it/s]
  3%|▎         | 2283/65536 [25:33<11:28:14,  1.53it/s]
  3%|▎         | 2284/65536 [25:34<11:16:48,  1.56it/s]
  3%|▎         | 2285/65536 [25:35<11:51:32,  1.48it/s]
  3%|▎         | 2286/65536 [25:36<11:59:27,  1.47it/s]
  3%|▎         | 2287/65536 [25:36<11:51:17,  1.48it/s]
  3%|▎         | 2288/65536 [25:37<11:53:17,  1.48it/s]
  3%|▎         | 2289/65536 [25:38<12:10:35,  1.44it/s]
  3%|▎         | 2290/65536 [25:38<12:05:21,  1.45it/s]
  3%|▎         | 2291/65536 [25:39<11:51:11,  1.48it/s]
  3%|▎         | 2292/65536 [25:40<11:32:44,  1.52it/s]
  3%|▎         | 2293/65536 [25:40<11:54:19,  1.48it/s]
  4%|▎         | 2294/65536 [25:41<11:49:13,  1.49it/s]
  4%|▎         | 2295/65536 [25:42<12:01:50,  1.46it/s]
  4%|▎         | 2296/65536 [25:42<11:50:33,  1.48it/s]
  4%|▎         | 2297/65536 [25:43<11:44:05,  1.50it/s]
  4%|▎         | 2298/65536 [25:44<11:40:01,  1.51it/s]
  4%|▎         | 2299/65536 [25:44<11:38:04,  1.51it/s]
  4%|▎         | 2300/65536 [25:45<11:41:05,  1.50it/s]
                                                       
{'loss': 1.311, 'learning_rate': 9.710726092812539e-07, 'epoch': 141.98}

  4%|▎         | 2300/65536 [25:45<11:41:05,  1.50it/s]
  4%|▎         | 2301/65536 [25:46<12:00:05,  1.46it/s]
  4%|▎         | 2302/65536 [25:46<11:35:12,  1.52it/s]
  4%|▎         | 2303/65536 [25:47<11:42:42,  1.50it/s]
  4%|▎         | 2304/65536 [25:48<12:08:51,  1.45it/s]
  4%|▎         | 2305/65536 [25:48<12:07:05,  1.45it/s]
  4%|▎         | 2306/65536 [25:49<12:03:09,  1.46it/s]
  4%|▎         | 2307/65536 [25:50<11:51:10,  1.48it/s]
  4%|▎         | 2308/65536 [25:50<11:43:23,  1.50it/s]
  4%|▎         | 2309/65536 [25:51<11:36:06,  1.51it/s]
  4%|▎         | 2310/65536 [25:52<11:28:25,  1.53it/s]
  4%|▎         | 2311/65536 [25:52<11:37:12,  1.51it/s]
  4%|▎         | 2312/65536 [25:53<11:49:56,  1.48it/s]
  4%|▎         | 2313/65536 [25:54<11:46:12,  1.49it/s]
  4%|▎         | 2314/65536 [25:54<11:53:35,  1.48it/s]
  4%|▎         | 2315/65536 [25:55<11:56:28,  1.47it/s]
  4%|▎         | 2316/65536 [25:56<11:34:06,  1.52it/s]
  4%|▎         | 2317/65536 [25:56<12:00:04,  1.46it/s]
  4%|▎         | 2318/65536 [25:57<11:53:40,  1.48it/s]
  4%|▎         | 2319/65536 [25:58<11:40:09,  1.50it/s]
  4%|▎         | 2320/65536 [25:58<11:43:49,  1.50it/s]
                                                       
{'loss': 1.3387, 'learning_rate': 9.707971103220275e-07, 'epoch': 143.21}

  4%|▎         | 2320/65536 [25:58<11:43:49,  1.50it/s]
  4%|▎         | 2321/65536 [25:59<11:59:54,  1.46it/s]
  4%|▎         | 2322/65536 [26:00<11:51:02,  1.48it/s]
  4%|▎         | 2323/65536 [26:00<11:35:24,  1.52it/s]
  4%|▎         | 2324/65536 [26:01<11:31:10,  1.52it/s]
  4%|▎         | 2325/65536 [26:02<11:20:27,  1.55it/s]
  4%|▎         | 2326/65536 [26:02<11:54:32,  1.47it/s]
  4%|▎         | 2327/65536 [26:03<11:51:43,  1.48it/s]
  4%|▎         | 2328/65536 [26:04<11:56:55,  1.47it/s]
  4%|▎         | 2329/65536 [26:04<11:58:01,  1.47it/s]
  4%|▎         | 2330/65536 [26:05<11:43:14,  1.50it/s]
  4%|▎         | 2331/65536 [26:06<11:47:04,  1.49it/s]
  4%|▎         | 2332/65536 [26:06<11:37:56,  1.51it/s]
  4%|▎         | 2333/65536 [26:07<11:54:20,  1.47it/s]
  4%|▎         | 2334/65536 [26:08<11:47:36,  1.49it/s]
  4%|▎         | 2335/65536 [26:09<12:06:20,  1.45it/s]
  4%|▎         | 2336/65536 [26:09<11:39:55,  1.50it/s]
  4%|▎         | 2337/65536 [26:10<11:45:03,  1.49it/s]
  4%|▎         | 2338/65536 [26:10<11:35:47,  1.51it/s]
  4%|▎         | 2339/65536 [26:11<11:34:46,  1.52it/s]
  4%|▎         | 2340/65536 [26:12<11:48:37,  1.49it/s]
                                                       
{'loss': 1.2977, 'learning_rate': 9.705216113628016e-07, 'epoch': 144.44}

  4%|▎         | 2340/65536 [26:12<11:48:37,  1.49it/s]
  4%|▎         | 2341/65536 [26:12<11:33:53,  1.52it/s]
  4%|▎         | 2342/65536 [26:13<11:43:32,  1.50it/s]
  4%|▎         | 2343/65536 [26:14<11:48:57,  1.49it/s]
  4%|▎         | 2344/65536 [26:15<12:03:48,  1.46it/s]
  4%|▎         | 2345/65536 [26:15<11:59:56,  1.46it/s]
  4%|▎         | 2346/65536 [26:16<11:46:26,  1.49it/s]
  4%|▎         | 2347/65536 [26:17<11:52:57,  1.48it/s]
  4%|▎         | 2348/65536 [26:17<11:52:22,  1.48it/s]
  4%|▎         | 2349/65536 [26:18<11:44:56,  1.49it/s]
  4%|▎         | 2350/65536 [26:19<12:15:29,  1.43it/s]
  4%|▎         | 2351/65536 [26:19<12:26:09,  1.41it/s]
  4%|▎         | 2352/65536 [26:20<12:15:59,  1.43it/s]
  4%|▎         | 2353/65536 [26:21<12:10:36,  1.44it/s]
  4%|▎         | 2354/65536 [26:21<12:01:28,  1.46it/s]
  4%|▎         | 2355/65536 [26:22<12:16:56,  1.43it/s]
  4%|▎         | 2356/65536 [26:23<12:20:08,  1.42it/s]
  4%|▎         | 2357/65536 [26:23<12:06:26,  1.45it/s]
  4%|▎         | 2358/65536 [26:24<11:48:56,  1.49it/s]
  4%|▎         | 2359/65536 [26:25<11:46:13,  1.49it/s]
  4%|▎         | 2360/65536 [26:25<11:42:22,  1.50it/s]
                                                       
{'loss': 1.3015, 'learning_rate': 9.702461124035752e-07, 'epoch': 145.68}

  4%|▎         | 2360/65536 [26:25<11:42:22,  1.50it/s]
  4%|▎         | 2361/65536 [26:26<11:22:15,  1.54it/s]
  4%|▎         | 2362/65536 [26:27<11:25:26,  1.54it/s]
  4%|▎         | 2363/65536 [26:27<11:10:57,  1.57it/s]
  4%|▎         | 2364/65536 [26:28<11:20:05,  1.55it/s]
  4%|▎         | 2365/65536 [26:29<11:23:15,  1.54it/s]
  4%|▎         | 2366/65536 [26:29<11:44:46,  1.49it/s]
  4%|▎         | 2367/65536 [26:30<11:43:54,  1.50it/s]
  4%|▎         | 2368/65536 [26:31<11:38:20,  1.51it/s]
  4%|▎         | 2369/65536 [26:31<11:34:41,  1.52it/s]
  4%|▎         | 2370/65536 [26:32<11:40:47,  1.50it/s]
  4%|▎         | 2371/65536 [26:33<11:43:09,  1.50it/s]
  4%|▎         | 2372/65536 [26:33<11:36:28,  1.51it/s]
  4%|▎         | 2373/65536 [26:34<11:40:51,  1.50it/s]
  4%|▎         | 2374/65536 [26:35<11:59:44,  1.46it/s]
  4%|▎         | 2375/65536 [26:35<11:45:59,  1.49it/s]
  4%|▎         | 2376/65536 [26:36<11:35:46,  1.51it/s]
  4%|▎         | 2377/65536 [26:37<11:33:13,  1.52it/s]
  4%|▎         | 2378/65536 [26:37<11:32:48,  1.52it/s]
  4%|▎         | 2379/65536 [26:38<11:41:26,  1.50it/s]
  4%|▎         | 2380/65536 [26:39<12:18:35,  1.43it/s]
                                                       
{'loss': 1.3121, 'learning_rate': 9.699706134443493e-07, 'epoch': 146.91}

  4%|▎         | 2380/65536 [26:39<12:18:35,  1.43it/s]
  4%|▎         | 2381/65536 [26:39<12:09:29,  1.44it/s]
  4%|▎         | 2382/65536 [26:40<12:37:35,  1.39it/s]
  4%|▎         | 2383/65536 [26:41<12:16:51,  1.43it/s]
  4%|▎         | 2384/65536 [26:42<12:16:03,  1.43it/s]
  4%|▎         | 2385/65536 [26:42<12:12:06,  1.44it/s]
  4%|▎         | 2386/65536 [26:43<12:08:45,  1.44it/s]
  4%|▎         | 2387/65536 [26:44<11:58:23,  1.47it/s]
  4%|▎         | 2388/65536 [26:44<11:59:15,  1.46it/s]
  4%|▎         | 2389/65536 [26:45<11:58:18,  1.47it/s]
  4%|▎         | 2390/65536 [26:46<11:43:50,  1.50it/s]
  4%|▎         | 2391/65536 [26:46<11:32:49,  1.52it/s]
  4%|▎         | 2392/65536 [26:47<11:33:16,  1.52it/s]
  4%|▎         | 2393/65536 [26:48<11:27:32,  1.53it/s]
  4%|▎         | 2394/65536 [26:48<11:43:52,  1.50it/s]
  4%|▎         | 2395/65536 [26:49<11:52:00,  1.48it/s]
  4%|▎         | 2396/65536 [26:50<11:40:45,  1.50it/s]
  4%|▎         | 2397/65536 [26:50<11:37:36,  1.51it/s]
  4%|▎         | 2398/65536 [26:51<11:51:32,  1.48it/s]
  4%|▎         | 2399/65536 [26:52<12:10:30,  1.44it/s]
  4%|▎         | 2400/65536 [26:52<12:14:01,  1.43it/s]
                                                       
{'loss': 1.3001, 'learning_rate': 9.69695114485123e-07, 'epoch': 148.15}

  4%|▎         | 2400/65536 [26:52<12:14:01,  1.43it/s]
  4%|▎         | 2401/65536 [26:53<11:50:06,  1.48it/s]
  4%|▎         | 2402/65536 [26:54<11:47:13,  1.49it/s]
  4%|▎         | 2403/65536 [26:54<11:39:30,  1.50it/s]
  4%|▎         | 2404/65536 [26:55<11:25:42,  1.53it/s]
  4%|▎         | 2405/65536 [26:56<11:32:33,  1.52it/s]
  4%|▎         | 2406/65536 [26:56<11:31:39,  1.52it/s]
  4%|▎         | 2407/65536 [26:57<11:21:25,  1.54it/s]
  4%|▎         | 2408/65536 [26:58<11:30:13,  1.52it/s]
  4%|▎         | 2409/65536 [26:58<11:49:36,  1.48it/s]
  4%|▎         | 2410/65536 [26:59<11:35:43,  1.51it/s]
  4%|▎         | 2411/65536 [27:00<11:42:54,  1.50it/s]
  4%|▎         | 2412/65536 [27:00<11:31:14,  1.52it/s]
  4%|▎         | 2413/65536 [27:01<11:50:31,  1.48it/s]
  4%|▎         | 2414/65536 [27:02<12:04:27,  1.45it/s]
  4%|▎         | 2415/65536 [27:02<11:55:26,  1.47it/s]
  4%|▎         | 2416/65536 [27:03<11:44:30,  1.49it/s]
  4%|▎         | 2417/65536 [27:04<11:51:20,  1.48it/s]
  4%|▎         | 2418/65536 [27:04<11:51:30,  1.48it/s]
  4%|▎         | 2419/65536 [27:05<11:47:40,  1.49it/s]
  4%|▎         | 2420/65536 [27:06<11:24:13,  1.54it/s]
                                                       
{'loss': 1.3266, 'learning_rate': 9.69419615525897e-07, 'epoch': 149.38}

  4%|▎         | 2420/65536 [27:06<11:24:13,  1.54it/s]
  4%|▎         | 2421/65536 [27:06<11:29:17,  1.53it/s]
  4%|▎         | 2422/65536 [27:07<11:54:50,  1.47it/s]
  4%|▎         | 2423/65536 [27:08<11:52:44,  1.48it/s]
  4%|▎         | 2424/65536 [27:08<11:47:51,  1.49it/s]
  4%|▎         | 2425/65536 [27:09<11:40:05,  1.50it/s]
  4%|▎         | 2426/65536 [27:10<11:41:44,  1.50it/s]
  4%|▎         | 2427/65536 [27:10<11:35:34,  1.51it/s]
  4%|▎         | 2428/65536 [27:11<11:46:10,  1.49it/s]
  4%|▎         | 2429/65536 [27:12<11:46:33,  1.49it/s]
  4%|▎         | 2430/65536 [27:12<11:39:31,  1.50it/s]
  4%|▎         | 2431/65536 [27:13<12:03:54,  1.45it/s]
  4%|▎         | 2432/65536 [27:14<11:50:13,  1.48it/s]
  4%|▎         | 2433/65536 [27:14<11:35:22,  1.51it/s]
  4%|▎         | 2434/65536 [27:15<11:55:27,  1.47it/s]
  4%|▎         | 2435/65536 [27:16<11:57:09,  1.47it/s]
  4%|▎         | 2436/65536 [27:16<11:55:43,  1.47it/s]
  4%|▎         | 2437/65536 [27:17<11:39:07,  1.50it/s]
  4%|▎         | 2438/65536 [27:18<11:39:23,  1.50it/s]
  4%|▎         | 2439/65536 [27:18<11:40:19,  1.50it/s]
  4%|▎         | 2440/65536 [27:19<11:49:20,  1.48it/s]
                                                       
{'loss': 1.3019, 'learning_rate': 9.691441165666707e-07, 'epoch': 150.62}

  4%|▎         | 2440/65536 [27:19<11:49:20,  1.48it/s]
  4%|▎         | 2441/65536 [27:20<11:44:17,  1.49it/s]
  4%|▎         | 2442/65536 [27:20<11:57:15,  1.47it/s]
  4%|▎         | 2443/65536 [27:21<11:49:45,  1.48it/s]
  4%|▎         | 2444/65536 [27:22<11:38:44,  1.50it/s]
  4%|▎         | 2445/65536 [27:22<11:30:58,  1.52it/s]
  4%|▎         | 2446/65536 [27:23<11:39:54,  1.50it/s]
  4%|▎         | 2447/65536 [27:24<11:35:47,  1.51it/s]
  4%|▎         | 2448/65536 [27:24<11:45:56,  1.49it/s]
  4%|▎         | 2449/65536 [27:25<11:55:38,  1.47it/s]
  4%|▎         | 2450/65536 [27:26<11:48:06,  1.48it/s]
  4%|▎         | 2451/65536 [27:26<11:54:42,  1.47it/s]
  4%|▎         | 2452/65536 [27:27<11:50:41,  1.48it/s]
  4%|▎         | 2453/65536 [27:28<11:41:19,  1.50it/s]
  4%|▎         | 2454/65536 [27:28<11:32:05,  1.52it/s]
  4%|▎         | 2455/65536 [27:29<11:45:28,  1.49it/s]
  4%|▎         | 2456/65536 [27:30<11:51:01,  1.48it/s]
  4%|▎         | 2457/65536 [27:31<11:55:13,  1.47it/s]
  4%|▍         | 2458/65536 [27:31<12:05:06,  1.45it/s]
  4%|▍         | 2459/65536 [27:32<11:59:34,  1.46it/s]
  4%|▍         | 2460/65536 [27:33<11:53:57,  1.47it/s]
                                                       
{'loss': 1.3018, 'learning_rate': 9.688686176074445e-07, 'epoch': 151.85}

  4%|▍         | 2460/65536 [27:33<11:53:57,  1.47it/s]
  4%|▍         | 2461/65536 [27:33<11:55:58,  1.47it/s]
  4%|▍         | 2462/65536 [27:34<11:43:37,  1.49it/s]
  4%|▍         | 2463/65536 [27:35<11:58:04,  1.46it/s]
  4%|▍         | 2464/65536 [27:35<11:51:32,  1.48it/s]
  4%|▍         | 2465/65536 [27:36<11:54:51,  1.47it/s]
  4%|▍         | 2466/65536 [27:37<11:47:15,  1.49it/s]
  4%|▍         | 2467/65536 [27:37<11:29:10,  1.53it/s]
  4%|▍         | 2468/65536 [27:38<11:42:12,  1.50it/s]
  4%|▍         | 2469/65536 [27:39<11:40:50,  1.50it/s]
  4%|▍         | 2470/65536 [27:39<11:41:49,  1.50it/s]
  4%|▍         | 2471/65536 [27:40<12:08:32,  1.44it/s]
  4%|▍         | 2472/65536 [27:41<11:53:55,  1.47it/s]
  4%|▍         | 2473/65536 [27:41<11:33:46,  1.51it/s]
  4%|▍         | 2474/65536 [27:42<11:26:09,  1.53it/s]
  4%|▍         | 2475/65536 [27:43<11:34:09,  1.51it/s]
  4%|▍         | 2476/65536 [27:43<11:44:29,  1.49it/s]
  4%|▍         | 2477/65536 [27:44<11:34:21,  1.51it/s]
  4%|▍         | 2478/65536 [27:45<12:01:00,  1.46it/s]
  4%|▍         | 2479/65536 [27:45<12:05:51,  1.45it/s]
  4%|▍         | 2480/65536 [27:46<12:00:10,  1.46it/s]
                                                       
{'loss': 1.3157, 'learning_rate': 9.685931186482184e-07, 'epoch': 153.09}

  4%|▍         | 2480/65536 [27:46<12:00:10,  1.46it/s]
  4%|▍         | 2481/65536 [27:47<11:52:46,  1.47it/s]
  4%|▍         | 2482/65536 [27:47<11:40:39,  1.50it/s]
  4%|▍         | 2483/65536 [27:48<11:46:49,  1.49it/s]
  4%|▍         | 2484/65536 [27:49<11:39:11,  1.50it/s]
  4%|▍         | 2485/65536 [27:49<11:56:19,  1.47it/s]
  4%|▍         | 2486/65536 [27:50<11:58:58,  1.46it/s]
  4%|▍         | 2487/65536 [27:51<11:19:43,  1.55it/s]
  4%|▍         | 2488/65536 [27:51<11:42:20,  1.50it/s]
  4%|▍         | 2489/65536 [27:52<11:18:29,  1.55it/s]
  4%|▍         | 2490/65536 [27:53<11:01:47,  1.59it/s]
  4%|▍         | 2491/65536 [27:53<11:15:53,  1.55it/s]
  4%|▍         | 2492/65536 [27:54<11:43:38,  1.49it/s]
  4%|▍         | 2493/65536 [27:55<11:47:30,  1.49it/s]
  4%|▍         | 2494/65536 [27:55<11:47:08,  1.49it/s]
  4%|▍         | 2495/65536 [27:56<12:19:33,  1.42it/s]
  4%|▍         | 2496/65536 [27:57<12:18:51,  1.42it/s]
  4%|▍         | 2497/65536 [27:58<12:21:02,  1.42it/s]
  4%|▍         | 2498/65536 [27:58<12:09:19,  1.44it/s]
  4%|▍         | 2499/65536 [27:59<12:04:03,  1.45it/s]
  4%|▍         | 2500/65536 [28:00<12:00:12,  1.46it/s]
                                                       
{'loss': 1.2998, 'learning_rate': 9.683176196889922e-07, 'epoch': 154.32}

  4%|▍         | 2500/65536 [28:00<12:00:12,  1.46it/s]
  4%|▍         | 2501/65536 [28:00<12:08:42,  1.44it/s]
  4%|▍         | 2502/65536 [28:01<12:00:48,  1.46it/s]
  4%|▍         | 2503/65536 [28:02<11:57:48,  1.46it/s]
  4%|▍         | 2504/65536 [28:02<11:59:12,  1.46it/s]
  4%|▍         | 2505/65536 [28:03<11:47:37,  1.48it/s]
  4%|▍         | 2506/65536 [28:04<11:43:25,  1.49it/s]
  4%|▍         | 2507/65536 [28:04<11:45:43,  1.49it/s]
  4%|▍         | 2508/65536 [28:05<11:51:58,  1.48it/s]
  4%|▍         | 2509/65536 [28:06<11:26:27,  1.53it/s]
  4%|▍         | 2510/65536 [28:06<11:21:10,  1.54it/s]
  4%|▍         | 2511/65536 [28:07<11:16:45,  1.55it/s]
  4%|▍         | 2512/65536 [28:08<11:45:17,  1.49it/s]
  4%|▍         | 2513/65536 [28:08<11:45:48,  1.49it/s]
  4%|▍         | 2514/65536 [28:09<11:43:28,  1.49it/s]
  4%|▍         | 2515/65536 [28:10<11:36:54,  1.51it/s]
  4%|▍         | 2516/65536 [28:10<12:00:36,  1.46it/s]
  4%|▍         | 2517/65536 [28:11<11:48:43,  1.48it/s]
  4%|▍         | 2518/65536 [28:12<12:02:38,  1.45it/s]
  4%|▍         | 2519/65536 [28:12<11:45:43,  1.49it/s]
  4%|▍         | 2520/65536 [28:13<11:29:38,  1.52it/s]
                                                       
{'loss': 1.2755, 'learning_rate': 9.68042120729766e-07, 'epoch': 155.56}

  4%|▍         | 2520/65536 [28:13<11:29:38,  1.52it/s]
  4%|▍         | 2521/65536 [28:14<11:39:29,  1.50it/s]
  4%|▍         | 2522/65536 [28:14<12:03:43,  1.45it/s]
  4%|▍         | 2523/65536 [28:15<11:55:50,  1.47it/s]
  4%|▍         | 2524/65536 [28:16<11:43:34,  1.49it/s]
  4%|▍         | 2525/65536 [28:16<11:28:26,  1.53it/s]
  4%|▍         | 2526/65536 [28:17<11:19:05,  1.55it/s]
  4%|▍         | 2527/65536 [28:18<11:18:35,  1.55it/s]
  4%|▍         | 2528/65536 [28:18<11:52:00,  1.47it/s]
  4%|▍         | 2529/65536 [28:19<11:42:03,  1.50it/s]
  4%|▍         | 2530/65536 [28:20<11:44:26,  1.49it/s]
  4%|▍         | 2531/65536 [28:20<11:48:31,  1.48it/s]
  4%|▍         | 2532/65536 [28:21<11:45:35,  1.49it/s]
  4%|▍         | 2533/65536 [28:22<12:06:42,  1.44it/s]
  4%|▍         | 2534/65536 [28:22<12:13:38,  1.43it/s]
  4%|▍         | 2535/65536 [28:23<12:04:15,  1.45it/s]
  4%|▍         | 2536/65536 [28:24<11:51:13,  1.48it/s]
  4%|▍         | 2537/65536 [28:24<11:40:31,  1.50it/s]
  4%|▍         | 2538/65536 [28:25<11:36:06,  1.51it/s]
  4%|▍         | 2539/65536 [28:26<11:27:25,  1.53it/s]
  4%|▍         | 2540/65536 [28:26<11:34:13,  1.51it/s]
                                                       
{'loss': 1.3308, 'learning_rate': 9.6776662177054e-07, 'epoch': 156.79}

  4%|▍         | 2540/65536 [28:26<11:34:13,  1.51it/s]
  4%|▍         | 2541/65536 [28:27<11:41:55,  1.50it/s]
  4%|▍         | 2542/65536 [28:28<11:43:47,  1.49it/s]
  4%|▍         | 2543/65536 [28:28<11:19:31,  1.55it/s]
  4%|▍         | 2544/65536 [28:29<11:45:23,  1.49it/s]
  4%|▍         | 2545/65536 [28:30<11:26:16,  1.53it/s]
  4%|▍         | 2546/65536 [28:30<11:25:37,  1.53it/s]
  4%|▍         | 2547/65536 [28:31<11:44:59,  1.49it/s]
  4%|▍         | 2548/65536 [28:32<11:28:41,  1.52it/s]
  4%|▍         | 2549/65536 [28:32<11:54:11,  1.47it/s]
  4%|▍         | 2550/65536 [28:33<12:04:24,  1.45it/s]
  4%|▍         | 2551/65536 [28:34<11:54:46,  1.47it/s]
  4%|▍         | 2552/65536 [28:34<11:46:12,  1.49it/s]
  4%|▍         | 2553/65536 [28:35<12:02:31,  1.45it/s]
  4%|▍         | 2554/65536 [28:36<12:05:46,  1.45it/s]
  4%|▍         | 2555/65536 [28:36<11:48:58,  1.48it/s]
  4%|▍         | 2556/65536 [28:37<11:50:15,  1.48it/s]
  4%|▍         | 2557/65536 [28:38<11:38:29,  1.50it/s]
  4%|▍         | 2558/65536 [28:38<11:26:46,  1.53it/s]
  4%|▍         | 2559/65536 [28:39<11:18:00,  1.55it/s]
  4%|▍         | 2560/65536 [28:40<11:37:46,  1.50it/s]
                                                       
{'loss': 1.3264, 'learning_rate': 9.674911228113138e-07, 'epoch': 158.02}

  4%|▍         | 2560/65536 [28:40<11:37:46,  1.50it/s]
  4%|▍         | 2561/65536 [28:40<11:38:16,  1.50it/s]
  4%|▍         | 2562/65536 [28:41<11:54:45,  1.47it/s]
  4%|▍         | 2563/65536 [28:42<11:41:07,  1.50it/s]
  4%|▍         | 2564/65536 [28:42<11:36:12,  1.51it/s]
  4%|▍         | 2565/65536 [28:43<11:44:55,  1.49it/s]
  4%|▍         | 2566/65536 [28:44<11:39:23,  1.50it/s]
  4%|▍         | 2567/65536 [28:44<11:50:47,  1.48it/s]
  4%|▍         | 2568/65536 [28:45<11:36:43,  1.51it/s]
  4%|▍         | 2569/65536 [28:46<11:35:43,  1.51it/s]
  4%|▍         | 2570/65536 [28:46<11:37:27,  1.50it/s]
  4%|▍         | 2571/65536 [28:47<11:15:40,  1.55it/s]
  4%|▍         | 2572/65536 [28:48<11:52:10,  1.47it/s]
  4%|▍         | 2573/65536 [28:48<11:58:20,  1.46it/s]
  4%|▍         | 2574/65536 [28:49<12:03:00,  1.45it/s]
  4%|▍         | 2575/65536 [28:50<11:55:31,  1.47it/s]
  4%|▍         | 2576/65536 [28:51<11:56:32,  1.46it/s]
  4%|▍         | 2577/65536 [28:51<11:50:11,  1.48it/s]
  4%|▍         | 2578/65536 [28:52<11:48:19,  1.48it/s]
  4%|▍         | 2579/65536 [28:52<11:41:51,  1.50it/s]
  4%|▍         | 2580/65536 [28:53<11:40:24,  1.50it/s]
                                                       
{'loss': 1.3038, 'learning_rate': 9.672156238520875e-07, 'epoch': 159.26}

  4%|▍         | 2580/65536 [28:53<11:40:24,  1.50it/s]
  4%|▍         | 2581/65536 [28:54<11:31:15,  1.52it/s]
  4%|▍         | 2582/65536 [28:54<11:35:22,  1.51it/s]
  4%|▍         | 2583/65536 [28:55<11:45:52,  1.49it/s]
  4%|▍         | 2584/65536 [28:56<11:22:59,  1.54it/s]
  4%|▍         | 2585/65536 [28:57<12:06:05,  1.44it/s]
  4%|▍         | 2586/65536 [28:57<12:06:48,  1.44it/s]
  4%|▍         | 2587/65536 [28:58<11:51:57,  1.47it/s]
  4%|▍         | 2588/65536 [28:59<12:13:03,  1.43it/s]
  4%|▍         | 2589/65536 [28:59<11:51:11,  1.48it/s]
  4%|▍         | 2590/65536 [29:00<11:27:00,  1.53it/s]
  4%|▍         | 2591/65536 [29:01<11:28:24,  1.52it/s]
  4%|▍         | 2592/65536 [29:01<11:33:47,  1.51it/s]
  4%|▍         | 2593/65536 [29:02<12:12:35,  1.43it/s]
  4%|▍         | 2594/65536 [29:03<12:09:45,  1.44it/s]
  4%|▍         | 2595/65536 [29:03<12:01:32,  1.45it/s]
  4%|▍         | 2596/65536 [29:04<12:01:33,  1.45it/s]
  4%|▍         | 2597/65536 [29:05<12:07:05,  1.44it/s]
  4%|▍         | 2598/65536 [29:05<11:46:04,  1.49it/s]
  4%|▍         | 2599/65536 [29:06<11:52:54,  1.47it/s]
  4%|▍         | 2600/65536 [29:07<11:46:27,  1.48it/s]
                                                       
{'loss': 1.2884, 'learning_rate': 9.669401248928615e-07, 'epoch': 160.49}

  4%|▍         | 2600/65536 [29:07<11:46:27,  1.48it/s]
  4%|▍         | 2601/65536 [29:07<11:35:43,  1.51it/s]
  4%|▍         | 2602/65536 [29:08<11:39:53,  1.50it/s]
  4%|▍         | 2603/65536 [29:09<11:52:55,  1.47it/s]
  4%|▍         | 2604/65536 [29:09<11:59:44,  1.46it/s]
  4%|▍         | 2605/65536 [29:10<11:45:22,  1.49it/s]
  4%|▍         | 2606/65536 [29:11<11:37:50,  1.50it/s]
  4%|▍         | 2607/65536 [29:11<11:28:23,  1.52it/s]
  4%|▍         | 2608/65536 [29:12<11:15:04,  1.55it/s]
  4%|▍         | 2609/65536 [29:13<11:37:59,  1.50it/s]
  4%|▍         | 2610/65536 [29:13<11:42:04,  1.49it/s]
  4%|▍         | 2611/65536 [29:14<11:32:21,  1.51it/s]
  4%|▍         | 2612/65536 [29:15<11:36:37,  1.51it/s]
  4%|▍         | 2613/65536 [29:15<11:39:55,  1.50it/s]
  4%|▍         | 2614/65536 [29:16<11:26:48,  1.53it/s]
  4%|▍         | 2615/65536 [29:17<11:14:55,  1.55it/s]
  4%|▍         | 2616/65536 [29:17<11:45:29,  1.49it/s]
  4%|▍         | 2617/65536 [29:18<11:36:06,  1.51it/s]
  4%|▍         | 2618/65536 [29:19<11:36:41,  1.51it/s]
  4%|▍         | 2619/65536 [29:19<11:57:02,  1.46it/s]
  4%|▍         | 2620/65536 [29:20<11:36:25,  1.51it/s]
                                                       
{'loss': 1.3112, 'learning_rate': 9.666646259336352e-07, 'epoch': 161.73}

  4%|▍         | 2620/65536 [29:20<11:36:25,  1.51it/s]
  4%|▍         | 2621/65536 [29:21<11:35:04,  1.51it/s]
  4%|▍         | 2622/65536 [29:21<11:32:01,  1.52it/s]
  4%|▍         | 2623/65536 [29:22<11:41:10,  1.50it/s]
  4%|▍         | 2624/65536 [29:23<11:43:35,  1.49it/s]
  4%|▍         | 2625/65536 [29:23<12:01:53,  1.45it/s]
  4%|▍         | 2626/65536 [29:24<11:44:06,  1.49it/s]
  4%|▍         | 2627/65536 [29:25<11:49:23,  1.48it/s]
  4%|▍         | 2628/65536 [29:25<11:48:47,  1.48it/s]
  4%|▍         | 2629/65536 [29:26<11:40:27,  1.50it/s]
  4%|▍         | 2630/65536 [29:27<11:45:47,  1.49it/s]
  4%|▍         | 2631/65536 [29:27<11:37:57,  1.50it/s]
  4%|▍         | 2632/65536 [29:28<11:33:30,  1.51it/s]
  4%|▍         | 2633/65536 [29:29<11:12:35,  1.56it/s]
  4%|▍         | 2634/65536 [29:29<11:29:15,  1.52it/s]
  4%|▍         | 2635/65536 [29:30<11:32:13,  1.51it/s]
  4%|▍         | 2636/65536 [29:31<11:34:24,  1.51it/s]
  4%|▍         | 2637/65536 [29:31<11:33:53,  1.51it/s]
  4%|▍         | 2638/65536 [29:32<11:43:52,  1.49it/s]
  4%|▍         | 2639/65536 [29:33<11:47:17,  1.48it/s]
  4%|▍         | 2640/65536 [29:33<12:03:15,  1.45it/s]
                                                       
{'loss': 1.2921, 'learning_rate': 9.663891269744093e-07, 'epoch': 162.96}

  4%|▍         | 2640/65536 [29:33<12:03:15,  1.45it/s]
  4%|▍         | 2641/65536 [29:34<11:58:35,  1.46it/s]
  4%|▍         | 2642/65536 [29:35<11:53:03,  1.47it/s]
  4%|▍         | 2643/65536 [29:35<12:03:03,  1.45it/s]
  4%|▍         | 2644/65536 [29:36<11:57:08,  1.46it/s]
  4%|▍         | 2645/65536 [29:37<11:47:53,  1.48it/s]
  4%|▍         | 2646/65536 [29:37<11:42:54,  1.49it/s]
  4%|▍         | 2647/65536 [29:38<11:33:51,  1.51it/s]
  4%|▍         | 2648/65536 [29:39<11:29:59,  1.52it/s]
  4%|▍         | 2649/65536 [29:39<11:44:08,  1.49it/s]
  4%|▍         | 2650/65536 [29:40<12:15:46,  1.42it/s]
  4%|▍         | 2651/65536 [29:41<11:54:02,  1.47it/s]
  4%|▍         | 2652/65536 [29:42<11:43:32,  1.49it/s]
  4%|▍         | 2653/65536 [29:42<11:41:39,  1.49it/s]
  4%|▍         | 2654/65536 [29:43<11:40:41,  1.50it/s]
  4%|▍         | 2655/65536 [29:44<11:43:56,  1.49it/s]
  4%|▍         | 2656/65536 [29:44<11:39:48,  1.50it/s]
  4%|▍         | 2657/65536 [29:45<12:00:15,  1.46it/s]
  4%|▍         | 2658/65536 [29:46<11:43:27,  1.49it/s]
  4%|▍         | 2659/65536 [29:46<11:43:28,  1.49it/s]
  4%|▍         | 2660/65536 [29:47<11:36:15,  1.51it/s]
                                                       
{'loss': 1.311, 'learning_rate': 9.66113628015183e-07, 'epoch': 164.2}

  4%|▍         | 2660/65536 [29:47<11:36:15,  1.51it/s]
  4%|▍         | 2661/65536 [29:48<11:37:53,  1.50it/s]
  4%|▍         | 2662/65536 [29:48<11:51:39,  1.47it/s]
  4%|▍         | 2663/65536 [29:49<11:46:38,  1.48it/s]
  4%|▍         | 2664/65536 [29:50<11:31:38,  1.52it/s]
  4%|▍         | 2665/65536 [29:50<11:43:58,  1.49it/s]
  4%|▍         | 2666/65536 [29:51<11:36:42,  1.50it/s]
  4%|▍         | 2667/65536 [29:51<11:16:33,  1.55it/s]
  4%|▍         | 2668/65536 [29:52<11:40:28,  1.50it/s]
  4%|▍         | 2669/65536 [29:53<11:34:13,  1.51it/s]
  4%|▍         | 2670/65536 [29:54<11:38:50,  1.50it/s]
  4%|▍         | 2671/65536 [29:54<11:42:05,  1.49it/s]
  4%|▍         | 2672/65536 [29:55<11:37:49,  1.50it/s]
  4%|▍         | 2673/65536 [29:56<11:32:29,  1.51it/s]
  4%|▍         | 2674/65536 [29:56<11:59:36,  1.46it/s]
  4%|▍         | 2675/65536 [29:57<11:49:48,  1.48it/s]
  4%|▍         | 2676/65536 [29:58<11:33:38,  1.51it/s]
  4%|▍         | 2677/65536 [29:58<11:40:05,  1.50it/s]
  4%|▍         | 2678/65536 [29:59<11:36:01,  1.51it/s]
  4%|▍         | 2679/65536 [30:00<11:39:23,  1.50it/s]
  4%|▍         | 2680/65536 [30:00<11:32:22,  1.51it/s]
                                                       
{'loss': 1.3174, 'learning_rate': 9.65838129055957e-07, 'epoch': 165.43}

  4%|▍         | 2680/65536 [30:00<11:32:22,  1.51it/s]
  4%|▍         | 2681/65536 [30:01<11:31:44,  1.51it/s]
  4%|▍         | 2682/65536 [30:02<11:38:51,  1.50it/s]
  4%|▍         | 2683/65536 [30:02<11:22:02,  1.54it/s]
  4%|▍         | 2684/65536 [30:03<11:44:42,  1.49it/s]
  4%|▍         | 2685/65536 [30:04<11:36:54,  1.50it/s]
  4%|▍         | 2686/65536 [30:04<11:34:51,  1.51it/s]
  4%|▍         | 2687/65536 [30:05<11:34:29,  1.51it/s]
  4%|▍         | 2688/65536 [30:06<12:03:13,  1.45it/s]
  4%|▍         | 2689/65536 [30:06<11:52:45,  1.47it/s]
  4%|▍         | 2690/65536 [30:07<11:53:12,  1.47it/s]
  4%|▍         | 2691/65536 [30:08<12:11:26,  1.43it/s]
  4%|▍         | 2692/65536 [30:08<11:49:39,  1.48it/s]
  4%|▍         | 2693/65536 [30:09<11:39:28,  1.50it/s]
  4%|▍         | 2694/65536 [30:10<11:33:58,  1.51it/s]
  4%|▍         | 2695/65536 [30:10<11:39:14,  1.50it/s]
  4%|▍         | 2696/65536 [30:11<11:39:39,  1.50it/s]
  4%|▍         | 2697/65536 [30:12<11:45:06,  1.49it/s]
  4%|▍         | 2698/65536 [30:12<11:44:03,  1.49it/s]
  4%|▍         | 2699/65536 [30:13<12:02:32,  1.45it/s]
  4%|▍         | 2700/65536 [30:14<11:58:14,  1.46it/s]
                                                       
{'loss': 1.2588, 'learning_rate': 9.655626300967306e-07, 'epoch': 166.67}

  4%|▍         | 2700/65536 [30:14<11:58:14,  1.46it/s]
  4%|▍         | 2701/65536 [30:14<12:03:53,  1.45it/s]
  4%|▍         | 2702/65536 [30:15<12:03:07,  1.45it/s]
  4%|▍         | 2703/65536 [30:16<11:54:58,  1.46it/s]
  4%|▍         | 2704/65536 [30:16<11:39:44,  1.50it/s]
  4%|▍         | 2705/65536 [30:17<11:32:13,  1.51it/s]
  4%|▍         | 2706/65536 [30:18<12:12:15,  1.43it/s]
  4%|▍         | 2707/65536 [30:19<11:59:21,  1.46it/s]
  4%|▍         | 2708/65536 [30:19<11:51:50,  1.47it/s]
  4%|▍         | 2709/65536 [30:20<12:06:54,  1.44it/s]
  4%|▍         | 2710/65536 [30:21<12:01:04,  1.45it/s]
  4%|▍         | 2711/65536 [30:21<11:42:56,  1.49it/s]
  4%|▍         | 2712/65536 [30:22<11:36:58,  1.50it/s]
  4%|▍         | 2713/65536 [30:23<11:32:52,  1.51it/s]
  4%|▍         | 2714/65536 [30:23<11:40:40,  1.49it/s]
  4%|▍         | 2715/65536 [30:24<11:26:31,  1.53it/s]
  4%|▍         | 2716/65536 [30:25<12:03:05,  1.45it/s]
  4%|▍         | 2717/65536 [30:25<11:39:19,  1.50it/s]
  4%|▍         | 2718/65536 [30:26<11:24:58,  1.53it/s]
  4%|▍         | 2719/65536 [30:26<11:25:59,  1.53it/s]
  4%|▍         | 2720/65536 [30:27<11:34:33,  1.51it/s]
                                                       
{'loss': 1.2639, 'learning_rate': 9.652871311375045e-07, 'epoch': 167.9}

  4%|▍         | 2720/65536 [30:27<11:34:33,  1.51it/s]
  4%|▍         | 2721/65536 [30:28<11:27:19,  1.52it/s]
  4%|▍         | 2722/65536 [30:29<11:42:40,  1.49it/s]
  4%|▍         | 2723/65536 [30:29<11:38:54,  1.50it/s]
  4%|▍         | 2724/65536 [30:30<11:56:22,  1.46it/s]
  4%|▍         | 2725/65536 [30:31<11:39:46,  1.50it/s]
  4%|▍         | 2726/65536 [30:31<11:34:59,  1.51it/s]
  4%|▍         | 2727/65536 [30:32<11:22:55,  1.53it/s]
  4%|▍         | 2728/65536 [30:32<11:16:50,  1.55it/s]
  4%|▍         | 2729/65536 [30:33<11:21:23,  1.54it/s]
  4%|▍         | 2730/65536 [30:34<11:17:26,  1.55it/s]
  4%|▍         | 2731/65536 [30:35<11:53:26,  1.47it/s]
  4%|▍         | 2732/65536 [30:35<11:53:40,  1.47it/s]
  4%|▍         | 2733/65536 [30:36<11:44:41,  1.49it/s]
  4%|▍         | 2734/65536 [30:36<11:37:40,  1.50it/s]
  4%|▍         | 2735/65536 [30:37<11:55:24,  1.46it/s]
  4%|▍         | 2736/65536 [30:38<11:25:12,  1.53it/s]
  4%|▍         | 2737/65536 [30:38<11:09:05,  1.56it/s]
  4%|▍         | 2738/65536 [30:39<11:50:59,  1.47it/s]
  4%|▍         | 2739/65536 [30:40<11:26:56,  1.52it/s]
  4%|▍         | 2740/65536 [30:40<11:13:23,  1.55it/s]
                                                       
{'loss': 1.3384, 'learning_rate': 9.650116321782783e-07, 'epoch': 169.14}

  4%|▍         | 2740/65536 [30:40<11:13:23,  1.55it/s]
  4%|▍         | 2741/65536 [30:41<11:16:01,  1.55it/s]
  4%|▍         | 2742/65536 [30:42<11:38:26,  1.50it/s]
  4%|▍         | 2743/65536 [30:42<11:42:13,  1.49it/s]
  4%|▍         | 2744/65536 [30:43<11:39:02,  1.50it/s]
  4%|▍         | 2745/65536 [30:44<11:36:41,  1.50it/s]
  4%|▍         | 2746/65536 [30:44<11:40:47,  1.49it/s]
  4%|▍         | 2747/65536 [30:45<11:42:04,  1.49it/s]
  4%|▍         | 2748/65536 [30:46<11:55:05,  1.46it/s]
  4%|▍         | 2749/65536 [30:47<11:56:31,  1.46it/s]
  4%|▍         | 2750/65536 [30:47<11:58:24,  1.46it/s]
  4%|▍         | 2751/65536 [30:48<11:44:14,  1.49it/s]
  4%|▍         | 2752/65536 [30:49<11:52:48,  1.47it/s]
  4%|▍         | 2753/65536 [30:49<11:44:13,  1.49it/s]
  4%|▍         | 2754/65536 [30:50<11:31:38,  1.51it/s]
  4%|▍         | 2755/65536 [30:51<12:02:25,  1.45it/s]
  4%|▍         | 2756/65536 [30:51<11:37:34,  1.50it/s]
  4%|▍         | 2757/65536 [30:52<11:42:17,  1.49it/s]
  4%|▍         | 2758/65536 [30:53<12:02:30,  1.45it/s]
  4%|▍         | 2759/65536 [30:53<11:52:04,  1.47it/s]
  4%|▍         | 2760/65536 [30:54<11:49:34,  1.47it/s]
                                                       
{'loss': 1.2851, 'learning_rate': 9.647361332190522e-07, 'epoch': 170.37}

  4%|▍         | 2760/65536 [30:54<11:49:34,  1.47it/s]
  4%|▍         | 2761/65536 [30:55<11:40:40,  1.49it/s]
  4%|▍         | 2762/65536 [30:55<12:04:48,  1.44it/s]
  4%|▍         | 2763/65536 [30:56<11:50:58,  1.47it/s]
  4%|▍         | 2764/65536 [30:57<11:39:00,  1.50it/s]
  4%|▍         | 2765/65536 [30:57<11:37:08,  1.50it/s]
  4%|▍         | 2766/65536 [30:58<11:29:34,  1.52it/s]
  4%|▍         | 2767/65536 [30:59<11:37:27,  1.50it/s]
  4%|▍         | 2768/65536 [30:59<11:28:47,  1.52it/s]
  4%|▍         | 2769/65536 [31:00<11:38:05,  1.50it/s]
  4%|▍         | 2770/65536 [31:01<11:26:28,  1.52it/s]
  4%|▍         | 2771/65536 [31:01<11:32:57,  1.51it/s]
  4%|▍         | 2772/65536 [31:02<11:27:43,  1.52it/s]
  4%|▍         | 2773/65536 [31:03<11:29:06,  1.52it/s]
  4%|▍         | 2774/65536 [31:03<11:39:11,  1.50it/s]
  4%|▍         | 2775/65536 [31:04<11:47:21,  1.48it/s]
  4%|▍         | 2776/65536 [31:05<11:47:13,  1.48it/s]
  4%|▍         | 2777/65536 [31:05<11:40:45,  1.49it/s]
  4%|▍         | 2778/65536 [31:06<11:31:09,  1.51it/s]
  4%|▍         | 2779/65536 [31:07<11:38:33,  1.50it/s]
  4%|▍         | 2780/65536 [31:07<11:23:15,  1.53it/s]
                                                       
{'loss': 1.27, 'learning_rate': 9.64460634259826e-07, 'epoch': 171.6}

  4%|▍         | 2780/65536 [31:07<11:23:15,  1.53it/s]
  4%|▍         | 2781/65536 [31:08<11:30:56,  1.51it/s]
  4%|▍         | 2782/65536 [31:09<11:39:24,  1.50it/s]
  4%|▍         | 2783/65536 [31:09<11:59:37,  1.45it/s]
  4%|▍         | 2784/65536 [31:10<11:43:30,  1.49it/s]
  4%|▍         | 2785/65536 [31:11<11:42:39,  1.49it/s]
  4%|▍         | 2786/65536 [31:11<11:46:42,  1.48it/s]
  4%|▍         | 2787/65536 [31:12<11:41:47,  1.49it/s]
  4%|▍         | 2788/65536 [31:13<11:31:31,  1.51it/s]
  4%|▍         | 2789/65536 [31:13<11:34:52,  1.50it/s]
  4%|▍         | 2790/65536 [31:14<11:36:04,  1.50it/s]
  4%|▍         | 2791/65536 [31:15<11:35:49,  1.50it/s]
  4%|▍         | 2792/65536 [31:15<11:29:29,  1.52it/s]
  4%|▍         | 2793/65536 [31:16<11:38:43,  1.50it/s]
  4%|▍         | 2794/65536 [31:17<11:28:55,  1.52it/s]
  4%|▍         | 2795/65536 [31:17<11:39:20,  1.50it/s]
  4%|▍         | 2796/65536 [31:18<11:42:35,  1.49it/s]
  4%|▍         | 2797/65536 [31:19<11:39:35,  1.49it/s]
  4%|▍         | 2798/65536 [31:19<11:41:06,  1.49it/s]
  4%|▍         | 2799/65536 [31:20<11:45:07,  1.48it/s]
  4%|▍         | 2800/65536 [31:21<11:46:36,  1.48it/s]
                                                       
{'loss': 1.2922, 'learning_rate': 9.641851353006e-07, 'epoch': 172.84}

  4%|▍         | 2800/65536 [31:21<11:46:36,  1.48it/s]
  4%|▍         | 2801/65536 [31:21<11:44:53,  1.48it/s]
  4%|▍         | 2802/65536 [31:22<11:58:11,  1.46it/s]
  4%|▍         | 2803/65536 [31:23<12:05:24,  1.44it/s]
  4%|▍         | 2804/65536 [31:23<11:46:14,  1.48it/s]
  4%|▍         | 2805/65536 [31:24<11:38:00,  1.50it/s]
  4%|▍         | 2806/65536 [31:25<11:39:37,  1.49it/s]
  4%|▍         | 2807/65536 [31:25<11:37:14,  1.50it/s]
  4%|▍         | 2808/65536 [31:26<11:35:43,  1.50it/s]
  4%|▍         | 2809/65536 [31:27<11:46:44,  1.48it/s]
  4%|▍         | 2810/65536 [31:27<11:39:24,  1.49it/s]
  4%|▍         | 2811/65536 [31:28<11:30:57,  1.51it/s]
  4%|▍         | 2812/65536 [31:29<11:22:18,  1.53it/s]
  4%|▍         | 2813/65536 [31:29<11:40:53,  1.49it/s]
  4%|▍         | 2814/65536 [31:30<11:45:35,  1.48it/s]
  4%|▍         | 2815/65536 [31:31<11:47:08,  1.48it/s]
  4%|▍         | 2816/65536 [31:31<11:33:32,  1.51it/s]
  4%|▍         | 2817/65536 [31:32<11:44:03,  1.48it/s]
  4%|▍         | 2818/65536 [31:33<11:30:23,  1.51it/s]
  4%|▍         | 2819/65536 [31:33<11:47:58,  1.48it/s]
  4%|▍         | 2820/65536 [31:34<11:42:24,  1.49it/s]
                                                       
{'loss': 1.2922, 'learning_rate': 9.639096363413738e-07, 'epoch': 174.07}

  4%|▍         | 2820/65536 [31:34<11:42:24,  1.49it/s]
  4%|▍         | 2821/65536 [31:35<11:55:14,  1.46it/s]
  4%|▍         | 2822/65536 [31:36<12:16:15,  1.42it/s]
  4%|▍         | 2823/65536 [31:36<11:59:23,  1.45it/s]
  4%|▍         | 2824/65536 [31:37<11:46:06,  1.48it/s]
  4%|▍         | 2825/65536 [31:37<11:36:19,  1.50it/s]
  4%|▍         | 2826/65536 [31:38<12:00:06,  1.45it/s]
  4%|▍         | 2827/65536 [31:39<11:52:35,  1.47it/s]
  4%|▍         | 2828/65536 [31:40<12:00:52,  1.45it/s]
  4%|▍         | 2829/65536 [31:40<11:52:52,  1.47it/s]
  4%|▍         | 2830/65536 [31:41<11:34:54,  1.50it/s]
  4%|▍         | 2831/65536 [31:42<11:32:04,  1.51it/s]
  4%|▍         | 2832/65536 [31:42<11:23:37,  1.53it/s]
  4%|▍         | 2833/65536 [31:43<11:26:12,  1.52it/s]
  4%|▍         | 2834/65536 [31:44<11:25:00,  1.53it/s]
  4%|▍         | 2835/65536 [31:44<11:29:52,  1.51it/s]
  4%|▍         | 2836/65536 [31:45<11:42:27,  1.49it/s]
  4%|▍         | 2837/65536 [31:46<11:40:43,  1.49it/s]
  4%|▍         | 2838/65536 [31:46<11:22:50,  1.53it/s]
  4%|▍         | 2839/65536 [31:47<11:28:11,  1.52it/s]
  4%|▍         | 2840/65536 [31:47<11:09:43,  1.56it/s]
                                                       
{'loss': 1.25, 'learning_rate': 9.636341373821476e-07, 'epoch': 175.31}

  4%|▍         | 2840/65536 [31:47<11:09:43,  1.56it/s]
  4%|▍         | 2841/65536 [31:48<11:26:45,  1.52it/s]
  4%|▍         | 2842/65536 [31:49<12:07:36,  1.44it/s]
  4%|▍         | 2843/65536 [31:50<12:00:46,  1.45it/s]
  4%|▍         | 2844/65536 [31:50<11:35:56,  1.50it/s]
  4%|▍         | 2845/65536 [31:51<11:36:45,  1.50it/s]
  4%|▍         | 2846/65536 [31:52<11:50:10,  1.47it/s]
  4%|▍         | 2847/65536 [31:52<11:50:05,  1.47it/s]
  4%|▍         | 2848/65536 [31:53<11:53:30,  1.46it/s]
  4%|▍         | 2849/65536 [31:54<11:51:48,  1.47it/s]
  4%|▍         | 2850/65536 [31:54<11:39:08,  1.49it/s]
  4%|▍         | 2851/65536 [31:55<11:39:06,  1.49it/s]
  4%|▍         | 2852/65536 [31:56<11:50:44,  1.47it/s]
  4%|▍         | 2853/65536 [31:56<11:50:14,  1.47it/s]
  4%|▍         | 2854/65536 [31:57<11:51:01,  1.47it/s]
  4%|▍         | 2855/65536 [31:58<11:39:07,  1.49it/s]
  4%|▍         | 2856/65536 [31:58<11:27:49,  1.52it/s]
  4%|▍         | 2857/65536 [31:59<11:23:23,  1.53it/s]
  4%|▍         | 2858/65536 [32:00<11:59:37,  1.45it/s]
  4%|▍         | 2859/65536 [32:00<11:44:18,  1.48it/s]
  4%|▍         | 2860/65536 [32:01<11:30:34,  1.51it/s]
                                                       
{'loss': 1.2735, 'learning_rate': 9.633586384229215e-07, 'epoch': 176.54}

  4%|▍         | 2860/65536 [32:01<11:30:34,  1.51it/s]
  4%|▍         | 2861/65536 [32:02<11:16:20,  1.54it/s]
  4%|▍         | 2862/65536 [32:02<11:19:18,  1.54it/s]
  4%|▍         | 2863/65536 [32:03<11:28:58,  1.52it/s]
  4%|▍         | 2864/65536 [32:04<11:41:25,  1.49it/s]
  4%|▍         | 2865/65536 [32:04<11:46:28,  1.48it/s]
  4%|▍         | 2866/65536 [32:05<11:43:12,  1.49it/s]
  4%|▍         | 2867/65536 [32:06<12:01:59,  1.45it/s]
  4%|▍         | 2868/65536 [32:06<12:17:43,  1.42it/s]
  4%|▍         | 2869/65536 [32:07<12:19:43,  1.41it/s]
  4%|▍         | 2870/65536 [32:08<12:08:50,  1.43it/s]
  4%|▍         | 2871/65536 [32:09<12:17:42,  1.42it/s]
  4%|▍         | 2872/65536 [32:09<11:52:46,  1.47it/s]
  4%|▍         | 2873/65536 [32:10<11:57:32,  1.46it/s]
  4%|▍         | 2874/65536 [32:10<11:33:45,  1.51it/s]
  4%|▍         | 2875/65536 [32:11<11:22:51,  1.53it/s]
  4%|▍         | 2876/65536 [32:12<11:31:44,  1.51it/s]
  4%|▍         | 2877/65536 [32:12<11:33:44,  1.51it/s]
  4%|▍         | 2878/65536 [32:13<11:30:00,  1.51it/s]
  4%|▍         | 2879/65536 [32:14<11:26:16,  1.52it/s]
  4%|▍         | 2880/65536 [32:14<11:37:14,  1.50it/s]
                                                       
{'loss': 1.2533, 'learning_rate': 9.630831394636953e-07, 'epoch': 177.78}

  4%|▍         | 2880/65536 [32:14<11:37:14,  1.50it/s]
  4%|▍         | 2881/65536 [32:15<11:44:16,  1.48it/s]
  4%|▍         | 2882/65536 [32:16<11:32:02,  1.51it/s]
  4%|▍         | 2883/65536 [32:16<11:45:42,  1.48it/s]
  4%|▍         | 2884/65536 [32:17<12:03:13,  1.44it/s]
  4%|▍         | 2885/65536 [32:18<11:42:03,  1.49it/s]
  4%|▍         | 2886/65536 [32:19<11:41:21,  1.49it/s]
  4%|▍         | 2887/65536 [32:19<11:36:32,  1.50it/s]
  4%|▍         | 2888/65536 [32:20<11:34:28,  1.50it/s]
  4%|▍         | 2889/65536 [32:20<11:26:10,  1.52it/s]
  4%|▍         | 2890/65536 [32:21<11:33:30,  1.51it/s]
  4%|▍         | 2891/65536 [32:22<11:31:22,  1.51it/s]
  4%|▍         | 2892/65536 [32:22<11:26:11,  1.52it/s]
  4%|▍         | 2893/65536 [32:23<11:27:39,  1.52it/s]
  4%|▍         | 2894/65536 [32:24<11:23:09,  1.53it/s]
  4%|▍         | 2895/65536 [32:24<11:13:20,  1.55it/s]
  4%|▍         | 2896/65536 [32:25<11:34:24,  1.50it/s]
  4%|▍         | 2897/65536 [32:26<11:40:31,  1.49it/s]
  4%|▍         | 2898/65536 [32:27<11:55:12,  1.46it/s]
  4%|▍         | 2899/65536 [32:27<11:58:21,  1.45it/s]
  4%|▍         | 2900/65536 [32:28<11:59:31,  1.45it/s]
                                                       
{'loss': 1.2742, 'learning_rate': 9.628076405044692e-07, 'epoch': 179.01}

  4%|▍         | 2900/65536 [32:28<11:59:31,  1.45it/s]
  4%|▍         | 2901/65536 [32:29<11:43:49,  1.48it/s]
  4%|▍         | 2902/65536 [32:29<11:30:20,  1.51it/s]
  4%|▍         | 2903/65536 [32:30<11:26:06,  1.52it/s]
  4%|▍         | 2904/65536 [32:30<11:17:15,  1.54it/s]
  4%|▍         | 2905/65536 [32:31<11:22:38,  1.53it/s]
  4%|▍         | 2906/65536 [32:32<11:37:11,  1.50it/s]
  4%|▍         | 2907/65536 [32:33<11:59:18,  1.45it/s]
  4%|▍         | 2908/65536 [32:33<11:41:53,  1.49it/s]
  4%|▍         | 2909/65536 [32:34<11:27:20,  1.52it/s]
  4%|▍         | 2910/65536 [32:34<11:33:57,  1.50it/s]
  4%|▍         | 2911/65536 [32:35<11:27:30,  1.52it/s]
  4%|▍         | 2912/65536 [32:36<11:50:52,  1.47it/s]
  4%|▍         | 2913/65536 [32:37<12:00:43,  1.45it/s]
  4%|▍         | 2914/65536 [32:37<11:57:42,  1.45it/s]
  4%|▍         | 2915/65536 [32:38<11:50:20,  1.47it/s]
  4%|▍         | 2916/65536 [32:39<11:32:48,  1.51it/s]
  4%|▍         | 2917/65536 [32:39<11:58:53,  1.45it/s]
  4%|▍         | 2918/65536 [32:40<11:45:52,  1.48it/s]
  4%|▍         | 2919/65536 [32:41<11:34:56,  1.50it/s]
  4%|▍         | 2920/65536 [32:41<11:48:45,  1.47it/s]
                                                       
{'loss': 1.2661, 'learning_rate': 9.62532141545243e-07, 'epoch': 180.25}

  4%|▍         | 2920/65536 [32:41<11:48:45,  1.47it/s]
  4%|▍         | 2921/65536 [32:42<12:07:33,  1.43it/s]
  4%|▍         | 2922/65536 [32:43<11:55:03,  1.46it/s]
  4%|▍         | 2923/65536 [32:43<12:03:53,  1.44it/s]
  4%|▍         | 2924/65536 [32:44<12:16:25,  1.42it/s]
  4%|▍         | 2925/65536 [32:45<11:52:31,  1.46it/s]
  4%|▍         | 2926/65536 [32:45<11:46:28,  1.48it/s]
  4%|▍         | 2927/65536 [32:46<11:43:34,  1.48it/s]
  4%|▍         | 2928/65536 [32:47<11:44:11,  1.48it/s]
  4%|▍         | 2929/65536 [32:47<11:41:19,  1.49it/s]
  4%|▍         | 2930/65536 [32:48<11:37:48,  1.50it/s]
  4%|▍         | 2931/65536 [32:49<11:29:14,  1.51it/s]
  4%|▍         | 2932/65536 [32:49<11:23:10,  1.53it/s]
  4%|▍         | 2933/65536 [32:50<11:44:37,  1.48it/s]
  4%|▍         | 2934/65536 [32:51<11:39:52,  1.49it/s]
  4%|▍         | 2935/65536 [32:51<11:39:02,  1.49it/s]
  4%|▍         | 2936/65536 [32:52<11:52:53,  1.46it/s]
  4%|▍         | 2937/65536 [32:53<11:56:38,  1.46it/s]
  4%|▍         | 2938/65536 [32:53<11:35:20,  1.50it/s]
  4%|▍         | 2939/65536 [32:54<11:26:03,  1.52it/s]
  4%|▍         | 2940/65536 [32:55<11:48:34,  1.47it/s]
                                                       
{'loss': 1.2292, 'learning_rate': 9.62256642586017e-07, 'epoch': 181.48}

  4%|▍         | 2940/65536 [32:55<11:48:34,  1.47it/s]
  4%|▍         | 2941/65536 [32:55<11:44:19,  1.48it/s]
  4%|▍         | 2942/65536 [32:56<11:37:58,  1.49it/s]
  4%|▍         | 2943/65536 [32:57<11:31:47,  1.51it/s]
  4%|▍         | 2944/65536 [32:57<11:33:25,  1.50it/s]
  4%|▍         | 2945/65536 [32:58<11:13:25,  1.55it/s]
  4%|▍         | 2946/65536 [32:59<11:17:35,  1.54it/s]
  4%|▍         | 2947/65536 [32:59<11:25:54,  1.52it/s]
  4%|▍         | 2948/65536 [33:00<11:17:19,  1.54it/s]
  4%|▍         | 2949/65536 [33:01<11:44:30,  1.48it/s]
  5%|▍         | 2950/65536 [33:01<11:40:14,  1.49it/s]
  5%|▍         | 2951/65536 [33:02<11:39:53,  1.49it/s]
  5%|▍         | 2952/65536 [33:03<11:26:29,  1.52it/s]
  5%|▍         | 2953/65536 [33:03<11:46:23,  1.48it/s]
  5%|▍         | 2954/65536 [33:04<11:57:05,  1.45it/s]
  5%|▍         | 2955/65536 [33:05<11:57:27,  1.45it/s]
  5%|▍         | 2956/65536 [33:06<11:47:43,  1.47it/s]
  5%|▍         | 2957/65536 [33:06<11:47:05,  1.48it/s]
  5%|▍         | 2958/65536 [33:07<11:40:35,  1.49it/s]
  5%|▍         | 2959/65536 [33:08<11:50:13,  1.47it/s]
  5%|▍         | 2960/65536 [33:08<11:37:29,  1.50it/s]
                                                       
{'loss': 1.3016, 'learning_rate': 9.619811436267908e-07, 'epoch': 182.72}

  5%|▍         | 2960/65536 [33:08<11:37:29,  1.50it/s]
  5%|▍         | 2961/65536 [33:09<11:37:14,  1.50it/s]
  5%|▍         | 2962/65536 [33:09<11:25:10,  1.52it/s]
  5%|▍         | 2963/65536 [33:10<11:22:47,  1.53it/s]
  5%|▍         | 2964/65536 [33:11<11:28:08,  1.52it/s]
  5%|▍         | 2965/65536 [33:12<11:51:27,  1.47it/s]
  5%|▍         | 2966/65536 [33:12<11:45:20,  1.48it/s]
  5%|▍         | 2967/65536 [33:13<11:39:00,  1.49it/s]
  5%|▍         | 2968/65536 [33:14<11:34:16,  1.50it/s]
  5%|▍         | 2969/65536 [33:14<11:44:21,  1.48it/s]
  5%|▍         | 2970/65536 [33:15<11:59:32,  1.45it/s]
  5%|▍         | 2971/65536 [33:16<12:21:00,  1.41it/s]
  5%|▍         | 2972/65536 [33:16<11:57:26,  1.45it/s]
  5%|▍         | 2973/65536 [33:17<11:36:53,  1.50it/s]
  5%|▍         | 2974/65536 [33:18<11:34:22,  1.50it/s]
  5%|▍         | 2975/65536 [33:18<11:19:24,  1.53it/s]
  5%|▍         | 2976/65536 [33:19<11:08:10,  1.56it/s]
  5%|▍         | 2977/65536 [33:19<11:12:03,  1.55it/s]
  5%|▍         | 2978/65536 [33:20<11:20:22,  1.53it/s]
  5%|▍         | 2979/65536 [33:21<11:12:32,  1.55it/s]
  5%|▍         | 2980/65536 [33:21<11:23:40,  1.53it/s]
                                                       
{'loss': 1.276, 'learning_rate': 9.617056446675646e-07, 'epoch': 183.95}

  5%|▍         | 2980/65536 [33:21<11:23:40,  1.53it/s]
  5%|▍         | 2981/65536 [33:22<11:38:22,  1.49it/s]
  5%|▍         | 2982/65536 [33:23<11:32:34,  1.51it/s]
  5%|▍         | 2983/65536 [33:23<11:22:15,  1.53it/s]
  5%|▍         | 2984/65536 [33:24<11:29:27,  1.51it/s]
  5%|▍         | 2985/65536 [33:25<11:40:07,  1.49it/s]
  5%|▍         | 2986/65536 [33:25<11:37:45,  1.49it/s]
  5%|▍         | 2987/65536 [33:26<11:27:47,  1.52it/s]
  5%|▍         | 2988/65536 [33:27<11:22:22,  1.53it/s]
  5%|▍         | 2989/65536 [33:27<11:26:25,  1.52it/s]
  5%|▍         | 2990/65536 [33:28<11:13:51,  1.55it/s]
  5%|▍         | 2991/65536 [33:29<11:21:06,  1.53it/s]
  5%|▍         | 2992/65536 [33:29<11:27:19,  1.52it/s]
  5%|▍         | 2993/65536 [33:30<11:48:38,  1.47it/s]
  5%|▍         | 2994/65536 [33:31<11:38:51,  1.49it/s]
  5%|▍         | 2995/65536 [33:31<11:49:51,  1.47it/s]
  5%|▍         | 2996/65536 [33:32<11:45:02,  1.48it/s]
  5%|▍         | 2997/65536 [33:33<11:48:27,  1.47it/s]
  5%|▍         | 2998/65536 [33:34<11:55:35,  1.46it/s]
  5%|▍         | 2999/65536 [33:34<11:55:08,  1.46it/s]
  5%|▍         | 3000/65536 [33:35<11:58:30,  1.45it/s]
                                                       
{'loss': 1.2571, 'learning_rate': 9.614301457083383e-07, 'epoch': 185.19}

  5%|▍         | 3000/65536 [33:35<11:58:30,  1.45it/s]
  5%|▍         | 3001/65536 [33:36<12:00:35,  1.45it/s]
  5%|▍         | 3002/65536 [33:36<11:36:53,  1.50it/s]
  5%|▍         | 3003/65536 [33:37<11:52:56,  1.46it/s]
  5%|▍         | 3004/65536 [33:38<11:30:04,  1.51it/s]
  5%|▍         | 3005/65536 [33:38<11:26:23,  1.52it/s]
  5%|▍         | 3006/65536 [33:39<11:23:35,  1.52it/s]
  5%|▍         | 3007/65536 [33:40<11:22:43,  1.53it/s]
  5%|▍         | 3008/65536 [33:40<11:15:28,  1.54it/s]
  5%|▍         | 3009/65536 [33:41<11:48:01,  1.47it/s]
  5%|▍         | 3010/65536 [33:42<11:55:20,  1.46it/s]
  5%|▍         | 3011/65536 [33:42<11:46:25,  1.48it/s]
  5%|▍         | 3012/65536 [33:43<11:52:27,  1.46it/s]
  5%|▍         | 3013/65536 [33:44<11:34:58,  1.50it/s]
  5%|▍         | 3014/65536 [33:44<11:55:29,  1.46it/s]
  5%|▍         | 3015/65536 [33:45<11:54:15,  1.46it/s]
  5%|▍         | 3016/65536 [33:46<12:06:01,  1.44it/s]
  5%|▍         | 3017/65536 [33:46<11:59:50,  1.45it/s]
  5%|▍         | 3018/65536 [33:47<11:45:40,  1.48it/s]
  5%|▍         | 3019/65536 [33:48<11:48:26,  1.47it/s]
  5%|▍         | 3020/65536 [33:48<11:38:13,  1.49it/s]
                                                       
{'loss': 1.2509, 'learning_rate': 9.611546467491124e-07, 'epoch': 186.42}

  5%|▍         | 3020/65536 [33:48<11:38:13,  1.49it/s]
  5%|▍         | 3021/65536 [33:49<11:41:18,  1.49it/s]
  5%|▍         | 3022/65536 [33:50<11:42:56,  1.48it/s]
  5%|▍         | 3023/65536 [33:50<11:35:48,  1.50it/s]
  5%|▍         | 3024/65536 [33:51<11:34:57,  1.50it/s]
  5%|▍         | 3025/65536 [33:52<11:35:30,  1.50it/s]
  5%|▍         | 3026/65536 [33:52<11:37:14,  1.49it/s]
  5%|▍         | 3027/65536 [33:53<11:35:51,  1.50it/s]
  5%|▍         | 3028/65536 [33:54<11:33:47,  1.50it/s]
  5%|▍         | 3029/65536 [33:54<11:37:45,  1.49it/s]
  5%|▍         | 3030/65536 [33:55<11:44:49,  1.48it/s]
  5%|▍         | 3031/65536 [33:56<11:36:20,  1.50it/s]
  5%|▍         | 3032/65536 [33:56<11:38:54,  1.49it/s]
  5%|▍         | 3033/65536 [33:57<11:56:02,  1.45it/s]
  5%|▍         | 3034/65536 [33:58<11:29:39,  1.51it/s]
  5%|▍         | 3035/65536 [33:58<11:26:38,  1.52it/s]
  5%|▍         | 3036/65536 [33:59<11:40:10,  1.49it/s]
  5%|▍         | 3037/65536 [34:00<11:44:36,  1.48it/s]
  5%|▍         | 3038/65536 [34:00<11:35:37,  1.50it/s]
  5%|▍         | 3039/65536 [34:01<11:52:18,  1.46it/s]
  5%|▍         | 3040/65536 [34:02<11:56:31,  1.45it/s]
                                                       
{'loss': 1.2469, 'learning_rate': 9.60879147789886e-07, 'epoch': 187.65}

  5%|▍         | 3040/65536 [34:02<11:56:31,  1.45it/s]
  5%|▍         | 3041/65536 [34:03<11:46:19,  1.47it/s]
  5%|▍         | 3042/65536 [34:03<11:51:36,  1.46it/s]
  5%|▍         | 3043/65536 [34:04<11:41:31,  1.48it/s]
  5%|▍         | 3044/65536 [34:05<11:38:46,  1.49it/s]
  5%|▍         | 3045/65536 [34:05<11:21:16,  1.53it/s]
  5%|▍         | 3046/65536 [34:06<11:32:06,  1.50it/s]
  5%|▍         | 3047/65536 [34:06<11:30:43,  1.51it/s]
  5%|▍         | 3048/65536 [34:07<11:24:10,  1.52it/s]
  5%|▍         | 3049/65536 [34:08<11:24:08,  1.52it/s]
  5%|▍         | 3050/65536 [34:08<11:35:58,  1.50it/s]
  5%|▍         | 3051/65536 [34:09<11:28:12,  1.51it/s]
  5%|▍         | 3052/65536 [34:10<11:15:54,  1.54it/s]
  5%|▍         | 3053/65536 [34:10<11:43:36,  1.48it/s]
  5%|▍         | 3054/65536 [34:11<12:10:04,  1.43it/s]
  5%|▍         | 3055/65536 [34:12<11:55:32,  1.46it/s]
  5%|▍         | 3056/65536 [34:13<11:49:50,  1.47it/s]
  5%|▍         | 3057/65536 [34:13<11:57:52,  1.45it/s]
  5%|▍         | 3058/65536 [34:14<11:48:23,  1.47it/s]
  5%|▍         | 3059/65536 [34:15<11:27:26,  1.51it/s]
  5%|▍         | 3060/65536 [34:15<11:16:11,  1.54it/s]
                                                       
{'loss': 1.2505, 'learning_rate': 9.6060364883066e-07, 'epoch': 188.89}

  5%|▍         | 3060/65536 [34:15<11:16:11,  1.54it/s]
  5%|▍         | 3061/65536 [34:16<11:02:05,  1.57it/s]
  5%|▍         | 3062/65536 [34:17<11:29:09,  1.51it/s]
  5%|▍         | 3063/65536 [34:17<11:15:07,  1.54it/s]
  5%|▍         | 3064/65536 [34:18<11:12:28,  1.55it/s]
  5%|▍         | 3065/65536 [34:18<11:07:53,  1.56it/s]
  5%|▍         | 3066/65536 [34:19<11:13:58,  1.54it/s]
  5%|▍         | 3067/65536 [34:20<11:28:35,  1.51it/s]
  5%|▍         | 3068/65536 [34:20<11:27:20,  1.51it/s]
  5%|▍         | 3069/65536 [34:21<11:46:28,  1.47it/s]
  5%|▍         | 3070/65536 [34:22<11:48:51,  1.47it/s]
  5%|▍         | 3071/65536 [34:23<11:52:23,  1.46it/s]
  5%|▍         | 3072/65536 [34:23<11:46:39,  1.47it/s]
  5%|▍         | 3073/65536 [34:24<11:43:29,  1.48it/s]
  5%|▍         | 3074/65536 [34:25<11:50:16,  1.47it/s]
  5%|▍         | 3075/65536 [34:25<12:02:57,  1.44it/s]
  5%|▍         | 3076/65536 [34:26<11:37:11,  1.49it/s]
  5%|▍         | 3077/65536 [34:27<11:25:48,  1.52it/s]
  5%|▍         | 3078/65536 [34:27<11:01:56,  1.57it/s]
  5%|▍         | 3079/65536 [34:28<11:28:58,  1.51it/s]
  5%|▍         | 3080/65536 [34:29<11:58:08,  1.45it/s]
                                                       
{'loss': 1.2913, 'learning_rate': 9.603281498714337e-07, 'epoch': 190.12}

  5%|▍         | 3080/65536 [34:29<11:58:08,  1.45it/s]
  5%|▍         | 3081/65536 [34:29<11:57:03,  1.45it/s]
  5%|▍         | 3082/65536 [34:30<11:43:01,  1.48it/s]
  5%|▍         | 3083/65536 [34:31<11:43:17,  1.48it/s]
  5%|▍         | 3084/65536 [34:31<11:41:22,  1.48it/s]
  5%|▍         | 3085/65536 [34:32<11:39:48,  1.49it/s]
  5%|▍         | 3086/65536 [34:33<11:40:03,  1.49it/s]
  5%|▍         | 3087/65536 [34:33<11:46:45,  1.47it/s]
  5%|▍         | 3088/65536 [34:34<11:45:08,  1.48it/s]
  5%|▍         | 3089/65536 [34:35<11:45:22,  1.48it/s]
  5%|▍         | 3090/65536 [34:35<11:29:49,  1.51it/s]
  5%|▍         | 3091/65536 [34:36<11:26:19,  1.52it/s]
  5%|▍         | 3092/65536 [34:37<11:38:02,  1.49it/s]
  5%|▍         | 3093/65536 [34:37<11:41:44,  1.48it/s]
  5%|▍         | 3094/65536 [34:38<11:17:42,  1.54it/s]
  5%|▍         | 3095/65536 [34:39<11:36:50,  1.49it/s]
  5%|▍         | 3096/65536 [34:39<11:26:15,  1.52it/s]
  5%|▍         | 3097/65536 [34:40<11:48:16,  1.47it/s]
  5%|▍         | 3098/65536 [34:41<11:39:02,  1.49it/s]
  5%|▍         | 3099/65536 [34:41<11:45:59,  1.47it/s]
  5%|▍         | 3100/65536 [34:42<11:36:49,  1.49it/s]
                                                       
{'loss': 1.2495, 'learning_rate': 9.600526509122076e-07, 'epoch': 191.36}

  5%|▍         | 3100/65536 [34:42<11:36:49,  1.49it/s]
  5%|▍         | 3101/65536 [34:43<11:29:50,  1.51it/s]
  5%|▍         | 3102/65536 [34:43<11:29:25,  1.51it/s]
  5%|▍         | 3103/65536 [34:44<11:58:18,  1.45it/s]
  5%|▍         | 3104/65536 [34:45<12:04:13,  1.44it/s]
  5%|▍         | 3105/65536 [34:45<12:01:41,  1.44it/s]
  5%|▍         | 3106/65536 [34:46<11:57:22,  1.45it/s]
  5%|▍         | 3107/65536 [34:47<11:51:44,  1.46it/s]
  5%|▍         | 3108/65536 [34:47<11:35:56,  1.50it/s]
  5%|▍         | 3109/65536 [34:48<11:42:02,  1.48it/s]
  5%|▍         | 3110/65536 [34:49<11:27:58,  1.51it/s]
  5%|▍         | 3111/65536 [34:49<11:45:09,  1.48it/s]
  5%|▍         | 3112/65536 [34:50<12:00:59,  1.44it/s]
  5%|▍         | 3113/65536 [34:51<11:57:29,  1.45it/s]
  5%|▍         | 3114/65536 [34:52<12:07:14,  1.43it/s]
  5%|▍         | 3115/65536 [34:52<11:59:04,  1.45it/s]
  5%|▍         | 3116/65536 [34:53<12:03:36,  1.44it/s]
  5%|▍         | 3117/65536 [34:54<11:51:17,  1.46it/s]
  5%|▍         | 3118/65536 [34:54<11:34:46,  1.50it/s]
  5%|▍         | 3119/65536 [34:55<11:55:49,  1.45it/s]
  5%|▍         | 3120/65536 [34:56<11:33:24,  1.50it/s]
                                                       
{'loss': 1.2404, 'learning_rate': 9.597771519529814e-07, 'epoch': 192.59}

  5%|▍         | 3120/65536 [34:56<11:33:24,  1.50it/s]
  5%|▍         | 3121/65536 [34:56<11:14:23,  1.54it/s]
  5%|▍         | 3122/65536 [34:57<11:08:26,  1.56it/s]
  5%|▍         | 3123/65536 [34:57<11:06:46,  1.56it/s]
  5%|▍         | 3124/65536 [34:58<11:13:23,  1.54it/s]
  5%|▍         | 3125/65536 [34:59<11:16:04,  1.54it/s]
  5%|▍         | 3126/65536 [34:59<11:29:51,  1.51it/s]
  5%|▍         | 3127/65536 [35:00<11:46:33,  1.47it/s]
  5%|▍         | 3128/65536 [35:01<11:53:56,  1.46it/s]
  5%|▍         | 3129/65536 [35:02<11:45:27,  1.47it/s]
  5%|▍         | 3130/65536 [35:02<11:33:10,  1.50it/s]
  5%|▍         | 3131/65536 [35:03<11:45:26,  1.47it/s]
  5%|▍         | 3132/65536 [35:04<11:57:08,  1.45it/s]
  5%|▍         | 3133/65536 [35:04<12:06:08,  1.43it/s]
  5%|▍         | 3134/65536 [35:05<11:44:46,  1.48it/s]
  5%|▍         | 3135/65536 [35:06<11:56:18,  1.45it/s]
  5%|▍         | 3136/65536 [35:06<11:48:40,  1.47it/s]
  5%|▍         | 3137/65536 [35:07<11:31:19,  1.50it/s]
  5%|▍         | 3138/65536 [35:08<11:28:22,  1.51it/s]
  5%|▍         | 3139/65536 [35:08<11:25:27,  1.52it/s]
  5%|▍         | 3140/65536 [35:09<11:13:34,  1.54it/s]
                                                       
{'loss': 1.2259, 'learning_rate': 9.595016529937553e-07, 'epoch': 193.83}

  5%|▍         | 3140/65536 [35:09<11:13:34,  1.54it/s]
  5%|▍         | 3141/65536 [35:10<11:33:36,  1.50it/s]
  5%|▍         | 3142/65536 [35:10<11:41:38,  1.48it/s]
  5%|▍         | 3143/65536 [35:11<11:45:30,  1.47it/s]
  5%|▍         | 3144/65536 [35:12<11:35:35,  1.49it/s]
  5%|▍         | 3145/65536 [35:12<11:37:02,  1.49it/s]
  5%|▍         | 3146/65536 [35:13<11:47:12,  1.47it/s]
  5%|▍         | 3147/65536 [35:14<11:59:49,  1.44it/s]
  5%|▍         | 3148/65536 [35:14<11:39:58,  1.49it/s]
  5%|▍         | 3149/65536 [35:15<11:33:22,  1.50it/s]
  5%|▍         | 3150/65536 [35:16<11:13:48,  1.54it/s]
  5%|▍         | 3151/65536 [35:16<11:37:06,  1.49it/s]
  5%|▍         | 3152/65536 [35:17<11:35:12,  1.50it/s]
  5%|▍         | 3153/65536 [35:18<11:47:39,  1.47it/s]
  5%|▍         | 3154/65536 [35:18<11:48:09,  1.47it/s]
  5%|▍         | 3155/65536 [35:19<11:51:18,  1.46it/s]
  5%|▍         | 3156/65536 [35:20<11:31:15,  1.50it/s]
  5%|▍         | 3157/65536 [35:20<11:15:14,  1.54it/s]
  5%|▍         | 3158/65536 [35:21<11:23:39,  1.52it/s]
  5%|▍         | 3159/65536 [35:22<11:23:12,  1.52it/s]
  5%|▍         | 3160/65536 [35:22<11:44:40,  1.48it/s]
                                                       
{'loss': 1.275, 'learning_rate': 9.592261540345292e-07, 'epoch': 195.06}

  5%|▍         | 3160/65536 [35:22<11:44:40,  1.48it/s]
  5%|▍         | 3161/65536 [35:23<11:42:09,  1.48it/s]
  5%|▍         | 3162/65536 [35:24<11:36:16,  1.49it/s]
  5%|▍         | 3163/65536 [35:24<11:26:08,  1.52it/s]
  5%|▍         | 3164/65536 [35:25<11:24:58,  1.52it/s]
  5%|▍         | 3165/65536 [35:26<11:21:21,  1.53it/s]
  5%|▍         | 3166/65536 [35:26<11:36:17,  1.49it/s]
  5%|▍         | 3167/65536 [35:27<11:38:43,  1.49it/s]
  5%|▍         | 3168/65536 [35:28<11:28:54,  1.51it/s]
  5%|▍         | 3169/65536 [35:28<11:16:48,  1.54it/s]
  5%|▍         | 3170/65536 [35:29<11:44:24,  1.48it/s]
  5%|▍         | 3171/65536 [35:30<11:37:46,  1.49it/s]
  5%|▍         | 3172/65536 [35:30<11:46:25,  1.47it/s]
  5%|▍         | 3173/65536 [35:31<11:47:07,  1.47it/s]
  5%|▍         | 3174/65536 [35:32<11:41:19,  1.48it/s]
  5%|▍         | 3175/65536 [35:32<11:46:56,  1.47it/s]
  5%|▍         | 3176/65536 [35:33<11:46:00,  1.47it/s]
  5%|▍         | 3177/65536 [35:34<11:40:47,  1.48it/s]
  5%|▍         | 3178/65536 [35:34<11:39:29,  1.49it/s]
  5%|▍         | 3179/65536 [35:35<11:33:51,  1.50it/s]
  5%|▍         | 3180/65536 [35:36<11:41:57,  1.48it/s]
                                                       
{'loss': 1.2309, 'learning_rate': 9.58950655075303e-07, 'epoch': 196.3}

  5%|▍         | 3180/65536 [35:36<11:41:57,  1.48it/s]
  5%|▍         | 3181/65536 [35:36<11:48:07,  1.47it/s]
  5%|▍         | 3182/65536 [35:37<11:40:52,  1.48it/s]
  5%|▍         | 3183/65536 [35:38<11:44:43,  1.47it/s]
  5%|▍         | 3184/65536 [35:39<12:03:03,  1.44it/s]
  5%|▍         | 3185/65536 [35:39<11:44:49,  1.47it/s]
  5%|▍         | 3186/65536 [35:40<11:47:33,  1.47it/s]
  5%|▍         | 3187/65536 [35:40<11:25:23,  1.52it/s]
  5%|▍         | 3188/65536 [35:41<11:16:09,  1.54it/s]
  5%|▍         | 3189/65536 [35:42<11:21:39,  1.52it/s]
  5%|▍         | 3190/65536 [35:42<11:27:01,  1.51it/s]
  5%|▍         | 3191/65536 [35:43<11:44:36,  1.47it/s]
  5%|▍         | 3192/65536 [35:44<12:15:31,  1.41it/s]
  5%|▍         | 3193/65536 [35:45<11:58:39,  1.45it/s]
  5%|▍         | 3194/65536 [35:45<11:45:31,  1.47it/s]
  5%|▍         | 3195/65536 [35:46<11:36:19,  1.49it/s]
  5%|▍         | 3196/65536 [35:47<11:22:23,  1.52it/s]
  5%|▍         | 3197/65536 [35:47<11:22:10,  1.52it/s]
  5%|▍         | 3198/65536 [35:48<11:18:16,  1.53it/s]
  5%|▍         | 3199/65536 [35:49<11:45:57,  1.47it/s]
  5%|▍         | 3200/65536 [35:49<11:35:47,  1.49it/s]
                                                       
{'loss': 1.2188, 'learning_rate': 9.586751561160769e-07, 'epoch': 197.53}

  5%|▍         | 3200/65536 [35:49<11:35:47,  1.49it/s]
  5%|▍         | 3201/65536 [35:50<11:35:12,  1.49it/s]
  5%|▍         | 3202/65536 [35:51<11:31:13,  1.50it/s]
  5%|▍         | 3203/65536 [35:51<11:46:49,  1.47it/s]
  5%|▍         | 3204/65536 [35:52<11:37:22,  1.49it/s]
  5%|▍         | 3205/65536 [35:53<11:53:17,  1.46it/s]
  5%|▍         | 3206/65536 [35:53<11:50:13,  1.46it/s]
  5%|▍         | 3207/65536 [35:54<11:53:09,  1.46it/s]
  5%|▍         | 3208/65536 [35:55<12:00:17,  1.44it/s]
  5%|▍         | 3209/65536 [35:55<11:57:12,  1.45it/s]
  5%|▍         | 3210/65536 [35:56<12:18:33,  1.41it/s]
  5%|▍         | 3211/65536 [35:57<11:54:09,  1.45it/s]
  5%|▍         | 3212/65536 [35:57<11:56:51,  1.45it/s]
  5%|▍         | 3213/65536 [35:58<11:51:27,  1.46it/s]
  5%|▍         | 3214/65536 [35:59<11:40:04,  1.48it/s]
  5%|▍         | 3215/65536 [36:00<11:51:53,  1.46it/s]
  5%|▍         | 3216/65536 [36:00<12:03:24,  1.44it/s]
  5%|▍         | 3217/65536 [36:01<11:53:16,  1.46it/s]
  5%|▍         | 3218/65536 [36:02<11:42:05,  1.48it/s]
  5%|▍         | 3219/65536 [36:02<11:38:09,  1.49it/s]
  5%|▍         | 3220/65536 [36:03<11:42:29,  1.48it/s]
                                                       
{'loss': 1.225, 'learning_rate': 9.583996571568507e-07, 'epoch': 198.77}

  5%|▍         | 3220/65536 [36:03<11:42:29,  1.48it/s]
  5%|▍         | 3221/65536 [36:04<11:34:43,  1.49it/s]
  5%|▍         | 3222/65536 [36:04<11:44:51,  1.47it/s]
  5%|▍         | 3223/65536 [36:05<11:28:24,  1.51it/s]
  5%|▍         | 3224/65536 [36:06<11:35:34,  1.49it/s]
  5%|▍         | 3225/65536 [36:06<11:29:10,  1.51it/s]
  5%|▍         | 3226/65536 [36:07<11:37:43,  1.49it/s]
  5%|▍         | 3227/65536 [36:08<11:42:54,  1.48it/s]
  5%|▍         | 3228/65536 [36:08<11:28:20,  1.51it/s]
  5%|▍         | 3229/65536 [36:09<11:21:09,  1.52it/s]
  5%|▍         | 3230/65536 [36:10<11:21:42,  1.52it/s]
  5%|▍         | 3231/65536 [36:10<11:33:59,  1.50it/s]
  5%|▍         | 3232/65536 [36:11<11:59:26,  1.44it/s]
  5%|▍         | 3233/65536 [36:12<11:52:48,  1.46it/s]
  5%|▍         | 3234/65536 [36:12<11:47:25,  1.47it/s]
  5%|▍         | 3235/65536 [36:13<11:38:32,  1.49it/s]
  5%|▍         | 3236/65536 [36:14<11:29:30,  1.51it/s]
  5%|▍         | 3237/65536 [36:14<11:27:03,  1.51it/s]
  5%|▍         | 3238/65536 [36:15<11:33:22,  1.50it/s]
  5%|▍         | 3239/65536 [36:16<11:40:01,  1.48it/s]
  5%|▍         | 3240/65536 [36:16<11:27:45,  1.51it/s]
                                                       
{'loss': 1.259, 'learning_rate': 9.581241581976246e-07, 'epoch': 200.0}

  5%|▍         | 3240/65536 [36:16<11:27:45,  1.51it/s]
  5%|▍         | 3241/65536 [36:17<11:50:00,  1.46it/s]
  5%|▍         | 3242/65536 [36:18<11:27:23,  1.51it/s]
  5%|▍         | 3243/65536 [36:18<11:23:11,  1.52it/s]
  5%|▍         | 3244/65536 [36:19<11:20:33,  1.53it/s]
  5%|▍         | 3245/65536 [36:20<11:21:41,  1.52it/s]
  5%|▍         | 3246/65536 [36:20<11:26:02,  1.51it/s]
  5%|▍         | 3247/65536 [36:21<11:30:44,  1.50it/s]
  5%|▍         | 3248/65536 [36:22<11:45:14,  1.47it/s]
  5%|▍         | 3249/65536 [36:22<11:52:39,  1.46it/s]
  5%|▍         | 3250/65536 [36:23<11:46:28,  1.47it/s]
  5%|▍         | 3251/65536 [36:24<11:35:35,  1.49it/s]
  5%|▍         | 3252/65536 [36:24<11:58:01,  1.45it/s]
  5%|▍         | 3253/65536 [36:25<11:46:16,  1.47it/s]
  5%|▍         | 3254/65536 [36:26<11:28:45,  1.51it/s]
  5%|▍         | 3255/65536 [36:26<11:27:02,  1.51it/s]
  5%|▍         | 3256/65536 [36:27<11:18:07,  1.53it/s]
  5%|▍         | 3257/65536 [36:28<11:27:15,  1.51it/s]
  5%|▍         | 3258/65536 [36:28<11:24:19,  1.52it/s]
  5%|▍         | 3259/65536 [36:29<11:32:22,  1.50it/s]
  5%|▍         | 3260/65536 [36:30<11:40:17,  1.48it/s]
                                                       
{'loss': 1.2493, 'learning_rate': 9.578486592383982e-07, 'epoch': 201.23}

  5%|▍         | 3260/65536 [36:30<11:40:17,  1.48it/s]
  5%|▍         | 3261/65536 [36:30<11:21:51,  1.52it/s]
  5%|▍         | 3262/65536 [36:31<11:32:52,  1.50it/s]
  5%|▍         | 3263/65536 [36:32<11:31:37,  1.50it/s]
  5%|▍         | 3264/65536 [36:32<11:18:41,  1.53it/s]
  5%|▍         | 3265/65536 [36:33<11:16:08,  1.53it/s]
  5%|▍         | 3266/65536 [36:34<11:15:21,  1.54it/s]
  5%|▍         | 3267/65536 [36:34<11:21:27,  1.52it/s]
  5%|▍         | 3268/65536 [36:35<11:14:24,  1.54it/s]
  5%|▍         | 3269/65536 [36:36<11:18:15,  1.53it/s]
  5%|▍         | 3270/65536 [36:36<11:31:13,  1.50it/s]
  5%|▍         | 3271/65536 [36:37<11:46:53,  1.47it/s]
  5%|▍         | 3272/65536 [36:38<11:41:52,  1.48it/s]
  5%|▍         | 3273/65536 [36:38<11:57:53,  1.45it/s]
  5%|▍         | 3274/65536 [36:39<11:47:34,  1.47it/s]
  5%|▍         | 3275/65536 [36:40<11:33:32,  1.50it/s]
  5%|▍         | 3276/65536 [36:40<11:41:40,  1.48it/s]
  5%|▌         | 3277/65536 [36:41<11:39:59,  1.48it/s]
  5%|▌         | 3278/65536 [36:42<11:21:32,  1.52it/s]
  5%|▌         | 3279/65536 [36:42<11:29:33,  1.50it/s]
  5%|▌         | 3280/65536 [36:43<11:37:29,  1.49it/s]
                                                       
{'loss': 1.2747, 'learning_rate': 9.575731602791723e-07, 'epoch': 202.47}

  5%|▌         | 3280/65536 [36:43<11:37:29,  1.49it/s]
  5%|▌         | 3281/65536 [36:44<11:27:41,  1.51it/s]
  5%|▌         | 3282/65536 [36:44<11:37:07,  1.49it/s]
  5%|▌         | 3283/65536 [36:45<11:32:20,  1.50it/s]
  5%|▌         | 3284/65536 [36:46<11:36:01,  1.49it/s]
  5%|▌         | 3285/65536 [36:46<11:37:29,  1.49it/s]
  5%|▌         | 3286/65536 [36:47<11:38:16,  1.49it/s]
  5%|▌         | 3287/65536 [36:48<11:45:05,  1.47it/s]
  5%|▌         | 3288/65536 [36:48<11:23:17,  1.52it/s]
  5%|▌         | 3289/65536 [36:49<11:27:15,  1.51it/s]
  5%|▌         | 3290/65536 [36:50<11:42:55,  1.48it/s]
  5%|▌         | 3291/65536 [36:50<11:42:24,  1.48it/s]
  5%|▌         | 3292/65536 [36:51<11:37:56,  1.49it/s]
  5%|▌         | 3293/65536 [36:52<11:27:21,  1.51it/s]
  5%|▌         | 3294/65536 [36:52<11:23:37,  1.52it/s]
  5%|▌         | 3295/65536 [36:53<11:20:25,  1.52it/s]
  5%|▌         | 3296/65536 [36:54<11:10:27,  1.55it/s]
  5%|▌         | 3297/65536 [36:54<11:35:21,  1.49it/s]
  5%|▌         | 3298/65536 [36:55<11:34:02,  1.49it/s]
  5%|▌         | 3299/65536 [36:56<11:50:33,  1.46it/s]
  5%|▌         | 3300/65536 [36:56<11:42:45,  1.48it/s]
                                                       
{'loss': 1.2412, 'learning_rate': 9.57297661319946e-07, 'epoch': 203.7}

  5%|▌         | 3300/65536 [36:56<11:42:45,  1.48it/s]
  5%|▌         | 3301/65536 [36:57<11:54:20,  1.45it/s]
  5%|▌         | 3302/65536 [36:58<11:39:35,  1.48it/s]
  5%|▌         | 3303/65536 [36:58<11:20:09,  1.52it/s]
  5%|▌         | 3304/65536 [36:59<11:20:04,  1.53it/s]
  5%|▌         | 3305/65536 [37:00<11:36:50,  1.49it/s]
  5%|▌         | 3306/65536 [37:00<11:21:48,  1.52it/s]
  5%|▌         | 3307/65536 [37:01<11:38:54,  1.48it/s]
  5%|▌         | 3308/65536 [37:02<12:09:02,  1.42it/s]
  5%|▌         | 3309/65536 [37:02<11:56:44,  1.45it/s]
  5%|▌         | 3310/65536 [37:03<11:43:57,  1.47it/s]
  5%|▌         | 3311/65536 [37:04<11:38:29,  1.48it/s]
  5%|▌         | 3312/65536 [37:04<11:29:43,  1.50it/s]
  5%|▌         | 3313/65536 [37:05<11:26:37,  1.51it/s]
  5%|▌         | 3314/65536 [37:06<11:17:01,  1.53it/s]
  5%|▌         | 3315/65536 [37:06<11:24:13,  1.52it/s]
  5%|▌         | 3316/65536 [37:07<11:34:23,  1.49it/s]
  5%|▌         | 3317/65536 [37:08<11:29:14,  1.50it/s]
  5%|▌         | 3318/65536 [37:08<11:35:12,  1.49it/s]
  5%|▌         | 3319/65536 [37:09<11:28:40,  1.51it/s]
  5%|▌         | 3320/65536 [37:10<11:29:44,  1.50it/s]
                                                       
{'loss': 1.2313, 'learning_rate': 9.5702216236072e-07, 'epoch': 204.94}

  5%|▌         | 3320/65536 [37:10<11:29:44,  1.50it/s]
  5%|▌         | 3321/65536 [37:10<11:32:54,  1.50it/s]
  5%|▌         | 3322/65536 [37:11<11:52:14,  1.46it/s]
  5%|▌         | 3323/65536 [37:12<11:36:56,  1.49it/s]
  5%|▌         | 3324/65536 [37:12<11:12:34,  1.54it/s]
  5%|▌         | 3325/65536 [37:13<11:20:01,  1.52it/s]
  5%|▌         | 3326/65536 [37:14<11:32:13,  1.50it/s]
  5%|▌         | 3327/65536 [37:14<11:11:26,  1.54it/s]
  5%|▌         | 3328/65536 [37:15<11:39:25,  1.48it/s]
  5%|▌         | 3329/65536 [37:16<11:46:09,  1.47it/s]
  5%|▌         | 3330/65536 [37:16<11:35:54,  1.49it/s]
  5%|▌         | 3331/65536 [37:17<11:41:55,  1.48it/s]
  5%|▌         | 3332/65536 [37:18<11:37:22,  1.49it/s]
  5%|▌         | 3333/65536 [37:18<11:28:30,  1.51it/s]
  5%|▌         | 3334/65536 [37:19<11:30:44,  1.50it/s]
  5%|▌         | 3335/65536 [37:20<11:34:51,  1.49it/s]
  5%|▌         | 3336/65536 [37:20<11:34:26,  1.49it/s]
  5%|▌         | 3337/65536 [37:21<11:32:38,  1.50it/s]
  5%|▌         | 3338/65536 [37:22<11:46:06,  1.47it/s]
  5%|▌         | 3339/65536 [37:22<11:20:54,  1.52it/s]
  5%|▌         | 3340/65536 [37:23<11:55:00,  1.45it/s]
                                                       
{'loss': 1.2546, 'learning_rate': 9.567466634014937e-07, 'epoch': 206.17}

  5%|▌         | 3340/65536 [37:23<11:55:00,  1.45it/s]
  5%|▌         | 3341/65536 [37:24<11:48:18,  1.46it/s]
  5%|▌         | 3342/65536 [37:25<11:49:32,  1.46it/s]
  5%|▌         | 3343/65536 [37:25<11:41:04,  1.48it/s]
  5%|▌         | 3344/65536 [37:26<11:33:50,  1.49it/s]
  5%|▌         | 3345/65536 [37:27<11:26:43,  1.51it/s]
  5%|▌         | 3346/65536 [37:27<11:42:07,  1.48it/s]
  5%|▌         | 3347/65536 [37:28<11:27:53,  1.51it/s]
  5%|▌         | 3348/65536 [37:29<11:26:36,  1.51it/s]
  5%|▌         | 3349/65536 [37:29<11:10:14,  1.55it/s]
  5%|▌         | 3350/65536 [37:30<11:15:54,  1.53it/s]
  5%|▌         | 3351/65536 [37:30<11:10:50,  1.54it/s]
  5%|▌         | 3352/65536 [37:31<11:27:40,  1.51it/s]
  5%|▌         | 3353/65536 [37:32<11:27:28,  1.51it/s]
  5%|▌         | 3354/65536 [37:33<11:45:31,  1.47it/s]
  5%|▌         | 3355/65536 [37:33<11:28:45,  1.50it/s]
  5%|▌         | 3356/65536 [37:34<11:29:37,  1.50it/s]
  5%|▌         | 3357/65536 [37:34<11:35:46,  1.49it/s]
  5%|▌         | 3358/65536 [37:35<11:37:09,  1.49it/s]
  5%|▌         | 3359/65536 [37:36<11:31:25,  1.50it/s]
  5%|▌         | 3360/65536 [37:36<11:13:55,  1.54it/s]
                                                       
{'loss': 1.2569, 'learning_rate': 9.564711644422677e-07, 'epoch': 207.41}

  5%|▌         | 3360/65536 [37:36<11:13:55,  1.54it/s]
  5%|▌         | 3361/65536 [37:37<11:15:43,  1.53it/s]
  5%|▌         | 3362/65536 [37:38<10:57:52,  1.58it/s]
  5%|▌         | 3363/65536 [37:38<11:11:11,  1.54it/s]
  5%|▌         | 3364/65536 [37:39<11:11:53,  1.54it/s]
  5%|▌         | 3365/65536 [37:40<11:39:04,  1.48it/s]
  5%|▌         | 3366/65536 [37:40<11:24:59,  1.51it/s]
  5%|▌         | 3367/65536 [37:41<11:26:10,  1.51it/s]
  5%|▌         | 3368/65536 [37:42<11:47:50,  1.46it/s]
  5%|▌         | 3369/65536 [37:42<11:52:03,  1.46it/s]
  5%|▌         | 3370/65536 [37:43<12:10:04,  1.42it/s]
  5%|▌         | 3371/65536 [37:44<12:14:14,  1.41it/s]
  5%|▌         | 3372/65536 [37:45<12:00:12,  1.44it/s]
  5%|▌         | 3373/65536 [37:45<12:01:24,  1.44it/s]
  5%|▌         | 3374/65536 [37:46<12:02:42,  1.43it/s]
  5%|▌         | 3375/65536 [37:47<11:50:47,  1.46it/s]
  5%|▌         | 3376/65536 [37:47<11:53:51,  1.45it/s]
  5%|▌         | 3377/65536 [37:48<11:52:36,  1.45it/s]
  5%|▌         | 3378/65536 [37:49<11:41:11,  1.48it/s]
  5%|▌         | 3379/65536 [37:49<11:48:22,  1.46it/s]
  5%|▌         | 3380/65536 [37:50<11:29:14,  1.50it/s]
                                                       
{'loss': 1.232, 'learning_rate': 9.561956654830414e-07, 'epoch': 208.64}

  5%|▌         | 3380/65536 [37:50<11:29:14,  1.50it/s]
  5%|▌         | 3381/65536 [37:51<11:30:45,  1.50it/s]
  5%|▌         | 3382/65536 [37:51<11:21:37,  1.52it/s]
  5%|▌         | 3383/65536 [37:52<11:22:28,  1.52it/s]
  5%|▌         | 3384/65536 [37:53<11:29:09,  1.50it/s]
  5%|▌         | 3385/65536 [37:53<11:21:12,  1.52it/s]
  5%|▌         | 3386/65536 [37:54<11:23:54,  1.51it/s]
  5%|▌         | 3387/65536 [37:55<11:38:36,  1.48it/s]
  5%|▌         | 3388/65536 [37:55<11:50:08,  1.46it/s]
  5%|▌         | 3389/65536 [37:56<11:44:51,  1.47it/s]
  5%|▌         | 3390/65536 [37:57<11:42:36,  1.47it/s]
  5%|▌         | 3391/65536 [37:57<11:30:40,  1.50it/s]
  5%|▌         | 3392/65536 [37:58<11:36:22,  1.49it/s]
  5%|▌         | 3393/65536 [37:59<11:52:45,  1.45it/s]
  5%|▌         | 3394/65536 [37:59<11:38:20,  1.48it/s]
  5%|▌         | 3395/65536 [38:00<11:37:24,  1.49it/s]
  5%|▌         | 3396/65536 [38:01<11:36:27,  1.49it/s]
  5%|▌         | 3397/65536 [38:01<11:26:27,  1.51it/s]
  5%|▌         | 3398/65536 [38:02<11:28:09,  1.50it/s]
  5%|▌         | 3399/65536 [38:03<11:35:58,  1.49it/s]
  5%|▌         | 3400/65536 [38:03<11:33:07,  1.49it/s]
                                                       
{'loss': 1.2274, 'learning_rate': 9.559201665238153e-07, 'epoch': 209.88}

  5%|▌         | 3400/65536 [38:03<11:33:07,  1.49it/s]
  5%|▌         | 3401/65536 [38:04<11:16:08,  1.53it/s]
  5%|▌         | 3402/65536 [38:05<11:13:35,  1.54it/s]
  5%|▌         | 3403/65536 [38:05<11:53:51,  1.45it/s]
  5%|▌         | 3404/65536 [38:06<11:42:29,  1.47it/s]
  5%|▌         | 3405/65536 [38:07<11:41:11,  1.48it/s]
  5%|▌         | 3406/65536 [38:07<11:31:54,  1.50it/s]
  5%|▌         | 3407/65536 [38:08<11:30:47,  1.50it/s]
  5%|▌         | 3408/65536 [38:09<11:23:48,  1.51it/s]
  5%|▌         | 3409/65536 [38:09<11:38:27,  1.48it/s]
  5%|▌         | 3410/65536 [38:10<11:34:59,  1.49it/s]
  5%|▌         | 3411/65536 [38:11<11:33:25,  1.49it/s]
  5%|▌         | 3412/65536 [38:11<11:23:40,  1.51it/s]
  5%|▌         | 3413/65536 [38:12<11:19:57,  1.52it/s]
  5%|▌         | 3414/65536 [38:13<11:12:46,  1.54it/s]
  5%|▌         | 3415/65536 [38:13<11:49:06,  1.46it/s]
  5%|▌         | 3416/65536 [38:14<11:34:41,  1.49it/s]
  5%|▌         | 3417/65536 [38:15<11:44:09,  1.47it/s]
  5%|▌         | 3418/65536 [38:15<11:39:27,  1.48it/s]
  5%|▌         | 3419/65536 [38:16<11:48:35,  1.46it/s]
  5%|▌         | 3420/65536 [38:17<11:49:51,  1.46it/s]
                                                       
{'loss': 1.2309, 'learning_rate': 9.556446675645891e-07, 'epoch': 211.11}

  5%|▌         | 3420/65536 [38:17<11:49:51,  1.46it/s]
  5%|▌         | 3421/65536 [38:18<11:50:20,  1.46it/s]
  5%|▌         | 3422/65536 [38:18<11:48:21,  1.46it/s]
  5%|▌         | 3423/65536 [38:19<11:42:17,  1.47it/s]
  5%|▌         | 3424/65536 [38:20<12:00:21,  1.44it/s]
  5%|▌         | 3425/65536 [38:20<11:50:19,  1.46it/s]
  5%|▌         | 3426/65536 [38:21<11:50:30,  1.46it/s]
  5%|▌         | 3427/65536 [38:22<11:43:21,  1.47it/s]
  5%|▌         | 3428/65536 [38:22<11:39:28,  1.48it/s]
  5%|▌         | 3429/65536 [38:23<11:32:09,  1.50it/s]
  5%|▌         | 3430/65536 [38:24<11:20:02,  1.52it/s]
  5%|▌         | 3431/65536 [38:24<11:24:40,  1.51it/s]
  5%|▌         | 3432/65536 [38:25<11:12:49,  1.54it/s]
  5%|▌         | 3433/65536 [38:26<11:16:17,  1.53it/s]
  5%|▌         | 3434/65536 [38:26<11:14:58,  1.53it/s]
  5%|▌         | 3435/65536 [38:27<11:35:10,  1.49it/s]
  5%|▌         | 3436/65536 [38:28<11:30:54,  1.50it/s]
  5%|▌         | 3437/65536 [38:28<11:26:31,  1.51it/s]
  5%|▌         | 3438/65536 [38:29<11:16:53,  1.53it/s]
  5%|▌         | 3439/65536 [38:30<11:20:00,  1.52it/s]
  5%|▌         | 3440/65536 [38:30<11:19:15,  1.52it/s]
                                                       
{'loss': 1.2307, 'learning_rate': 9.55369168605363e-07, 'epoch': 212.35}

  5%|▌         | 3440/65536 [38:30<11:19:15,  1.52it/s]
  5%|▌         | 3441/65536 [38:31<11:43:23,  1.47it/s]
  5%|▌         | 3442/65536 [38:32<11:19:45,  1.52it/s]
  5%|▌         | 3443/65536 [38:32<11:30:43,  1.50it/s]
  5%|▌         | 3444/65536 [38:33<11:23:55,  1.51it/s]
  5%|▌         | 3445/65536 [38:34<11:21:52,  1.52it/s]
  5%|▌         | 3446/65536 [38:34<11:10:13,  1.54it/s]
  5%|▌         | 3447/65536 [38:35<11:16:18,  1.53it/s]
  5%|▌         | 3448/65536 [38:36<11:35:46,  1.49it/s]
  5%|▌         | 3449/65536 [38:36<11:42:29,  1.47it/s]
  5%|▌         | 3450/65536 [38:37<11:38:20,  1.48it/s]
  5%|▌         | 3451/65536 [38:38<11:46:42,  1.46it/s]
  5%|▌         | 3452/65536 [38:38<11:31:59,  1.50it/s]
  5%|▌         | 3453/65536 [38:39<11:37:07,  1.48it/s]
  5%|▌         | 3454/65536 [38:40<11:26:58,  1.51it/s]
  5%|▌         | 3455/65536 [38:40<11:45:26,  1.47it/s]
  5%|▌         | 3456/65536 [38:41<12:05:48,  1.43it/s]
  5%|▌         | 3457/65536 [38:42<11:53:30,  1.45it/s]
  5%|▌         | 3458/65536 [38:42<11:36:56,  1.48it/s]
  5%|▌         | 3459/65536 [38:43<11:26:33,  1.51it/s]
  5%|▌         | 3460/65536 [38:44<11:15:53,  1.53it/s]
                                                       
{'loss': 1.2286, 'learning_rate': 9.550936696461368e-07, 'epoch': 213.58}

  5%|▌         | 3460/65536 [38:44<11:15:53,  1.53it/s]
  5%|▌         | 3461/65536 [38:44<11:17:00,  1.53it/s]
  5%|▌         | 3462/65536 [38:45<11:30:42,  1.50it/s]
  5%|▌         | 3463/65536 [38:46<11:31:12,  1.50it/s]
  5%|▌         | 3464/65536 [38:46<11:42:56,  1.47it/s]
  5%|▌         | 3465/65536 [38:47<11:29:27,  1.50it/s]
  5%|▌         | 3466/65536 [38:48<11:46:03,  1.47it/s]
  5%|▌         | 3467/65536 [38:48<12:00:31,  1.44it/s]
  5%|▌         | 3468/65536 [38:49<12:00:08,  1.44it/s]
  5%|▌         | 3469/65536 [38:50<12:23:22,  1.39it/s]
  5%|▌         | 3470/65536 [38:50<11:58:43,  1.44it/s]
  5%|▌         | 3471/65536 [38:51<11:47:35,  1.46it/s]
  5%|▌         | 3472/65536 [38:52<11:32:03,  1.49it/s]
  5%|▌         | 3473/65536 [38:52<11:29:40,  1.50it/s]
  5%|▌         | 3474/65536 [38:53<11:41:07,  1.48it/s]
  5%|▌         | 3475/65536 [38:54<11:54:34,  1.45it/s]
  5%|▌         | 3476/65536 [38:55<11:36:25,  1.49it/s]
  5%|▌         | 3477/65536 [38:55<11:41:19,  1.47it/s]
  5%|▌         | 3478/65536 [38:56<11:24:31,  1.51it/s]
  5%|▌         | 3479/65536 [38:57<11:36:15,  1.49it/s]
  5%|▌         | 3480/65536 [38:57<11:34:58,  1.49it/s]
                                                       
{'loss': 1.2097, 'learning_rate': 9.548181706869107e-07, 'epoch': 214.81}

  5%|▌         | 3480/65536 [38:57<11:34:58,  1.49it/s]
  5%|▌         | 3481/65536 [38:58<11:26:18,  1.51it/s]
  5%|▌         | 3482/65536 [38:58<11:13:03,  1.54it/s]
  5%|▌         | 3483/65536 [38:59<11:09:14,  1.55it/s]
  5%|▌         | 3484/65536 [39:00<11:39:46,  1.48it/s]
  5%|▌         | 3485/65536 [39:01<11:36:59,  1.48it/s]
  5%|▌         | 3486/65536 [39:01<11:15:58,  1.53it/s]
  5%|▌         | 3487/65536 [39:02<11:07:58,  1.55it/s]
  5%|▌         | 3488/65536 [39:02<11:11:32,  1.54it/s]
  5%|▌         | 3489/65536 [39:03<10:50:05,  1.59it/s]
  5%|▌         | 3490/65536 [39:04<11:01:43,  1.56it/s]
  5%|▌         | 3491/65536 [39:04<10:59:49,  1.57it/s]
  5%|▌         | 3492/65536 [39:05<11:17:05,  1.53it/s]
  5%|▌         | 3493/65536 [39:06<11:19:19,  1.52it/s]
  5%|▌         | 3494/65536 [39:06<11:33:04,  1.49it/s]
  5%|▌         | 3495/65536 [39:07<11:33:57,  1.49it/s]
  5%|▌         | 3496/65536 [39:08<11:23:48,  1.51it/s]
  5%|▌         | 3497/65536 [39:08<11:50:23,  1.46it/s]
  5%|▌         | 3498/65536 [39:09<11:55:11,  1.45it/s]
  5%|▌         | 3499/65536 [39:10<11:55:29,  1.45it/s]
  5%|▌         | 3500/65536 [39:10<12:02:14,  1.43it/s]
                                                       
{'loss': 1.2557, 'learning_rate': 9.545426717276845e-07, 'epoch': 216.05}

  5%|▌         | 3500/65536 [39:11<12:02:14,  1.43it/s]
  5%|▌         | 3501/65536 [39:11<12:03:13,  1.43it/s]
  5%|▌         | 3502/65536 [39:12<11:55:05,  1.45it/s]
  5%|▌         | 3503/65536 [39:13<12:01:39,  1.43it/s]
  5%|▌         | 3504/65536 [39:13<12:09:17,  1.42it/s]
  5%|▌         | 3505/65536 [39:14<12:09:45,  1.42it/s]
  5%|▌         | 3506/65536 [39:15<11:47:56,  1.46it/s]
  5%|▌         | 3507/65536 [39:15<11:41:19,  1.47it/s]
  5%|▌         | 3508/65536 [39:16<11:30:42,  1.50it/s]
  5%|▌         | 3509/65536 [39:17<11:39:28,  1.48it/s]
  5%|▌         | 3510/65536 [39:17<11:31:15,  1.50it/s]
  5%|▌         | 3511/65536 [39:18<11:19:17,  1.52it/s]
  5%|▌         | 3512/65536 [39:19<11:09:06,  1.54it/s]
  5%|▌         | 3513/65536 [39:19<11:27:21,  1.50it/s]
  5%|▌         | 3514/65536 [39:20<11:35:04,  1.49it/s]
  5%|▌         | 3515/65536 [39:21<11:18:24,  1.52it/s]
  5%|▌         | 3516/65536 [39:21<11:28:01,  1.50it/s]
  5%|▌         | 3517/65536 [39:22<11:43:54,  1.47it/s]
  5%|▌         | 3518/65536 [39:23<11:25:00,  1.51it/s]
  5%|▌         | 3519/65536 [39:23<11:31:51,  1.49it/s]
  5%|▌         | 3520/65536 [39:24<11:34:54,  1.49it/s]
                                                       
{'loss': 1.2113, 'learning_rate': 9.542671727684582e-07, 'epoch': 217.28}

  5%|▌         | 3520/65536 [39:24<11:34:54,  1.49it/s]
  5%|▌         | 3521/65536 [39:25<11:34:50,  1.49it/s]
  5%|▌         | 3522/65536 [39:25<11:22:59,  1.51it/s]
  5%|▌         | 3523/65536 [39:26<11:52:22,  1.45it/s]
  5%|▌         | 3524/65536 [39:27<11:44:31,  1.47it/s]
  5%|▌         | 3525/65536 [39:27<11:40:04,  1.48it/s]
  5%|▌         | 3526/65536 [39:28<11:56:23,  1.44it/s]
  5%|▌         | 3527/65536 [39:29<11:42:51,  1.47it/s]
  5%|▌         | 3528/65536 [39:29<11:39:18,  1.48it/s]
  5%|▌         | 3529/65536 [39:30<11:35:02,  1.49it/s]
  5%|▌         | 3530/65536 [39:31<11:38:15,  1.48it/s]
  5%|▌         | 3531/65536 [39:31<11:19:19,  1.52it/s]
  5%|▌         | 3532/65536 [39:32<11:34:02,  1.49it/s]
  5%|▌         | 3533/65536 [39:33<11:40:04,  1.48it/s]
  5%|▌         | 3534/65536 [39:33<11:19:12,  1.52it/s]
  5%|▌         | 3535/65536 [39:34<11:27:30,  1.50it/s]
  5%|▌         | 3536/65536 [39:35<11:25:38,  1.51it/s]
  5%|▌         | 3537/65536 [39:35<11:20:05,  1.52it/s]
  5%|▌         | 3538/65536 [39:36<11:26:57,  1.50it/s]
  5%|▌         | 3539/65536 [39:37<11:26:06,  1.51it/s]
  5%|▌         | 3540/65536 [39:37<11:18:12,  1.52it/s]
                                                       
{'loss': 1.2287, 'learning_rate': 9.539916738092323e-07, 'epoch': 218.52}

  5%|▌         | 3540/65536 [39:37<11:18:12,  1.52it/s]
  5%|▌         | 3541/65536 [39:38<11:31:49,  1.49it/s]
  5%|▌         | 3542/65536 [39:39<11:33:09,  1.49it/s]
  5%|▌         | 3543/65536 [39:39<11:37:52,  1.48it/s]
  5%|▌         | 3544/65536 [39:40<11:45:48,  1.46it/s]
  5%|▌         | 3545/65536 [39:41<11:42:53,  1.47it/s]
  5%|▌         | 3546/65536 [39:41<11:25:30,  1.51it/s]
  5%|▌         | 3547/65536 [39:42<11:20:39,  1.52it/s]
  5%|▌         | 3548/65536 [39:43<11:48:59,  1.46it/s]
  5%|▌         | 3549/65536 [39:43<11:45:39,  1.46it/s]
  5%|▌         | 3550/65536 [39:44<12:07:12,  1.42it/s]
  5%|▌         | 3551/65536 [39:45<12:00:17,  1.43it/s]
  5%|▌         | 3552/65536 [39:46<11:42:13,  1.47it/s]
  5%|▌         | 3553/65536 [39:46<11:34:56,  1.49it/s]
  5%|▌         | 3554/65536 [39:47<11:31:18,  1.49it/s]
  5%|▌         | 3555/65536 [39:48<11:43:41,  1.47it/s]
  5%|▌         | 3556/65536 [39:48<11:34:58,  1.49it/s]
  5%|▌         | 3557/65536 [39:49<11:30:00,  1.50it/s]
  5%|▌         | 3558/65536 [39:50<11:29:26,  1.50it/s]
  5%|▌         | 3559/65536 [39:50<11:11:13,  1.54it/s]
  5%|▌         | 3560/65536 [39:51<11:02:54,  1.56it/s]
                                                       
{'loss': 1.2305, 'learning_rate': 9.537161748500061e-07, 'epoch': 219.75}

  5%|▌         | 3560/65536 [39:51<11:02:54,  1.56it/s]
  5%|▌         | 3561/65536 [39:51<11:11:09,  1.54it/s]
  5%|▌         | 3562/65536 [39:52<11:23:59,  1.51it/s]
  5%|▌         | 3563/65536 [39:53<11:30:32,  1.50it/s]
  5%|▌         | 3564/65536 [39:53<11:27:31,  1.50it/s]
  5%|▌         | 3565/65536 [39:54<11:40:35,  1.47it/s]
  5%|▌         | 3566/65536 [39:55<11:41:34,  1.47it/s]
  5%|▌         | 3567/65536 [39:56<11:25:06,  1.51it/s]
  5%|▌         | 3568/65536 [39:56<11:26:54,  1.50it/s]
  5%|▌         | 3569/65536 [39:57<11:29:07,  1.50it/s]
  5%|▌         | 3570/65536 [39:57<11:13:38,  1.53it/s]
  5%|▌         | 3571/65536 [39:58<11:03:56,  1.56it/s]
  5%|▌         | 3572/65536 [39:59<11:10:00,  1.54it/s]
  5%|▌         | 3573/65536 [39:59<11:39:43,  1.48it/s]
  5%|▌         | 3574/65536 [40:00<11:58:42,  1.44it/s]
  5%|▌         | 3575/65536 [40:01<11:54:45,  1.44it/s]
  5%|▌         | 3576/65536 [40:02<12:03:20,  1.43it/s]
  5%|▌         | 3577/65536 [40:02<11:46:38,  1.46it/s]
  5%|▌         | 3578/65536 [40:03<11:42:34,  1.47it/s]
  5%|▌         | 3579/65536 [40:04<11:36:11,  1.48it/s]
  5%|▌         | 3580/65536 [40:04<11:14:27,  1.53it/s]
                                                       
{'loss': 1.2022, 'learning_rate': 9.5344067589078e-07, 'epoch': 220.99}

  5%|▌         | 3580/65536 [40:04<11:14:27,  1.53it/s]
  5%|▌         | 3581/65536 [40:05<11:42:44,  1.47it/s]
  5%|▌         | 3582/65536 [40:06<11:47:50,  1.46it/s]
  5%|▌         | 3583/65536 [40:06<11:37:41,  1.48it/s]
  5%|▌         | 3584/65536 [40:07<11:49:30,  1.46it/s]
  5%|▌         | 3585/65536 [40:08<11:44:45,  1.47it/s]
  5%|▌         | 3586/65536 [40:08<11:43:10,  1.47it/s]
  5%|▌         | 3587/65536 [40:09<11:20:07,  1.52it/s]
  5%|▌         | 3588/65536 [40:10<11:02:14,  1.56it/s]
  5%|▌         | 3589/65536 [40:10<11:07:11,  1.55it/s]
  5%|▌         | 3590/65536 [40:11<10:57:33,  1.57it/s]
  5%|▌         | 3591/65536 [40:12<11:04:02,  1.55it/s]
  5%|▌         | 3592/65536 [40:12<11:21:25,  1.52it/s]
  5%|▌         | 3593/65536 [40:13<11:06:40,  1.55it/s]
  5%|▌         | 3594/65536 [40:14<11:20:46,  1.52it/s]
  5%|▌         | 3595/65536 [40:14<11:41:20,  1.47it/s]
  5%|▌         | 3596/65536 [40:15<11:26:41,  1.50it/s]
  5%|▌         | 3597/65536 [40:16<11:24:59,  1.51it/s]
  5%|▌         | 3598/65536 [40:16<11:32:33,  1.49it/s]
  5%|▌         | 3599/65536 [40:17<11:28:46,  1.50it/s]
  5%|▌         | 3600/65536 [40:18<11:24:37,  1.51it/s]
                                                       
{'loss': 1.261, 'learning_rate': 9.531651769315538e-07, 'epoch': 222.22}

  5%|▌         | 3600/65536 [40:18<11:24:37,  1.51it/s]
  5%|▌         | 3601/65536 [40:18<11:31:32,  1.49it/s]
  5%|▌         | 3602/65536 [40:19<11:42:45,  1.47it/s]
  5%|▌         | 3603/65536 [40:20<11:40:26,  1.47it/s]
  5%|▌         | 3604/65536 [40:20<11:27:02,  1.50it/s]
  6%|▌         | 3605/65536 [40:21<11:23:54,  1.51it/s]
  6%|▌         | 3606/65536 [40:22<11:26:38,  1.50it/s]
  6%|▌         | 3607/65536 [40:22<11:34:52,  1.49it/s]
  6%|▌         | 3608/65536 [40:23<11:21:15,  1.52it/s]
  6%|▌         | 3609/65536 [40:23<11:07:44,  1.55it/s]
  6%|▌         | 3610/65536 [40:24<11:12:56,  1.53it/s]
  6%|▌         | 3611/65536 [40:25<11:08:08,  1.54it/s]
  6%|▌         | 3612/65536 [40:25<11:25:37,  1.51it/s]
  6%|▌         | 3613/65536 [40:26<11:37:18,  1.48it/s]
  6%|▌         | 3614/65536 [40:27<11:26:41,  1.50it/s]
  6%|▌         | 3615/65536 [40:28<11:25:34,  1.51it/s]
  6%|▌         | 3616/65536 [40:28<11:21:06,  1.52it/s]
  6%|▌         | 3617/65536 [40:29<11:41:07,  1.47it/s]
  6%|▌         | 3618/65536 [40:30<11:36:55,  1.48it/s]
  6%|▌         | 3619/65536 [40:30<11:33:26,  1.49it/s]
  6%|▌         | 3620/65536 [40:31<11:23:10,  1.51it/s]
                                                       
{'loss': 1.242, 'learning_rate': 9.528896779723277e-07, 'epoch': 223.46}

  6%|▌         | 3620/65536 [40:31<11:23:10,  1.51it/s]
  6%|▌         | 3621/65536 [40:31<11:19:27,  1.52it/s]
  6%|▌         | 3622/65536 [40:32<11:20:57,  1.52it/s]
  6%|▌         | 3623/65536 [40:33<11:06:10,  1.55it/s]
  6%|▌         | 3624/65536 [40:33<11:11:47,  1.54it/s]
  6%|▌         | 3625/65536 [40:34<11:16:25,  1.53it/s]
  6%|▌         | 3626/65536 [40:35<11:10:50,  1.54it/s]
  6%|▌         | 3627/65536 [40:35<11:20:17,  1.52it/s]
  6%|▌         | 3628/65536 [40:36<11:17:10,  1.52it/s]
  6%|▌         | 3629/65536 [40:37<11:51:22,  1.45it/s]
  6%|▌         | 3630/65536 [40:38<11:48:45,  1.46it/s]
  6%|▌         | 3631/65536 [40:38<11:24:14,  1.51it/s]
  6%|▌         | 3632/65536 [40:39<11:32:59,  1.49it/s]
  6%|▌         | 3633/65536 [40:39<11:18:58,  1.52it/s]
  6%|▌         | 3634/65536 [40:40<11:21:07,  1.51it/s]
  6%|▌         | 3635/65536 [40:41<11:14:19,  1.53it/s]
  6%|▌         | 3636/65536 [40:41<11:13:40,  1.53it/s]
  6%|▌         | 3637/65536 [40:42<11:21:28,  1.51it/s]
  6%|▌         | 3638/65536 [40:43<11:28:06,  1.50it/s]
  6%|▌         | 3639/65536 [40:43<11:23:00,  1.51it/s]
  6%|▌         | 3640/65536 [40:44<11:25:48,  1.50it/s]
                                                       
{'loss': 1.2483, 'learning_rate': 9.526141790131015e-07, 'epoch': 224.69}

  6%|▌         | 3640/65536 [40:44<11:25:48,  1.50it/s]
  6%|▌         | 3641/65536 [40:45<11:23:53,  1.51it/s]
  6%|▌         | 3642/65536 [40:45<11:51:40,  1.45it/s]
  6%|▌         | 3643/65536 [40:46<11:41:48,  1.47it/s]
  6%|▌         | 3644/65536 [40:47<11:41:41,  1.47it/s]
  6%|▌         | 3645/65536 [40:47<11:19:37,  1.52it/s]
  6%|▌         | 3646/65536 [40:48<11:26:32,  1.50it/s]
  6%|▌         | 3647/65536 [40:49<11:39:40,  1.47it/s]
  6%|▌         | 3648/65536 [40:50<11:42:58,  1.47it/s]
  6%|▌         | 3649/65536 [40:50<11:28:34,  1.50it/s]
  6%|▌         | 3650/65536 [40:51<11:25:14,  1.51it/s]
  6%|▌         | 3651/65536 [40:51<11:16:17,  1.53it/s]
  6%|▌         | 3652/65536 [40:52<11:29:15,  1.50it/s]
  6%|▌         | 3653/65536 [40:53<11:44:47,  1.46it/s]
  6%|▌         | 3654/65536 [40:54<11:39:16,  1.47it/s]
  6%|▌         | 3655/65536 [40:54<11:40:17,  1.47it/s]
  6%|▌         | 3656/65536 [40:55<11:38:13,  1.48it/s]
  6%|▌         | 3657/65536 [40:56<11:57:12,  1.44it/s]
  6%|▌         | 3658/65536 [40:56<11:33:14,  1.49it/s]
  6%|▌         | 3659/65536 [40:57<11:21:47,  1.51it/s]
  6%|▌         | 3660/65536 [40:58<11:32:24,  1.49it/s]
                                                       
{'loss': 1.2255, 'learning_rate': 9.523386800538753e-07, 'epoch': 225.93}

  6%|▌         | 3660/65536 [40:58<11:32:24,  1.49it/s]
  6%|▌         | 3661/65536 [40:58<11:09:27,  1.54it/s]
  6%|▌         | 3662/65536 [40:59<11:27:54,  1.50it/s]
  6%|▌         | 3663/65536 [41:00<11:36:26,  1.48it/s]
  6%|▌         | 3664/65536 [41:00<11:46:13,  1.46it/s]
  6%|▌         | 3665/65536 [41:01<11:31:42,  1.49it/s]
  6%|▌         | 3666/65536 [41:02<11:30:13,  1.49it/s]
  6%|▌         | 3667/65536 [41:02<11:50:56,  1.45it/s]
  6%|▌         | 3668/65536 [41:03<11:36:17,  1.48it/s]
  6%|▌         | 3669/65536 [41:04<11:28:35,  1.50it/s]
  6%|▌         | 3670/65536 [41:04<11:11:28,  1.54it/s]
  6%|▌         | 3671/65536 [41:05<11:37:25,  1.48it/s]
  6%|▌         | 3672/65536 [41:06<11:20:39,  1.51it/s]
  6%|▌         | 3673/65536 [41:06<11:16:43,  1.52it/s]
  6%|▌         | 3674/65536 [41:07<11:19:20,  1.52it/s]
  6%|▌         | 3675/65536 [41:08<11:26:07,  1.50it/s]
  6%|▌         | 3676/65536 [41:08<11:19:45,  1.52it/s]
  6%|▌         | 3677/65536 [41:09<11:40:44,  1.47it/s]
  6%|▌         | 3678/65536 [41:10<11:56:40,  1.44it/s]
  6%|▌         | 3679/65536 [41:10<11:43:51,  1.46it/s]
  6%|▌         | 3680/65536 [41:11<11:43:08,  1.47it/s]
                                                       
{'loss': 1.2058, 'learning_rate': 9.520631810946491e-07, 'epoch': 227.16}

  6%|▌         | 3680/65536 [41:11<11:43:08,  1.47it/s]
  6%|▌         | 3681/65536 [41:12<11:48:10,  1.46it/s]
  6%|▌         | 3682/65536 [41:12<11:33:01,  1.49it/s]
  6%|▌         | 3683/65536 [41:13<11:39:50,  1.47it/s]
  6%|▌         | 3684/65536 [41:14<11:32:09,  1.49it/s]
  6%|▌         | 3685/65536 [41:14<11:31:42,  1.49it/s]
  6%|▌         | 3686/65536 [41:15<11:49:11,  1.45it/s]
  6%|▌         | 3687/65536 [41:16<11:47:02,  1.46it/s]
  6%|▌         | 3688/65536 [41:16<11:41:04,  1.47it/s]
  6%|▌         | 3689/65536 [41:17<11:40:09,  1.47it/s]
  6%|▌         | 3690/65536 [41:18<11:27:40,  1.50it/s]
  6%|▌         | 3691/65536 [41:18<11:21:46,  1.51it/s]
  6%|▌         | 3692/65536 [41:19<11:30:07,  1.49it/s]
  6%|▌         | 3693/65536 [41:20<11:31:37,  1.49it/s]
  6%|▌         | 3694/65536 [41:20<11:34:21,  1.48it/s]
  6%|▌         | 3695/65536 [41:21<11:23:19,  1.51it/s]
  6%|▌         | 3696/65536 [41:22<11:31:51,  1.49it/s]
  6%|▌         | 3697/65536 [41:22<11:26:24,  1.50it/s]
  6%|▌         | 3698/65536 [41:23<11:31:21,  1.49it/s]
  6%|▌         | 3699/65536 [41:24<11:31:16,  1.49it/s]
  6%|▌         | 3700/65536 [41:24<11:30:09,  1.49it/s]
                                                       
{'loss': 1.2098, 'learning_rate': 9.51787682135423e-07, 'epoch': 228.4}

  6%|▌         | 3700/65536 [41:24<11:30:09,  1.49it/s]
  6%|▌         | 3701/65536 [41:25<11:30:05,  1.49it/s]
  6%|▌         | 3702/65536 [41:26<11:29:37,  1.49it/s]
  6%|▌         | 3703/65536 [41:27<11:44:43,  1.46it/s]
  6%|▌         | 3704/65536 [41:27<11:45:47,  1.46it/s]
  6%|▌         | 3705/65536 [41:28<11:36:15,  1.48it/s]
  6%|▌         | 3706/65536 [41:29<11:47:02,  1.46it/s]
  6%|▌         | 3707/65536 [41:29<11:39:49,  1.47it/s]
  6%|▌         | 3708/65536 [41:30<11:19:52,  1.52it/s]
  6%|▌         | 3709/65536 [41:31<11:28:42,  1.50it/s]
  6%|▌         | 3710/65536 [41:31<11:26:18,  1.50it/s]
  6%|▌         | 3711/65536 [41:32<11:26:18,  1.50it/s]
  6%|▌         | 3712/65536 [41:33<11:23:26,  1.51it/s]
  6%|▌         | 3713/65536 [41:33<11:43:14,  1.47it/s]
  6%|▌         | 3714/65536 [41:34<11:38:39,  1.47it/s]
  6%|▌         | 3715/65536 [41:35<11:36:19,  1.48it/s]
  6%|▌         | 3716/65536 [41:35<11:34:33,  1.48it/s]
  6%|▌         | 3717/65536 [41:36<11:40:09,  1.47it/s]
  6%|▌         | 3718/65536 [41:37<11:50:25,  1.45it/s]
  6%|▌         | 3719/65536 [41:37<11:56:41,  1.44it/s]
  6%|▌         | 3720/65536 [41:38<11:36:29,  1.48it/s]
                                                       
{'loss': 1.2034, 'learning_rate': 9.515121831761969e-07, 'epoch': 229.63}

  6%|▌         | 3720/65536 [41:38<11:36:29,  1.48it/s]
  6%|▌         | 3721/65536 [41:39<11:29:31,  1.49it/s]
  6%|▌         | 3722/65536 [41:39<11:20:20,  1.51it/s]
  6%|▌         | 3723/65536 [41:40<11:17:38,  1.52it/s]
  6%|▌         | 3724/65536 [41:41<11:24:36,  1.50it/s]
  6%|▌         | 3725/65536 [41:41<11:15:16,  1.53it/s]
  6%|▌         | 3726/65536 [41:42<11:01:39,  1.56it/s]
  6%|▌         | 3727/65536 [41:43<11:39:26,  1.47it/s]
  6%|▌         | 3728/65536 [41:43<11:46:56,  1.46it/s]
  6%|▌         | 3729/65536 [41:44<11:40:49,  1.47it/s]
  6%|▌         | 3730/65536 [41:45<11:49:23,  1.45it/s]
  6%|▌         | 3731/65536 [41:45<11:31:19,  1.49it/s]
  6%|▌         | 3732/65536 [41:46<11:14:08,  1.53it/s]
  6%|▌         | 3733/65536 [41:47<11:15:25,  1.53it/s]
  6%|▌         | 3734/65536 [41:47<11:16:07,  1.52it/s]
  6%|▌         | 3735/65536 [41:48<11:05:15,  1.55it/s]
  6%|▌         | 3736/65536 [41:49<11:10:01,  1.54it/s]
  6%|▌         | 3737/65536 [41:49<11:09:12,  1.54it/s]
  6%|▌         | 3738/65536 [41:50<11:17:47,  1.52it/s]
  6%|▌         | 3739/65536 [41:51<11:13:46,  1.53it/s]
  6%|▌         | 3740/65536 [41:51<11:16:08,  1.52it/s]
                                                       
{'loss': 1.2591, 'learning_rate': 9.512366842169707e-07, 'epoch': 230.86}

  6%|▌         | 3740/65536 [41:51<11:16:08,  1.52it/s]
  6%|▌         | 3741/65536 [41:52<11:13:45,  1.53it/s]
  6%|▌         | 3742/65536 [41:53<11:23:33,  1.51it/s]
  6%|▌         | 3743/65536 [41:53<11:45:31,  1.46it/s]
  6%|▌         | 3744/65536 [41:54<11:30:43,  1.49it/s]
  6%|▌         | 3745/65536 [41:55<11:47:00,  1.46it/s]
  6%|▌         | 3746/65536 [41:55<11:33:00,  1.49it/s]
  6%|▌         | 3747/65536 [41:56<11:41:34,  1.47it/s]
  6%|▌         | 3748/65536 [41:57<11:40:47,  1.47it/s]
  6%|▌         | 3749/65536 [41:57<11:28:19,  1.50it/s]
  6%|▌         | 3750/65536 [41:58<11:32:21,  1.49it/s]
  6%|▌         | 3751/65536 [41:59<11:39:58,  1.47it/s]
  6%|▌         | 3752/65536 [41:59<11:31:48,  1.49it/s]
  6%|▌         | 3753/65536 [42:00<11:29:14,  1.49it/s]
  6%|▌         | 3754/65536 [42:01<11:08:08,  1.54it/s]
  6%|▌         | 3755/65536 [42:01<11:32:19,  1.49it/s]
  6%|▌         | 3756/65536 [42:02<11:10:22,  1.54it/s]
  6%|▌         | 3757/65536 [42:02<10:56:46,  1.57it/s]
  6%|▌         | 3758/65536 [42:03<11:20:10,  1.51it/s]
  6%|▌         | 3759/65536 [42:04<11:21:26,  1.51it/s]
  6%|▌         | 3760/65536 [42:05<11:12:06,  1.53it/s]
                                                       
{'loss': 1.2274, 'learning_rate': 9.509611852577446e-07, 'epoch': 232.1}

  6%|▌         | 3760/65536 [42:05<11:12:06,  1.53it/s]
  6%|▌         | 3761/65536 [42:05<11:33:48,  1.48it/s]
  6%|▌         | 3762/65536 [42:06<11:29:12,  1.49it/s]
  6%|▌         | 3763/65536 [42:07<11:32:38,  1.49it/s]
  6%|▌         | 3764/65536 [42:07<11:35:32,  1.48it/s]
  6%|▌         | 3765/65536 [42:08<11:41:56,  1.47it/s]
  6%|▌         | 3766/65536 [42:09<11:25:46,  1.50it/s]
  6%|▌         | 3767/65536 [42:09<11:07:43,  1.54it/s]
  6%|▌         | 3768/65536 [42:10<11:23:56,  1.51it/s]
  6%|▌         | 3769/65536 [42:11<11:27:17,  1.50it/s]
  6%|▌         | 3770/65536 [42:11<11:43:51,  1.46it/s]
  6%|▌         | 3771/65536 [42:12<11:40:15,  1.47it/s]
  6%|▌         | 3772/65536 [42:13<11:43:20,  1.46it/s]
  6%|▌         | 3773/65536 [42:13<11:22:57,  1.51it/s]
  6%|▌         | 3774/65536 [42:14<11:07:43,  1.54it/s]
  6%|▌         | 3775/65536 [42:15<11:48:37,  1.45it/s]
  6%|▌         | 3776/65536 [42:15<11:55:53,  1.44it/s]
  6%|▌         | 3777/65536 [42:16<11:55:00,  1.44it/s]
  6%|▌         | 3778/65536 [42:17<11:21:03,  1.51it/s]
  6%|▌         | 3779/65536 [42:17<11:07:16,  1.54it/s]
  6%|▌         | 3780/65536 [42:18<11:29:32,  1.49it/s]
                                                       
{'loss': 1.1983, 'learning_rate': 9.506856862985184e-07, 'epoch': 233.33}

  6%|▌         | 3780/65536 [42:18<11:29:32,  1.49it/s]
  6%|▌         | 3781/65536 [42:19<11:29:07,  1.49it/s]
  6%|▌         | 3782/65536 [42:19<11:23:56,  1.50it/s]
  6%|▌         | 3783/65536 [42:20<11:42:46,  1.46it/s]
  6%|▌         | 3784/65536 [42:21<11:15:24,  1.52it/s]
  6%|▌         | 3785/65536 [42:21<11:16:03,  1.52it/s]
  6%|▌         | 3786/65536 [42:22<11:32:26,  1.49it/s]
  6%|▌         | 3787/65536 [42:23<11:40:39,  1.47it/s]
  6%|▌         | 3788/65536 [42:23<11:45:24,  1.46it/s]
  6%|▌         | 3789/65536 [42:24<11:36:31,  1.48it/s]
  6%|▌         | 3790/65536 [42:25<11:26:22,  1.50it/s]
  6%|▌         | 3791/65536 [42:25<11:29:00,  1.49it/s]
  6%|▌         | 3792/65536 [42:26<11:41:52,  1.47it/s]
  6%|▌         | 3793/65536 [42:27<11:25:48,  1.50it/s]
  6%|▌         | 3794/65536 [42:27<11:58:03,  1.43it/s]
  6%|▌         | 3795/65536 [42:28<11:48:33,  1.45it/s]
  6%|▌         | 3796/65536 [42:29<11:52:40,  1.44it/s]
  6%|▌         | 3797/65536 [42:30<11:47:51,  1.45it/s]
  6%|▌         | 3798/65536 [42:30<11:30:43,  1.49it/s]
  6%|▌         | 3799/65536 [42:31<11:16:54,  1.52it/s]
  6%|▌         | 3800/65536 [42:31<11:27:01,  1.50it/s]
                                                       
{'loss': 1.2091, 'learning_rate': 9.504101873392922e-07, 'epoch': 234.57}

  6%|▌         | 3800/65536 [42:31<11:27:01,  1.50it/s]
  6%|▌         | 3801/65536 [42:32<11:10:31,  1.53it/s]
  6%|▌         | 3802/65536 [42:33<11:15:20,  1.52it/s]
  6%|▌         | 3803/65536 [42:33<11:13:20,  1.53it/s]
  6%|▌         | 3804/65536 [42:34<11:30:36,  1.49it/s]
  6%|▌         | 3805/65536 [42:35<11:30:59,  1.49it/s]
  6%|▌         | 3806/65536 [42:35<11:34:19,  1.48it/s]
  6%|▌         | 3807/65536 [42:36<11:20:03,  1.51it/s]
  6%|▌         | 3808/65536 [42:37<11:35:20,  1.48it/s]
  6%|▌         | 3809/65536 [42:38<11:39:03,  1.47it/s]
  6%|▌         | 3810/65536 [42:38<11:15:18,  1.52it/s]
  6%|▌         | 3811/65536 [42:39<11:22:07,  1.51it/s]
  6%|▌         | 3812/65536 [42:39<11:05:14,  1.55it/s]
  6%|▌         | 3813/65536 [42:40<11:03:44,  1.55it/s]
  6%|▌         | 3814/65536 [42:41<11:10:14,  1.53it/s]
  6%|▌         | 3815/65536 [42:41<11:36:57,  1.48it/s]
  6%|▌         | 3816/65536 [42:42<11:27:37,  1.50it/s]
  6%|▌         | 3817/65536 [42:43<11:39:29,  1.47it/s]
  6%|▌         | 3818/65536 [42:43<11:43:31,  1.46it/s]
  6%|▌         | 3819/65536 [42:44<11:51:47,  1.45it/s]
  6%|▌         | 3820/65536 [42:45<11:35:04,  1.48it/s]
                                                       
{'loss': 1.2054, 'learning_rate': 9.501346883800661e-07, 'epoch': 235.8}

  6%|▌         | 3820/65536 [42:45<11:35:04,  1.48it/s]
  6%|▌         | 3821/65536 [42:45<11:21:47,  1.51it/s]
  6%|▌         | 3822/65536 [42:46<11:13:50,  1.53it/s]
  6%|▌         | 3823/65536 [42:47<11:27:56,  1.50it/s]
  6%|▌         | 3824/65536 [42:47<11:28:21,  1.49it/s]
  6%|▌         | 3825/65536 [42:48<11:33:12,  1.48it/s]
  6%|▌         | 3826/65536 [42:49<11:29:07,  1.49it/s]
  6%|▌         | 3827/65536 [42:49<11:12:01,  1.53it/s]
  6%|▌         | 3828/65536 [42:50<11:19:13,  1.51it/s]
  6%|▌         | 3829/65536 [42:51<11:24:00,  1.50it/s]
  6%|▌         | 3830/65536 [42:52<11:39:55,  1.47it/s]
  6%|▌         | 3831/65536 [42:52<11:46:08,  1.46it/s]
  6%|▌         | 3832/65536 [42:53<11:37:59,  1.47it/s]
  6%|▌         | 3833/65536 [42:54<11:37:14,  1.47it/s]
  6%|▌         | 3834/65536 [42:54<11:24:38,  1.50it/s]
  6%|▌         | 3835/65536 [42:55<11:37:18,  1.47it/s]
  6%|▌         | 3836/65536 [42:56<11:38:48,  1.47it/s]
  6%|▌         | 3837/65536 [42:56<11:51:28,  1.45it/s]
  6%|▌         | 3838/65536 [42:57<11:54:19,  1.44it/s]
  6%|▌         | 3839/65536 [42:58<11:37:45,  1.47it/s]
  6%|▌         | 3840/65536 [42:58<11:20:31,  1.51it/s]
                                                       
{'loss': 1.2212, 'learning_rate': 9.498591894208399e-07, 'epoch': 237.04}

  6%|▌         | 3840/65536 [42:58<11:20:31,  1.51it/s]
  6%|▌         | 3841/65536 [42:59<11:32:55,  1.48it/s]
  6%|▌         | 3842/65536 [43:00<11:31:55,  1.49it/s]
  6%|▌         | 3843/65536 [43:00<11:25:48,  1.50it/s]
  6%|▌         | 3844/65536 [43:01<11:27:12,  1.50it/s]
  6%|▌         | 3845/65536 [43:02<11:13:42,  1.53it/s]
  6%|▌         | 3846/65536 [43:02<11:23:49,  1.50it/s]
  6%|▌         | 3847/65536 [43:03<11:25:01,  1.50it/s]
  6%|▌         | 3848/65536 [43:04<11:25:57,  1.50it/s]
  6%|▌         | 3849/65536 [43:04<11:21:40,  1.51it/s]
  6%|▌         | 3850/65536 [43:05<11:26:17,  1.50it/s]
  6%|▌         | 3851/65536 [43:06<11:32:39,  1.48it/s]
  6%|▌         | 3852/65536 [43:06<11:42:02,  1.46it/s]
  6%|▌         | 3853/65536 [43:07<11:44:21,  1.46it/s]
  6%|▌         | 3854/65536 [43:08<11:24:04,  1.50it/s]
  6%|▌         | 3855/65536 [43:08<11:32:42,  1.48it/s]
  6%|▌         | 3856/65536 [43:09<11:53:18,  1.44it/s]
  6%|▌         | 3857/65536 [43:10<11:58:30,  1.43it/s]
  6%|▌         | 3858/65536 [43:10<11:45:07,  1.46it/s]
  6%|▌         | 3859/65536 [43:11<11:19:09,  1.51it/s]
  6%|▌         | 3860/65536 [43:12<11:14:25,  1.52it/s]
                                                       
{'loss': 1.1987, 'learning_rate': 9.495836904616138e-07, 'epoch': 238.27}

  6%|▌         | 3860/65536 [43:12<11:14:25,  1.52it/s]
  6%|▌         | 3861/65536 [43:12<11:31:13,  1.49it/s]
  6%|▌         | 3862/65536 [43:13<11:30:28,  1.49it/s]
  6%|▌         | 3863/65536 [43:14<11:26:09,  1.50it/s]
  6%|▌         | 3864/65536 [43:14<11:17:03,  1.52it/s]
  6%|▌         | 3865/65536 [43:15<11:33:03,  1.48it/s]
  6%|▌         | 3866/65536 [43:16<11:26:24,  1.50it/s]
  6%|▌         | 3867/65536 [43:16<11:28:54,  1.49it/s]
  6%|▌         | 3868/65536 [43:17<11:16:36,  1.52it/s]
  6%|▌         | 3869/65536 [43:18<11:06:21,  1.54it/s]
  6%|▌         | 3870/65536 [43:18<11:12:36,  1.53it/s]
  6%|▌         | 3871/65536 [43:19<11:23:31,  1.50it/s]
  6%|▌         | 3872/65536 [43:20<11:27:46,  1.49it/s]
  6%|▌         | 3873/65536 [43:20<11:16:08,  1.52it/s]
  6%|▌         | 3874/65536 [43:21<11:12:42,  1.53it/s]
  6%|▌         | 3875/65536 [43:22<11:12:12,  1.53it/s]
  6%|▌         | 3876/65536 [43:22<11:09:32,  1.53it/s]
  6%|▌         | 3877/65536 [43:23<11:56:11,  1.43it/s]
  6%|▌         | 3878/65536 [43:24<11:53:56,  1.44it/s]
  6%|▌         | 3879/65536 [43:24<11:41:24,  1.47it/s]
  6%|▌         | 3880/65536 [43:25<11:52:19,  1.44it/s]
                                                       
{'loss': 1.2065, 'learning_rate': 9.493081915023877e-07, 'epoch': 239.51}

  6%|▌         | 3880/65536 [43:25<11:52:19,  1.44it/s]
  6%|▌         | 3881/65536 [43:26<11:36:57,  1.47it/s]
  6%|▌         | 3882/65536 [43:26<11:14:44,  1.52it/s]
  6%|▌         | 3883/65536 [43:27<11:09:20,  1.54it/s]
  6%|▌         | 3884/65536 [43:28<11:40:40,  1.47it/s]
  6%|▌         | 3885/65536 [43:28<11:30:50,  1.49it/s]
  6%|▌         | 3886/65536 [43:29<11:41:17,  1.47it/s]
  6%|▌         | 3887/65536 [43:30<11:39:55,  1.47it/s]
  6%|▌         | 3888/65536 [43:30<11:18:52,  1.51it/s]
  6%|▌         | 3889/65536 [43:31<11:37:11,  1.47it/s]
  6%|▌         | 3890/65536 [43:32<11:23:51,  1.50it/s]
  6%|▌         | 3891/65536 [43:32<11:23:27,  1.50it/s]
  6%|▌         | 3892/65536 [43:33<11:40:50,  1.47it/s]
  6%|▌         | 3893/65536 [43:34<11:28:21,  1.49it/s]
  6%|▌         | 3894/65536 [43:35<11:57:38,  1.43it/s]
  6%|▌         | 3895/65536 [43:35<11:30:29,  1.49it/s]
  6%|▌         | 3896/65536 [43:36<11:15:11,  1.52it/s]
  6%|▌         | 3897/65536 [43:36<11:22:07,  1.51it/s]
  6%|▌         | 3898/65536 [43:37<11:16:41,  1.52it/s]
  6%|▌         | 3899/65536 [43:38<11:31:20,  1.49it/s]
  6%|▌         | 3900/65536 [43:38<11:17:33,  1.52it/s]
                                                       
{'loss': 1.2186, 'learning_rate': 9.490326925431615e-07, 'epoch': 240.74}

  6%|▌         | 3900/65536 [43:38<11:17:33,  1.52it/s]
  6%|▌         | 3901/65536 [43:39<11:18:35,  1.51it/s]
  6%|▌         | 3902/65536 [43:40<11:37:59,  1.47it/s]
  6%|▌         | 3903/65536 [43:41<11:29:51,  1.49it/s]
  6%|▌         | 3904/65536 [43:41<11:24:36,  1.50it/s]
  6%|▌         | 3905/65536 [43:42<11:47:15,  1.45it/s]
  6%|▌         | 3906/65536 [43:43<11:27:51,  1.49it/s]
  6%|▌         | 3907/65536 [43:43<11:17:57,  1.52it/s]
  6%|▌         | 3908/65536 [43:44<11:31:54,  1.48it/s]
  6%|▌         | 3909/65536 [43:45<11:42:47,  1.46it/s]
  6%|▌         | 3910/65536 [43:45<11:54:07,  1.44it/s]
  6%|▌         | 3911/65536 [43:46<11:36:15,  1.48it/s]
  6%|▌         | 3912/65536 [43:47<11:39:38,  1.47it/s]
  6%|▌         | 3913/65536 [43:47<11:38:54,  1.47it/s]
  6%|▌         | 3914/65536 [43:48<11:45:51,  1.46it/s]
  6%|▌         | 3915/65536 [43:49<11:24:00,  1.50it/s]
  6%|▌         | 3916/65536 [43:49<11:22:26,  1.50it/s]
  6%|▌         | 3917/65536 [43:50<11:21:35,  1.51it/s]
  6%|▌         | 3918/65536 [43:51<11:30:49,  1.49it/s]
  6%|▌         | 3919/65536 [43:51<11:25:11,  1.50it/s]
  6%|▌         | 3920/65536 [43:52<11:19:37,  1.51it/s]
                                                       
{'loss': 1.1802, 'learning_rate': 9.487571935839353e-07, 'epoch': 241.98}

  6%|▌         | 3920/65536 [43:52<11:19:37,  1.51it/s]
  6%|▌         | 3921/65536 [43:53<11:47:08,  1.45it/s]
  6%|▌         | 3922/65536 [43:53<11:39:01,  1.47it/s]
  6%|▌         | 3923/65536 [43:54<11:42:25,  1.46it/s]
  6%|▌         | 3924/65536 [43:55<11:47:29,  1.45it/s]
  6%|▌         | 3925/65536 [43:55<11:43:13,  1.46it/s]
  6%|▌         | 3926/65536 [43:56<11:46:45,  1.45it/s]
  6%|▌         | 3927/65536 [43:57<11:37:06,  1.47it/s]
  6%|▌         | 3928/65536 [43:57<11:42:17,  1.46it/s]
  6%|▌         | 3929/65536 [43:58<11:33:56,  1.48it/s]
  6%|▌         | 3930/65536 [43:59<11:22:34,  1.50it/s]
  6%|▌         | 3931/65536 [43:59<11:00:42,  1.55it/s]
  6%|▌         | 3932/65536 [44:00<11:08:09,  1.54it/s]
  6%|▌         | 3933/65536 [44:01<11:22:48,  1.50it/s]
  6%|▌         | 3934/65536 [44:01<11:15:25,  1.52it/s]
  6%|▌         | 3935/65536 [44:02<11:29:35,  1.49it/s]
  6%|▌         | 3936/65536 [44:03<11:31:36,  1.48it/s]
  6%|▌         | 3937/65536 [44:03<11:35:29,  1.48it/s]
  6%|▌         | 3938/65536 [44:04<11:18:56,  1.51it/s]
  6%|▌         | 3939/65536 [44:05<11:13:13,  1.52it/s]
  6%|▌         | 3940/65536 [44:05<11:11:49,  1.53it/s]
                                                       
{'loss': 1.1899, 'learning_rate': 9.484816946247091e-07, 'epoch': 243.21}

  6%|▌         | 3940/65536 [44:05<11:11:49,  1.53it/s]
  6%|▌         | 3941/65536 [44:06<11:13:19,  1.52it/s]
  6%|▌         | 3942/65536 [44:07<11:18:32,  1.51it/s]
  6%|▌         | 3943/65536 [44:07<11:22:28,  1.50it/s]
  6%|▌         | 3944/65536 [44:08<11:17:59,  1.51it/s]
  6%|▌         | 3945/65536 [44:09<11:48:11,  1.45it/s]
  6%|▌         | 3946/65536 [44:09<11:31:43,  1.48it/s]
  6%|▌         | 3947/65536 [44:10<11:20:11,  1.51it/s]
  6%|▌         | 3948/65536 [44:11<11:15:00,  1.52it/s]
  6%|▌         | 3949/65536 [44:11<11:12:26,  1.53it/s]
  6%|▌         | 3950/65536 [44:12<11:45:39,  1.45it/s]
  6%|▌         | 3951/65536 [44:13<11:38:03,  1.47it/s]
  6%|▌         | 3952/65536 [44:13<11:42:30,  1.46it/s]
  6%|▌         | 3953/65536 [44:14<11:41:00,  1.46it/s]
  6%|▌         | 3954/65536 [44:15<11:34:47,  1.48it/s]
  6%|▌         | 3955/65536 [44:15<11:19:52,  1.51it/s]
  6%|▌         | 3956/65536 [44:16<11:33:32,  1.48it/s]
  6%|▌         | 3957/65536 [44:17<11:25:16,  1.50it/s]
  6%|▌         | 3958/65536 [44:17<11:24:24,  1.50it/s]
  6%|▌         | 3959/65536 [44:18<11:36:21,  1.47it/s]
  6%|▌         | 3960/65536 [44:19<11:41:43,  1.46it/s]
                                                       
{'loss': 1.2157, 'learning_rate': 9.48206195665483e-07, 'epoch': 244.44}

  6%|▌         | 3960/65536 [44:19<11:41:43,  1.46it/s]
  6%|▌         | 3961/65536 [44:20<11:31:29,  1.48it/s]
  6%|▌         | 3962/65536 [44:20<11:13:38,  1.52it/s]
  6%|▌         | 3963/65536 [44:21<11:26:59,  1.49it/s]
  6%|▌         | 3964/65536 [44:21<11:17:31,  1.51it/s]
  6%|▌         | 3965/65536 [44:22<11:22:14,  1.50it/s]
  6%|▌         | 3966/65536 [44:23<11:28:09,  1.49it/s]
  6%|▌         | 3967/65536 [44:24<11:34:29,  1.48it/s]
  6%|▌         | 3968/65536 [44:24<11:33:48,  1.48it/s]
  6%|▌         | 3969/65536 [44:25<11:40:18,  1.47it/s]
  6%|▌         | 3970/65536 [44:26<11:54:06,  1.44it/s]
  6%|▌         | 3971/65536 [44:26<11:44:12,  1.46it/s]
  6%|▌         | 3972/65536 [44:27<11:38:43,  1.47it/s]
  6%|▌         | 3973/65536 [44:28<11:23:11,  1.50it/s]
  6%|▌         | 3974/65536 [44:28<11:20:12,  1.51it/s]
  6%|▌         | 3975/65536 [44:29<11:22:18,  1.50it/s]
  6%|▌         | 3976/65536 [44:29<10:55:51,  1.56it/s]
  6%|▌         | 3977/65536 [44:30<11:06:54,  1.54it/s]
  6%|▌         | 3978/65536 [44:31<11:13:57,  1.52it/s]
  6%|▌         | 3979/65536 [44:31<11:08:01,  1.54it/s]
  6%|▌         | 3980/65536 [44:32<11:24:58,  1.50it/s]
                                                       
{'loss': 1.2106, 'learning_rate': 9.479306967062568e-07, 'epoch': 245.68}

  6%|▌         | 3980/65536 [44:32<11:24:58,  1.50it/s]
  6%|▌         | 3981/65536 [44:33<11:21:58,  1.50it/s]
  6%|▌         | 3982/65536 [44:33<11:21:23,  1.51it/s]
  6%|▌         | 3983/65536 [44:34<11:33:15,  1.48it/s]
  6%|▌         | 3984/65536 [44:35<11:45:00,  1.46it/s]
  6%|▌         | 3985/65536 [44:36<11:47:26,  1.45it/s]
  6%|▌         | 3986/65536 [44:36<11:42:33,  1.46it/s]
  6%|▌         | 3987/65536 [44:37<11:41:33,  1.46it/s]
  6%|▌         | 3988/65536 [44:38<11:36:07,  1.47it/s]
  6%|▌         | 3989/65536 [44:38<11:36:23,  1.47it/s]
  6%|▌         | 3990/65536 [44:39<11:36:15,  1.47it/s]
  6%|▌         | 3991/65536 [44:40<11:39:45,  1.47it/s]
  6%|▌         | 3992/65536 [44:40<11:34:15,  1.48it/s]
  6%|▌         | 3993/65536 [44:41<11:25:23,  1.50it/s]
  6%|▌         | 3994/65536 [44:42<11:07:52,  1.54it/s]
  6%|▌         | 3995/65536 [44:42<11:16:06,  1.52it/s]
  6%|▌         | 3996/65536 [44:43<11:30:02,  1.49it/s]
  6%|▌         | 3997/65536 [44:44<11:33:06,  1.48it/s]
  6%|▌         | 3998/65536 [44:44<11:37:27,  1.47it/s]
  6%|▌         | 3999/65536 [44:45<11:49:35,  1.45it/s]
  6%|▌         | 4000/65536 [44:46<11:32:53,  1.48it/s]
                                                       
{'loss': 1.1798, 'learning_rate': 9.476551977470307e-07, 'epoch': 246.91}

  6%|▌         | 4000/65536 [44:46<11:32:53,  1.48it/s]
  6%|▌         | 4001/65536 [44:46<11:39:02,  1.47it/s]
  6%|▌         | 4002/65536 [44:47<11:40:01,  1.47it/s]
  6%|▌         | 4003/65536 [44:48<11:26:00,  1.49it/s]
  6%|▌         | 4004/65536 [44:48<11:39:51,  1.47it/s]
  6%|▌         | 4005/65536 [44:49<11:22:02,  1.50it/s]
  6%|▌         | 4006/65536 [44:50<11:13:50,  1.52it/s]
  6%|▌         | 4007/65536 [44:50<11:32:43,  1.48it/s]
  6%|▌         | 4008/65536 [44:51<11:27:47,  1.49it/s]
  6%|▌         | 4009/65536 [44:52<11:23:30,  1.50it/s]
  6%|▌         | 4010/65536 [44:52<11:20:40,  1.51it/s]
  6%|▌         | 4011/65536 [44:53<11:32:07,  1.48it/s]
  6%|▌         | 4012/65536 [44:54<11:22:43,  1.50it/s]
  6%|▌         | 4013/65536 [44:54<11:28:29,  1.49it/s]
  6%|▌         | 4014/65536 [44:55<11:24:06,  1.50it/s]
  6%|▌         | 4015/65536 [44:56<11:24:50,  1.50it/s]
  6%|▌         | 4016/65536 [44:56<11:39:05,  1.47it/s]
  6%|▌         | 4017/65536 [44:57<11:40:58,  1.46it/s]
  6%|▌         | 4018/65536 [44:58<11:49:19,  1.45it/s]
  6%|▌         | 4019/65536 [44:59<11:43:29,  1.46it/s]
  6%|▌         | 4020/65536 [44:59<11:45:38,  1.45it/s]
                                                       
{'loss': 1.1877, 'learning_rate': 9.473796987878046e-07, 'epoch': 248.15}

  6%|▌         | 4020/65536 [44:59<11:45:38,  1.45it/s]
  6%|▌         | 4021/65536 [45:00<11:37:56,  1.47it/s]
  6%|▌         | 4022/65536 [45:01<11:45:25,  1.45it/s]
  6%|▌         | 4023/65536 [45:01<11:32:37,  1.48it/s]
  6%|▌         | 4024/65536 [45:02<11:47:49,  1.45it/s]
  6%|▌         | 4025/65536 [45:03<11:49:01,  1.45it/s]
  6%|▌         | 4026/65536 [45:03<11:41:06,  1.46it/s]
  6%|▌         | 4027/65536 [45:04<11:32:57,  1.48it/s]
  6%|▌         | 4028/65536 [45:05<11:42:54,  1.46it/s]
  6%|▌         | 4029/65536 [45:05<11:35:10,  1.47it/s]
  6%|▌         | 4030/65536 [45:06<11:20:10,  1.51it/s]
  6%|▌         | 4031/65536 [45:07<11:15:14,  1.52it/s]
  6%|▌         | 4032/65536 [45:07<11:23:37,  1.50it/s]
  6%|▌         | 4033/65536 [45:08<11:20:03,  1.51it/s]
  6%|▌         | 4034/65536 [45:09<11:31:07,  1.48it/s]
  6%|▌         | 4035/65536 [45:09<11:15:43,  1.52it/s]
  6%|▌         | 4036/65536 [45:10<11:16:47,  1.51it/s]
  6%|▌         | 4037/65536 [45:11<11:08:22,  1.53it/s]
  6%|▌         | 4038/65536 [45:11<11:08:41,  1.53it/s]
  6%|▌         | 4039/65536 [45:12<11:35:35,  1.47it/s]
  6%|▌         | 4040/65536 [45:13<11:38:46,  1.47it/s]
                                                       
{'loss': 1.184, 'learning_rate': 9.471041998285784e-07, 'epoch': 249.38}

  6%|▌         | 4040/65536 [45:13<11:38:46,  1.47it/s]
  6%|▌         | 4041/65536 [45:13<12:00:08,  1.42it/s]
  6%|▌         | 4042/65536 [45:14<11:30:05,  1.49it/s]
  6%|▌         | 4043/65536 [45:15<11:27:54,  1.49it/s]
  6%|▌         | 4044/65536 [45:15<11:11:26,  1.53it/s]
  6%|▌         | 4045/65536 [45:16<11:10:13,  1.53it/s]
  6%|▌         | 4046/65536 [45:17<11:22:50,  1.50it/s]
  6%|▌         | 4047/65536 [45:17<11:42:43,  1.46it/s]
  6%|▌         | 4048/65536 [45:18<11:41:40,  1.46it/s]
  6%|▌         | 4049/65536 [45:19<11:39:27,  1.47it/s]
  6%|▌         | 4050/65536 [45:19<11:37:00,  1.47it/s]
  6%|▌         | 4051/65536 [45:20<11:58:18,  1.43it/s]
  6%|▌         | 4052/65536 [45:21<11:42:17,  1.46it/s]
  6%|▌         | 4053/65536 [45:21<11:30:43,  1.48it/s]
  6%|▌         | 4054/65536 [45:22<11:33:22,  1.48it/s]
  6%|▌         | 4055/65536 [45:23<11:40:06,  1.46it/s]
  6%|▌         | 4056/65536 [45:24<11:28:41,  1.49it/s]
  6%|▌         | 4057/65536 [45:24<11:35:52,  1.47it/s]
  6%|▌         | 4058/65536 [45:25<11:23:38,  1.50it/s]
  6%|▌         | 4059/65536 [45:25<11:09:56,  1.53it/s]
  6%|▌         | 4060/65536 [45:26<11:21:10,  1.50it/s]
                                                       
{'loss': 1.2056, 'learning_rate': 9.468287008693522e-07, 'epoch': 250.62}

  6%|▌         | 4060/65536 [45:26<11:21:10,  1.50it/s]
  6%|▌         | 4061/65536 [45:27<11:19:13,  1.51it/s]
  6%|▌         | 4062/65536 [45:27<11:14:06,  1.52it/s]
  6%|▌         | 4063/65536 [45:28<11:16:35,  1.51it/s]
  6%|▌         | 4064/65536 [45:29<11:07:56,  1.53it/s]
  6%|▌         | 4065/65536 [45:29<10:56:38,  1.56it/s]
  6%|▌         | 4066/65536 [45:30<11:15:57,  1.52it/s]
  6%|▌         | 4067/65536 [45:31<11:36:33,  1.47it/s]
  6%|▌         | 4068/65536 [45:32<11:45:20,  1.45it/s]
  6%|▌         | 4069/65536 [45:32<11:34:17,  1.48it/s]
  6%|▌         | 4070/65536 [45:33<11:23:36,  1.50it/s]
  6%|▌         | 4071/65536 [45:33<11:15:22,  1.52it/s]
  6%|▌         | 4072/65536 [45:34<11:18:34,  1.51it/s]
  6%|▌         | 4073/65536 [45:35<11:25:28,  1.49it/s]
  6%|▌         | 4074/65536 [45:35<11:32:32,  1.48it/s]
  6%|▌         | 4075/65536 [45:36<11:37:34,  1.47it/s]
  6%|▌         | 4076/65536 [45:37<11:39:38,  1.46it/s]
  6%|▌         | 4077/65536 [45:38<11:38:46,  1.47it/s]
  6%|▌         | 4078/65536 [45:38<11:39:52,  1.46it/s]
  6%|▌         | 4079/65536 [45:39<11:40:58,  1.46it/s]
  6%|▌         | 4080/65536 [45:40<11:39:38,  1.46it/s]
                                                       
{'loss': 1.1936, 'learning_rate': 9.46553201910126e-07, 'epoch': 251.85}

  6%|▌         | 4080/65536 [45:40<11:39:38,  1.46it/s]
  6%|▌         | 4081/65536 [45:40<11:29:16,  1.49it/s]
  6%|▌         | 4082/65536 [45:41<11:23:20,  1.50it/s]
  6%|▌         | 4083/65536 [45:42<11:36:49,  1.47it/s]
  6%|▌         | 4084/65536 [45:42<11:26:16,  1.49it/s]
  6%|▌         | 4085/65536 [45:43<11:17:19,  1.51it/s]
  6%|▌         | 4086/65536 [45:44<11:16:45,  1.51it/s]
  6%|▌         | 4087/65536 [45:44<11:21:07,  1.50it/s]
  6%|▌         | 4088/65536 [45:45<11:06:54,  1.54it/s]
  6%|▌         | 4089/65536 [45:46<11:11:53,  1.52it/s]
  6%|▌         | 4090/65536 [45:46<11:28:02,  1.49it/s]
  6%|▌         | 4091/65536 [45:47<11:42:14,  1.46it/s]
  6%|▌         | 4092/65536 [45:48<11:20:51,  1.50it/s]
  6%|▌         | 4093/65536 [45:48<11:32:11,  1.48it/s]
  6%|▌         | 4094/65536 [45:49<11:22:17,  1.50it/s]
  6%|▌         | 4095/65536 [45:50<11:45:39,  1.45it/s]
  6%|▋         | 4096/65536 [45:50<11:40:58,  1.46it/s]
  6%|▋         | 4097/65536 [45:51<11:38:52,  1.47it/s]
  6%|▋         | 4098/65536 [45:52<11:32:24,  1.48it/s]
  6%|▋         | 4099/65536 [45:52<11:39:05,  1.46it/s]
  6%|▋         | 4100/65536 [45:53<11:25:28,  1.49it/s]
                                                       
{'loss': 1.1872, 'learning_rate': 9.462777029508999e-07, 'epoch': 253.09}

  6%|▋         | 4100/65536 [45:53<11:25:28,  1.49it/s]
  6%|▋         | 4101/65536 [45:54<11:15:13,  1.52it/s]
  6%|▋         | 4102/65536 [45:54<11:17:27,  1.51it/s]
  6%|▋         | 4103/65536 [45:55<11:35:59,  1.47it/s]
  6%|▋         | 4104/65536 [45:56<11:38:31,  1.47it/s]
  6%|▋         | 4105/65536 [45:56<11:20:11,  1.51it/s]
  6%|▋         | 4106/65536 [45:57<11:19:50,  1.51it/s]
  6%|▋         | 4107/65536 [45:58<11:08:26,  1.53it/s]
  6%|▋         | 4108/65536 [45:58<11:19:32,  1.51it/s]
  6%|▋         | 4109/65536 [45:59<11:31:09,  1.48it/s]
  6%|▋         | 4110/65536 [46:00<11:49:09,  1.44it/s]
  6%|▋         | 4111/65536 [46:00<11:24:05,  1.50it/s]
  6%|▋         | 4112/65536 [46:01<11:12:41,  1.52it/s]
  6%|▋         | 4113/65536 [46:02<11:28:40,  1.49it/s]
  6%|▋         | 4114/65536 [46:02<11:31:54,  1.48it/s]
  6%|▋         | 4115/65536 [46:03<11:38:17,  1.47it/s]
  6%|▋         | 4116/65536 [46:04<11:46:45,  1.45it/s]
  6%|▋         | 4117/65536 [46:04<11:38:39,  1.47it/s]
  6%|▋         | 4118/65536 [46:05<11:24:41,  1.50it/s]
  6%|▋         | 4119/65536 [46:06<11:15:18,  1.52it/s]
  6%|▋         | 4120/65536 [46:06<11:18:06,  1.51it/s]
                                                       
{'loss': 1.2107, 'learning_rate': 9.460022039916737e-07, 'epoch': 254.32}

  6%|▋         | 4120/65536 [46:06<11:18:06,  1.51it/s]
  6%|▋         | 4121/65536 [46:07<11:14:07,  1.52it/s]
  6%|▋         | 4122/65536 [46:08<11:15:45,  1.51it/s]
  6%|▋         | 4123/65536 [46:08<11:31:23,  1.48it/s]
  6%|▋         | 4124/65536 [46:09<11:27:04,  1.49it/s]
  6%|▋         | 4125/65536 [46:10<11:17:18,  1.51it/s]
  6%|▋         | 4126/65536 [46:10<11:14:03,  1.52it/s]
  6%|▋         | 4127/65536 [46:11<11:14:51,  1.52it/s]
  6%|▋         | 4128/65536 [46:12<11:14:23,  1.52it/s]
  6%|▋         | 4129/65536 [46:12<11:18:43,  1.51it/s]
  6%|▋         | 4130/65536 [46:13<11:18:34,  1.51it/s]
  6%|▋         | 4131/65536 [46:14<11:33:59,  1.47it/s]
  6%|▋         | 4132/65536 [46:14<11:53:42,  1.43it/s]
  6%|▋         | 4133/65536 [46:15<11:48:34,  1.44it/s]
  6%|▋         | 4134/65536 [46:16<12:04:00,  1.41it/s]
  6%|▋         | 4135/65536 [46:17<11:40:49,  1.46it/s]
  6%|▋         | 4136/65536 [46:17<11:31:17,  1.48it/s]
  6%|▋         | 4137/65536 [46:18<11:32:24,  1.48it/s]
  6%|▋         | 4138/65536 [46:19<11:21:22,  1.50it/s]
  6%|▋         | 4139/65536 [46:19<10:53:45,  1.57it/s]
  6%|▋         | 4140/65536 [46:20<11:16:16,  1.51it/s]
                                                       
{'loss': 1.1871, 'learning_rate': 9.457267050324476e-07, 'epoch': 255.56}

  6%|▋         | 4140/65536 [46:20<11:16:16,  1.51it/s]
  6%|▋         | 4141/65536 [46:20<11:06:49,  1.53it/s]
  6%|▋         | 4142/65536 [46:21<10:58:15,  1.55it/s]
  6%|▋         | 4143/65536 [46:22<11:08:38,  1.53it/s]
  6%|▋         | 4144/65536 [46:22<11:07:18,  1.53it/s]
  6%|▋         | 4145/65536 [46:23<11:11:27,  1.52it/s]
  6%|▋         | 4146/65536 [46:24<11:16:27,  1.51it/s]
  6%|▋         | 4147/65536 [46:24<11:25:55,  1.49it/s]
  6%|▋         | 4148/65536 [46:25<11:45:52,  1.45it/s]
  6%|▋         | 4149/65536 [46:26<11:34:14,  1.47it/s]
  6%|▋         | 4150/65536 [46:26<11:31:30,  1.48it/s]
  6%|▋         | 4151/65536 [46:27<11:15:45,  1.51it/s]
  6%|▋         | 4152/65536 [46:28<11:01:57,  1.55it/s]
  6%|▋         | 4153/65536 [46:28<10:58:41,  1.55it/s]
  6%|▋         | 4154/65536 [46:29<10:46:41,  1.58it/s]
  6%|▋         | 4155/65536 [46:30<10:52:20,  1.57it/s]
  6%|▋         | 4156/65536 [46:30<11:03:12,  1.54it/s]
  6%|▋         | 4157/65536 [46:31<11:13:16,  1.52it/s]
  6%|▋         | 4158/65536 [46:32<11:08:03,  1.53it/s]
  6%|▋         | 4159/65536 [46:32<11:40:13,  1.46it/s]
  6%|▋         | 4160/65536 [46:33<11:31:19,  1.48it/s]
                                                       
{'loss': 1.2197, 'learning_rate': 9.454512060732215e-07, 'epoch': 256.79}

  6%|▋         | 4160/65536 [46:33<11:31:19,  1.48it/s]
  6%|▋         | 4161/65536 [46:34<11:29:45,  1.48it/s]
  6%|▋         | 4162/65536 [46:34<11:31:42,  1.48it/s]
  6%|▋         | 4163/65536 [46:35<11:40:33,  1.46it/s]
  6%|▋         | 4164/65536 [46:36<12:02:53,  1.41it/s]
  6%|▋         | 4165/65536 [46:36<11:42:45,  1.46it/s]
  6%|▋         | 4166/65536 [46:37<11:35:25,  1.47it/s]
  6%|▋         | 4167/65536 [46:38<11:39:46,  1.46it/s]
  6%|▋         | 4168/65536 [46:38<11:26:43,  1.49it/s]
  6%|▋         | 4169/65536 [46:39<11:20:47,  1.50it/s]
  6%|▋         | 4170/65536 [46:40<11:34:40,  1.47it/s]
  6%|▋         | 4171/65536 [46:40<11:29:26,  1.48it/s]
  6%|▋         | 4172/65536 [46:41<11:35:10,  1.47it/s]
  6%|▋         | 4173/65536 [46:42<11:35:16,  1.47it/s]
  6%|▋         | 4174/65536 [46:43<11:38:35,  1.46it/s]
  6%|▋         | 4175/65536 [46:43<11:25:56,  1.49it/s]
  6%|▋         | 4176/65536 [46:44<11:37:48,  1.47it/s]
  6%|▋         | 4177/65536 [46:45<11:29:32,  1.48it/s]
  6%|▋         | 4178/65536 [46:45<11:23:07,  1.50it/s]
  6%|▋         | 4179/65536 [46:46<11:20:49,  1.50it/s]
  6%|▋         | 4180/65536 [46:47<11:49:33,  1.44it/s]
                                                       
{'loss': 1.1786, 'learning_rate': 9.451757071139952e-07, 'epoch': 258.02}

  6%|▋         | 4180/65536 [46:47<11:49:33,  1.44it/s]
  6%|▋         | 4181/65536 [46:47<11:42:21,  1.46it/s]
  6%|▋         | 4182/65536 [46:48<11:19:28,  1.50it/s]
  6%|▋         | 4183/65536 [46:49<10:57:58,  1.55it/s]
  6%|▋         | 4184/65536 [46:49<11:07:46,  1.53it/s]
  6%|▋         | 4185/65536 [46:50<11:24:27,  1.49it/s]
  6%|▋         | 4186/65536 [46:51<11:19:57,  1.50it/s]
  6%|▋         | 4187/65536 [46:51<11:18:40,  1.51it/s]
  6%|▋         | 4188/65536 [46:52<11:22:34,  1.50it/s]
  6%|▋         | 4189/65536 [46:53<11:24:47,  1.49it/s]
  6%|▋         | 4190/65536 [46:53<11:13:04,  1.52it/s]
  6%|▋         | 4191/65536 [46:54<11:52:58,  1.43it/s]
  6%|▋         | 4192/65536 [46:55<11:48:59,  1.44it/s]
  6%|▋         | 4193/65536 [46:55<11:45:58,  1.45it/s]
  6%|▋         | 4194/65536 [46:56<11:34:14,  1.47it/s]
  6%|▋         | 4195/65536 [46:57<11:17:19,  1.51it/s]
  6%|▋         | 4196/65536 [46:57<11:33:10,  1.47it/s]
  6%|▋         | 4197/65536 [46:58<11:13:37,  1.52it/s]
  6%|▋         | 4198/65536 [46:59<11:37:19,  1.47it/s]
  6%|▋         | 4199/65536 [46:59<11:46:18,  1.45it/s]
  6%|▋         | 4200/65536 [47:00<11:58:41,  1.42it/s]
                                                       
{'loss': 1.1961, 'learning_rate': 9.449002081547691e-07, 'epoch': 259.26}

  6%|▋         | 4200/65536 [47:00<11:58:41,  1.42it/s]
  6%|▋         | 4201/65536 [47:01<11:47:44,  1.44it/s]
  6%|▋         | 4202/65536 [47:01<11:42:14,  1.46it/s]
  6%|▋         | 4203/65536 [47:02<11:27:44,  1.49it/s]
  6%|▋         | 4204/65536 [47:03<11:13:52,  1.52it/s]
  6%|▋         | 4205/65536 [47:03<10:55:57,  1.56it/s]
  6%|▋         | 4206/65536 [47:04<10:58:48,  1.55it/s]
  6%|▋         | 4207/65536 [47:05<11:07:56,  1.53it/s]
  6%|▋         | 4208/65536 [47:05<11:07:01,  1.53it/s]
  6%|▋         | 4209/65536 [47:06<11:10:07,  1.53it/s]
  6%|▋         | 4210/65536 [47:07<11:27:26,  1.49it/s]
  6%|▋         | 4211/65536 [47:07<11:22:45,  1.50it/s]
  6%|▋         | 4212/65536 [47:08<11:17:42,  1.51it/s]
  6%|▋         | 4213/65536 [47:09<11:30:58,  1.48it/s]
  6%|▋         | 4214/65536 [47:09<11:27:00,  1.49it/s]
  6%|▋         | 4215/65536 [47:10<11:29:46,  1.48it/s]
  6%|▋         | 4216/65536 [47:11<11:16:45,  1.51it/s]
  6%|▋         | 4217/65536 [47:11<11:19:51,  1.50it/s]
  6%|▋         | 4218/65536 [47:12<11:19:01,  1.51it/s]
  6%|▋         | 4219/65536 [47:13<11:27:49,  1.49it/s]
  6%|▋         | 4220/65536 [47:13<11:14:21,  1.52it/s]
                                                       
{'loss': 1.1862, 'learning_rate': 9.446247091955429e-07, 'epoch': 260.49}

  6%|▋         | 4220/65536 [47:13<11:14:21,  1.52it/s]
  6%|▋         | 4221/65536 [47:14<11:14:34,  1.51it/s]
  6%|▋         | 4222/65536 [47:15<11:26:51,  1.49it/s]
  6%|▋         | 4223/65536 [47:15<11:31:05,  1.48it/s]
  6%|▋         | 4224/65536 [47:16<11:16:31,  1.51it/s]
  6%|▋         | 4225/65536 [47:17<11:23:54,  1.49it/s]
  6%|▋         | 4226/65536 [47:17<11:33:33,  1.47it/s]
  6%|▋         | 4227/65536 [47:18<11:38:35,  1.46it/s]
  6%|▋         | 4228/65536 [47:19<11:24:28,  1.49it/s]
  6%|▋         | 4229/65536 [47:19<11:36:11,  1.47it/s]
  6%|▋         | 4230/65536 [47:20<11:28:55,  1.48it/s]
  6%|▋         | 4231/65536 [47:21<11:36:06,  1.47it/s]
  6%|▋         | 4232/65536 [47:22<11:49:05,  1.44it/s]
  6%|▋         | 4233/65536 [47:22<11:39:08,  1.46it/s]
  6%|▋         | 4234/65536 [47:23<11:22:56,  1.50it/s]
  6%|▋         | 4235/65536 [47:23<11:16:52,  1.51it/s]
  6%|▋         | 4236/65536 [47:24<11:12:45,  1.52it/s]
  6%|▋         | 4237/65536 [47:25<11:12:02,  1.52it/s]
  6%|▋         | 4238/65536 [47:25<11:06:19,  1.53it/s]
  6%|▋         | 4239/65536 [47:26<11:28:54,  1.48it/s]
  6%|▋         | 4240/65536 [47:27<11:37:43,  1.46it/s]
                                                       
{'loss': 1.1693, 'learning_rate': 9.443492102363168e-07, 'epoch': 261.73}

  6%|▋         | 4240/65536 [47:27<11:37:43,  1.46it/s]
  6%|▋         | 4241/65536 [47:28<11:49:14,  1.44it/s]
  6%|▋         | 4242/65536 [47:28<11:20:56,  1.50it/s]
  6%|▋         | 4243/65536 [47:29<11:16:35,  1.51it/s]
  6%|▋         | 4244/65536 [47:30<11:25:00,  1.49it/s]
  6%|▋         | 4245/65536 [47:30<11:26:12,  1.49it/s]
  6%|▋         | 4246/65536 [47:31<11:29:45,  1.48it/s]
  6%|▋         | 4247/65536 [47:32<11:21:35,  1.50it/s]
  6%|▋         | 4248/65536 [47:32<11:06:17,  1.53it/s]
  6%|▋         | 4249/65536 [47:33<11:08:30,  1.53it/s]
  6%|▋         | 4250/65536 [47:34<11:34:21,  1.47it/s]
  6%|▋         | 4251/65536 [47:34<11:30:58,  1.48it/s]
  6%|▋         | 4252/65536 [47:35<11:23:40,  1.49it/s]
  6%|▋         | 4253/65536 [47:36<11:35:24,  1.47it/s]
  6%|▋         | 4254/65536 [47:36<11:18:38,  1.51it/s]
  6%|▋         | 4255/65536 [47:37<11:07:18,  1.53it/s]
  6%|▋         | 4256/65536 [47:37<10:57:52,  1.55it/s]
  6%|▋         | 4257/65536 [47:38<11:07:43,  1.53it/s]
  6%|▋         | 4258/65536 [47:39<11:25:37,  1.49it/s]
  6%|▋         | 4259/65536 [47:40<11:25:35,  1.49it/s]
  7%|▋         | 4260/65536 [47:40<11:20:28,  1.50it/s]
                                                       
{'loss': 1.1966, 'learning_rate': 9.440737112770907e-07, 'epoch': 262.96}

  7%|▋         | 4260/65536 [47:40<11:20:28,  1.50it/s]
  7%|▋         | 4261/65536 [47:41<11:47:30,  1.44it/s]
  7%|▋         | 4262/65536 [47:42<11:54:22,  1.43it/s]
  7%|▋         | 4263/65536 [47:42<11:43:15,  1.45it/s]
  7%|▋         | 4264/65536 [47:43<11:33:46,  1.47it/s]
  7%|▋         | 4265/65536 [47:44<11:07:28,  1.53it/s]
  7%|▋         | 4266/65536 [47:44<11:16:16,  1.51it/s]
  7%|▋         | 4267/65536 [47:45<11:12:34,  1.52it/s]
  7%|▋         | 4268/65536 [47:46<11:27:22,  1.49it/s]
  7%|▋         | 4269/65536 [47:46<11:17:11,  1.51it/s]
  7%|▋         | 4270/65536 [47:47<11:19:48,  1.50it/s]
  7%|▋         | 4271/65536 [47:48<11:32:30,  1.47it/s]
  7%|▋         | 4272/65536 [47:48<11:19:12,  1.50it/s]
  7%|▋         | 4273/65536 [47:49<11:24:59,  1.49it/s]
  7%|▋         | 4274/65536 [47:50<11:41:07,  1.46it/s]
  7%|▋         | 4275/65536 [47:50<11:32:44,  1.47it/s]
  7%|▋         | 4276/65536 [47:51<11:29:45,  1.48it/s]
  7%|▋         | 4277/65536 [47:52<11:48:26,  1.44it/s]
  7%|▋         | 4278/65536 [47:52<11:43:48,  1.45it/s]
  7%|▋         | 4279/65536 [47:53<11:29:06,  1.48it/s]
  7%|▋         | 4280/65536 [47:54<11:21:58,  1.50it/s]
                                                       
{'loss': 1.1881, 'learning_rate': 9.437982123178645e-07, 'epoch': 264.2}

  7%|▋         | 4280/65536 [47:54<11:21:58,  1.50it/s]
  7%|▋         | 4281/65536 [47:54<11:17:58,  1.51it/s]
  7%|▋         | 4282/65536 [47:55<11:25:57,  1.49it/s]
  7%|▋         | 4283/65536 [47:56<11:14:49,  1.51it/s]
  7%|▋         | 4284/65536 [47:56<11:06:42,  1.53it/s]
  7%|▋         | 4285/65536 [47:57<11:16:47,  1.51it/s]
  7%|▋         | 4286/65536 [47:58<11:19:07,  1.50it/s]
  7%|▋         | 4287/65536 [47:58<11:24:37,  1.49it/s]
  7%|▋         | 4288/65536 [47:59<11:07:34,  1.53it/s]
  7%|▋         | 4289/65536 [48:00<11:04:44,  1.54it/s]
  7%|▋         | 4290/65536 [48:00<10:54:26,  1.56it/s]
  7%|▋         | 4291/65536 [48:01<11:03:41,  1.54it/s]
  7%|▋         | 4292/65536 [48:02<11:25:34,  1.49it/s]
  7%|▋         | 4293/65536 [48:02<11:34:27,  1.47it/s]
  7%|▋         | 4294/65536 [48:03<11:40:40,  1.46it/s]
  7%|▋         | 4295/65536 [48:04<11:22:44,  1.49it/s]
  7%|▋         | 4296/65536 [48:04<11:20:18,  1.50it/s]
  7%|▋         | 4297/65536 [48:05<11:17:41,  1.51it/s]
  7%|▋         | 4298/65536 [48:06<11:30:24,  1.48it/s]
  7%|▋         | 4299/65536 [48:06<11:49:46,  1.44it/s]
  7%|▋         | 4300/65536 [48:07<11:25:29,  1.49it/s]
                                                       
{'loss': 1.1858, 'learning_rate': 9.435227133586384e-07, 'epoch': 265.43}

  7%|▋         | 4300/65536 [48:07<11:25:29,  1.49it/s]
  7%|▋         | 4301/65536 [48:08<11:24:54,  1.49it/s]
  7%|▋         | 4302/65536 [48:08<11:25:00,  1.49it/s]
  7%|▋         | 4303/65536 [48:09<11:21:14,  1.50it/s]
  7%|▋         | 4304/65536 [48:10<11:51:51,  1.43it/s]
  7%|▋         | 4305/65536 [48:10<11:52:35,  1.43it/s]
  7%|▋         | 4306/65536 [48:11<11:43:57,  1.45it/s]
  7%|▋         | 4307/65536 [48:12<11:29:18,  1.48it/s]
  7%|▋         | 4308/65536 [48:12<11:17:52,  1.51it/s]
  7%|▋         | 4309/65536 [48:13<11:02:34,  1.54it/s]
  7%|▋         | 4310/65536 [48:14<11:27:45,  1.48it/s]
  7%|▋         | 4311/65536 [48:15<11:42:51,  1.45it/s]
  7%|▋         | 4312/65536 [48:15<11:31:11,  1.48it/s]
  7%|▋         | 4313/65536 [48:16<11:34:21,  1.47it/s]
  7%|▋         | 4314/65536 [48:17<11:29:51,  1.48it/s]
  7%|▋         | 4315/65536 [48:17<11:21:25,  1.50it/s]
  7%|▋         | 4316/65536 [48:18<11:12:06,  1.52it/s]
  7%|▋         | 4317/65536 [48:18<11:26:23,  1.49it/s]
  7%|▋         | 4318/65536 [48:19<11:15:47,  1.51it/s]
  7%|▋         | 4319/65536 [48:20<11:11:50,  1.52it/s]
  7%|▋         | 4320/65536 [48:20<11:01:36,  1.54it/s]
                                                       
{'loss': 1.1819, 'learning_rate': 9.432472143994122e-07, 'epoch': 266.67}

  7%|▋         | 4320/65536 [48:20<11:01:36,  1.54it/s]
  7%|▋         | 4321/65536 [48:21<11:05:44,  1.53it/s]
  7%|▋         | 4322/65536 [48:22<11:20:32,  1.50it/s]
  7%|▋         | 4323/65536 [48:22<10:59:06,  1.55it/s]
  7%|▋         | 4324/65536 [48:23<11:16:23,  1.51it/s]
  7%|▋         | 4325/65536 [48:24<11:25:22,  1.49it/s]
  7%|▋         | 4326/65536 [48:24<11:37:38,  1.46it/s]
  7%|▋         | 4327/65536 [48:25<11:29:01,  1.48it/s]
  7%|▋         | 4328/65536 [48:26<11:30:29,  1.48it/s]
  7%|▋         | 4329/65536 [48:26<11:29:17,  1.48it/s]
  7%|▋         | 4330/65536 [48:27<11:27:24,  1.48it/s]
  7%|▋         | 4331/65536 [48:28<11:46:34,  1.44it/s]
  7%|▋         | 4332/65536 [48:29<11:37:59,  1.46it/s]
  7%|▋         | 4333/65536 [48:29<11:31:17,  1.48it/s]
  7%|▋         | 4334/65536 [48:30<11:24:40,  1.49it/s]
  7%|▋         | 4335/65536 [48:31<11:27:03,  1.48it/s]
  7%|▋         | 4336/65536 [48:31<11:18:14,  1.50it/s]
  7%|▋         | 4337/65536 [48:32<10:58:19,  1.55it/s]
  7%|▋         | 4338/65536 [48:32<11:01:00,  1.54it/s]
  7%|▋         | 4339/65536 [48:33<11:26:13,  1.49it/s]
  7%|▋         | 4340/65536 [48:34<11:37:27,  1.46it/s]
                                                       
{'loss': 1.1901, 'learning_rate': 9.429717154401861e-07, 'epoch': 267.9}

  7%|▋         | 4340/65536 [48:34<11:37:27,  1.46it/s]
  7%|▋         | 4341/65536 [48:35<11:18:51,  1.50it/s]
  7%|▋         | 4342/65536 [48:35<11:33:03,  1.47it/s]
  7%|▋         | 4343/65536 [48:36<11:35:20,  1.47it/s]
  7%|▋         | 4344/65536 [48:37<11:20:36,  1.50it/s]
  7%|▋         | 4345/65536 [48:37<11:00:17,  1.54it/s]
  7%|▋         | 4346/65536 [48:38<11:21:10,  1.50it/s]
  7%|▋         | 4347/65536 [48:39<11:32:23,  1.47it/s]
  7%|▋         | 4348/65536 [48:39<11:37:42,  1.46it/s]
  7%|▋         | 4349/65536 [48:40<11:29:21,  1.48it/s]
  7%|▋         | 4350/65536 [48:41<11:33:20,  1.47it/s]
  7%|▋         | 4351/65536 [48:41<11:35:37,  1.47it/s]
  7%|▋         | 4352/65536 [48:42<11:14:45,  1.51it/s]
  7%|▋         | 4353/65536 [48:43<11:22:57,  1.49it/s]
  7%|▋         | 4354/65536 [48:43<11:19:15,  1.50it/s]
  7%|▋         | 4355/65536 [48:44<11:19:24,  1.50it/s]
  7%|▋         | 4356/65536 [48:45<10:57:09,  1.55it/s]
  7%|▋         | 4357/65536 [48:45<11:32:51,  1.47it/s]
  7%|▋         | 4358/65536 [48:46<11:26:55,  1.48it/s]
  7%|▋         | 4359/65536 [48:47<11:27:36,  1.48it/s]
  7%|▋         | 4360/65536 [48:47<11:16:50,  1.51it/s]
                                                       
{'loss': 1.1886, 'learning_rate': 9.4269621648096e-07, 'epoch': 269.14}

  7%|▋         | 4360/65536 [48:47<11:16:50,  1.51it/s]
  7%|▋         | 4361/65536 [48:48<11:32:20,  1.47it/s]
  7%|▋         | 4362/65536 [48:49<11:21:03,  1.50it/s]
  7%|▋         | 4363/65536 [48:49<11:04:59,  1.53it/s]
  7%|▋         | 4364/65536 [48:50<11:14:20,  1.51it/s]
  7%|▋         | 4365/65536 [48:51<11:08:54,  1.52it/s]
  7%|▋         | 4366/65536 [48:51<11:07:42,  1.53it/s]
  7%|▋         | 4367/65536 [48:52<11:24:22,  1.49it/s]
  7%|▋         | 4368/65536 [48:53<11:26:20,  1.49it/s]
  7%|▋         | 4369/65536 [48:53<11:38:24,  1.46it/s]
  7%|▋         | 4370/65536 [48:54<11:26:54,  1.48it/s]
  7%|▋         | 4371/65536 [48:55<11:35:04,  1.47it/s]
  7%|▋         | 4372/65536 [48:55<11:42:26,  1.45it/s]
  7%|▋         | 4373/65536 [48:56<11:53:09,  1.43it/s]
  7%|▋         | 4374/65536 [48:57<11:25:27,  1.49it/s]
  7%|▋         | 4375/65536 [48:57<11:37:33,  1.46it/s]
  7%|▋         | 4376/65536 [48:58<11:33:16,  1.47it/s]
  7%|▋         | 4377/65536 [48:59<11:19:21,  1.50it/s]
  7%|▋         | 4378/65536 [48:59<11:09:40,  1.52it/s]
  7%|▋         | 4379/65536 [49:00<11:03:58,  1.54it/s]
  7%|▋         | 4380/65536 [49:01<11:16:20,  1.51it/s]
                                                       
{'loss': 1.166, 'learning_rate': 9.424207175217338e-07, 'epoch': 270.37}

  7%|▋         | 4380/65536 [49:01<11:16:20,  1.51it/s]
  7%|▋         | 4381/65536 [49:01<11:32:31,  1.47it/s]
  7%|▋         | 4382/65536 [49:02<11:33:01,  1.47it/s]
  7%|▋         | 4383/65536 [49:03<11:44:58,  1.45it/s]
  7%|▋         | 4384/65536 [49:03<11:20:02,  1.50it/s]
  7%|▋         | 4385/65536 [49:04<11:13:39,  1.51it/s]
  7%|▋         | 4386/65536 [49:05<11:14:03,  1.51it/s]
  7%|▋         | 4387/65536 [49:05<11:31:09,  1.47it/s]
  7%|▋         | 4388/65536 [49:06<11:31:28,  1.47it/s]
  7%|▋         | 4389/65536 [49:07<11:21:33,  1.50it/s]
  7%|▋         | 4390/65536 [49:07<11:35:49,  1.46it/s]
  7%|▋         | 4391/65536 [49:08<11:42:34,  1.45it/s]
  7%|▋         | 4392/65536 [49:09<11:33:57,  1.47it/s]
  7%|▋         | 4393/65536 [49:10<11:35:23,  1.47it/s]
  7%|▋         | 4394/65536 [49:10<11:36:44,  1.46it/s]
  7%|▋         | 4395/65536 [49:11<11:11:27,  1.52it/s]
  7%|▋         | 4396/65536 [49:11<11:17:05,  1.50it/s]
  7%|▋         | 4397/65536 [49:12<11:05:22,  1.53it/s]
  7%|▋         | 4398/65536 [49:13<11:08:42,  1.52it/s]
  7%|▋         | 4399/65536 [49:13<10:58:02,  1.55it/s]
  7%|▋         | 4400/65536 [49:14<11:06:33,  1.53it/s]
                                                       
{'loss': 1.1708, 'learning_rate': 9.421452185625077e-07, 'epoch': 271.6}

  7%|▋         | 4400/65536 [49:14<11:06:33,  1.53it/s]
  7%|▋         | 4401/65536 [49:15<11:15:02,  1.51it/s]
  7%|▋         | 4402/65536 [49:15<11:24:16,  1.49it/s]
  7%|▋         | 4403/65536 [49:16<11:17:39,  1.50it/s]
  7%|▋         | 4404/65536 [49:17<11:05:12,  1.53it/s]
  7%|▋         | 4405/65536 [49:17<11:02:39,  1.54it/s]
  7%|▋         | 4406/65536 [49:18<11:24:49,  1.49it/s]
  7%|▋         | 4407/65536 [49:19<11:28:48,  1.48it/s]
  7%|▋         | 4408/65536 [49:19<11:19:35,  1.50it/s]
  7%|▋         | 4409/65536 [49:20<11:20:48,  1.50it/s]
  7%|▋         | 4410/65536 [49:21<11:13:43,  1.51it/s]
  7%|▋         | 4411/65536 [49:21<11:21:49,  1.49it/s]
  7%|▋         | 4412/65536 [49:22<11:21:01,  1.50it/s]
  7%|▋         | 4413/65536 [49:23<11:37:56,  1.46it/s]
  7%|▋         | 4414/65536 [49:24<11:44:23,  1.45it/s]
  7%|▋         | 4415/65536 [49:24<11:47:29,  1.44it/s]
  7%|▋         | 4416/65536 [49:25<11:43:18,  1.45it/s]
  7%|▋         | 4417/65536 [49:26<11:44:43,  1.45it/s]
  7%|▋         | 4418/65536 [49:26<11:41:29,  1.45it/s]
  7%|▋         | 4419/65536 [49:27<11:40:03,  1.46it/s]
  7%|▋         | 4420/65536 [49:28<11:18:12,  1.50it/s]
                                                       
{'loss': 1.2039, 'learning_rate': 9.418697196032815e-07, 'epoch': 272.84}

  7%|▋         | 4420/65536 [49:28<11:18:12,  1.50it/s]
  7%|▋         | 4421/65536 [49:28<11:08:07,  1.52it/s]
  7%|▋         | 4422/65536 [49:29<11:03:00,  1.54it/s]
  7%|▋         | 4423/65536 [49:30<11:27:40,  1.48it/s]
  7%|▋         | 4424/65536 [49:30<11:42:33,  1.45it/s]
  7%|▋         | 4425/65536 [49:31<11:28:38,  1.48it/s]
  7%|▋         | 4426/65536 [49:32<11:28:17,  1.48it/s]
  7%|▋         | 4427/65536 [49:32<11:32:14,  1.47it/s]
  7%|▋         | 4428/65536 [49:33<11:30:56,  1.47it/s]
  7%|▋         | 4429/65536 [49:34<11:44:50,  1.44it/s]
  7%|▋         | 4430/65536 [49:34<11:25:19,  1.49it/s]
  7%|▋         | 4431/65536 [49:35<11:17:02,  1.50it/s]
  7%|▋         | 4432/65536 [49:36<11:32:27,  1.47it/s]
  7%|▋         | 4433/65536 [49:36<11:15:49,  1.51it/s]
  7%|▋         | 4434/65536 [49:37<11:16:05,  1.51it/s]
  7%|▋         | 4435/65536 [49:38<11:23:30,  1.49it/s]
  7%|▋         | 4436/65536 [49:38<11:21:30,  1.49it/s]
  7%|▋         | 4437/65536 [49:39<11:09:56,  1.52it/s]
  7%|▋         | 4438/65536 [49:40<11:03:57,  1.53it/s]
  7%|▋         | 4439/65536 [49:40<11:21:54,  1.49it/s]
  7%|▋         | 4440/65536 [49:41<11:13:19,  1.51it/s]
                                                       
{'loss': 1.1779, 'learning_rate': 9.415942206440553e-07, 'epoch': 274.07}

  7%|▋         | 4440/65536 [49:41<11:13:19,  1.51it/s]
  7%|▋         | 4441/65536 [49:42<10:57:45,  1.55it/s]
  7%|▋         | 4442/65536 [49:42<10:54:14,  1.56it/s]
  7%|▋         | 4443/65536 [49:43<10:55:26,  1.55it/s]
  7%|▋         | 4444/65536 [49:44<11:02:04,  1.54it/s]
  7%|▋         | 4445/65536 [49:44<10:48:09,  1.57it/s]
  7%|▋         | 4446/65536 [49:45<11:15:41,  1.51it/s]
  7%|▋         | 4447/65536 [49:46<11:40:18,  1.45it/s]
  7%|▋         | 4448/65536 [49:46<11:25:54,  1.48it/s]
  7%|▋         | 4449/65536 [49:47<11:37:55,  1.46it/s]
  7%|▋         | 4450/65536 [49:48<11:38:19,  1.46it/s]
  7%|▋         | 4451/65536 [49:48<11:40:30,  1.45it/s]
  7%|▋         | 4452/65536 [49:49<11:28:18,  1.48it/s]
  7%|▋         | 4453/65536 [49:50<11:38:11,  1.46it/s]
  7%|▋         | 4454/65536 [49:50<11:30:32,  1.47it/s]
  7%|▋         | 4455/65536 [49:51<11:19:35,  1.50it/s]
  7%|▋         | 4456/65536 [49:52<11:20:53,  1.50it/s]
  7%|▋         | 4457/65536 [49:52<11:27:09,  1.48it/s]
  7%|▋         | 4458/65536 [49:53<11:32:08,  1.47it/s]
  7%|▋         | 4459/65536 [49:54<11:39:14,  1.46it/s]
  7%|▋         | 4460/65536 [49:54<11:37:19,  1.46it/s]
                                                       
{'loss': 1.1781, 'learning_rate': 9.413187216848291e-07, 'epoch': 275.31}

  7%|▋         | 4460/65536 [49:54<11:37:19,  1.46it/s]
  7%|▋         | 4461/65536 [49:55<11:36:02,  1.46it/s]
  7%|▋         | 4462/65536 [49:56<11:20:53,  1.49it/s]
  7%|▋         | 4463/65536 [49:56<11:35:49,  1.46it/s]
  7%|▋         | 4464/65536 [49:57<11:17:12,  1.50it/s]
  7%|▋         | 4465/65536 [49:58<11:22:31,  1.49it/s]
  7%|▋         | 4466/65536 [49:58<11:17:41,  1.50it/s]
  7%|▋         | 4467/65536 [49:59<11:28:06,  1.48it/s]
  7%|▋         | 4468/65536 [50:00<11:35:52,  1.46it/s]
  7%|▋         | 4469/65536 [50:00<11:27:56,  1.48it/s]
  7%|▋         | 4470/65536 [50:01<11:09:20,  1.52it/s]
  7%|▋         | 4471/65536 [50:02<11:17:04,  1.50it/s]
  7%|▋         | 4472/65536 [50:02<11:28:06,  1.48it/s]
  7%|▋         | 4473/65536 [50:03<11:35:46,  1.46it/s]
  7%|▋         | 4474/65536 [50:04<11:34:26,  1.47it/s]
  7%|▋         | 4475/65536 [50:05<11:31:48,  1.47it/s]
  7%|▋         | 4476/65536 [50:05<11:17:11,  1.50it/s]
  7%|▋         | 4477/65536 [50:06<11:31:28,  1.47it/s]
  7%|▋         | 4478/65536 [50:07<11:12:56,  1.51it/s]
  7%|▋         | 4479/65536 [50:07<11:18:07,  1.50it/s]
  7%|▋         | 4480/65536 [50:08<11:18:05,  1.50it/s]
                                                       
{'loss': 1.1795, 'learning_rate': 9.41043222725603e-07, 'epoch': 276.54}

  7%|▋         | 4480/65536 [50:08<11:18:05,  1.50it/s]
  7%|▋         | 4481/65536 [50:09<11:16:39,  1.50it/s]
  7%|▋         | 4482/65536 [50:09<11:09:18,  1.52it/s]
  7%|▋         | 4483/65536 [50:10<11:28:27,  1.48it/s]
  7%|▋         | 4484/65536 [50:11<11:28:05,  1.48it/s]
  7%|▋         | 4485/65536 [50:11<11:21:35,  1.49it/s]
  7%|▋         | 4486/65536 [50:12<11:05:42,  1.53it/s]
  7%|▋         | 4487/65536 [50:12<11:12:04,  1.51it/s]
  7%|▋         | 4488/65536 [50:13<11:26:34,  1.48it/s]
  7%|▋         | 4489/65536 [50:14<11:18:27,  1.50it/s]
  7%|▋         | 4490/65536 [50:14<11:07:30,  1.52it/s]
  7%|▋         | 4491/65536 [50:15<11:21:51,  1.49it/s]
  7%|▋         | 4492/65536 [50:16<11:25:12,  1.48it/s]
  7%|▋         | 4493/65536 [50:17<11:27:57,  1.48it/s]
  7%|▋         | 4494/65536 [50:17<11:22:29,  1.49it/s]
  7%|▋         | 4495/65536 [50:18<11:15:34,  1.51it/s]
  7%|▋         | 4496/65536 [50:19<11:29:42,  1.48it/s]
  7%|▋         | 4497/65536 [50:19<11:39:35,  1.45it/s]
  7%|▋         | 4498/65536 [50:20<11:30:12,  1.47it/s]
  7%|▋         | 4499/65536 [50:21<11:20:57,  1.49it/s]
  7%|▋         | 4500/65536 [50:21<11:07:13,  1.52it/s]
                                                       
{'loss': 1.1831, 'learning_rate': 9.407677237663769e-07, 'epoch': 277.78}

  7%|▋         | 4500/65536 [50:21<11:07:13,  1.52it/s]
  7%|▋         | 4501/65536 [50:22<11:38:19,  1.46it/s]
  7%|▋         | 4502/65536 [50:23<11:13:39,  1.51it/s]
  7%|▋         | 4503/65536 [50:23<11:15:30,  1.51it/s]
  7%|▋         | 4504/65536 [50:24<11:28:48,  1.48it/s]
  7%|▋         | 4505/65536 [50:25<11:20:53,  1.49it/s]
  7%|▋         | 4506/65536 [50:25<11:10:53,  1.52it/s]
  7%|▋         | 4507/65536 [50:26<11:21:36,  1.49it/s]
  7%|▋         | 4508/65536 [50:27<11:33:11,  1.47it/s]
  7%|▋         | 4509/65536 [50:27<11:20:42,  1.49it/s]
  7%|▋         | 4510/65536 [50:28<11:34:19,  1.46it/s]
  7%|▋         | 4511/65536 [50:29<11:27:44,  1.48it/s]
  7%|▋         | 4512/65536 [50:29<11:30:24,  1.47it/s]
  7%|▋         | 4513/65536 [50:30<11:33:05,  1.47it/s]
  7%|▋         | 4514/65536 [50:31<11:26:51,  1.48it/s]
  7%|▋         | 4515/65536 [50:31<11:33:17,  1.47it/s]
  7%|▋         | 4516/65536 [50:32<11:39:09,  1.45it/s]
  7%|▋         | 4517/65536 [50:33<11:34:27,  1.46it/s]
  7%|▋         | 4518/65536 [50:33<11:13:53,  1.51it/s]
  7%|▋         | 4519/65536 [50:34<11:03:56,  1.53it/s]
  7%|▋         | 4520/65536 [50:35<11:14:06,  1.51it/s]
                                                       
{'loss': 1.1832, 'learning_rate': 9.404922248071507e-07, 'epoch': 279.01}

  7%|▋         | 4520/65536 [50:35<11:14:06,  1.51it/s]
  7%|▋         | 4521/65536 [50:35<11:31:43,  1.47it/s]
  7%|▋         | 4522/65536 [50:36<11:20:51,  1.49it/s]
  7%|▋         | 4523/65536 [50:37<11:17:03,  1.50it/s]
  7%|▋         | 4524/65536 [50:37<11:09:43,  1.52it/s]
  7%|▋         | 4525/65536 [50:38<11:08:41,  1.52it/s]
  7%|▋         | 4526/65536 [50:39<11:00:57,  1.54it/s]
  7%|▋         | 4527/65536 [50:39<11:27:50,  1.48it/s]
  7%|▋         | 4528/65536 [50:40<11:09:54,  1.52it/s]
  7%|▋         | 4529/65536 [50:41<11:03:43,  1.53it/s]
  7%|▋         | 4530/65536 [50:41<11:10:25,  1.52it/s]
  7%|▋         | 4531/65536 [50:42<11:28:11,  1.48it/s]
  7%|▋         | 4532/65536 [50:43<11:29:48,  1.47it/s]
  7%|▋         | 4533/65536 [50:43<11:23:07,  1.49it/s]
  7%|▋         | 4534/65536 [50:44<11:29:06,  1.48it/s]
  7%|▋         | 4535/65536 [50:45<11:06:28,  1.53it/s]
  7%|▋         | 4536/65536 [50:45<11:29:53,  1.47it/s]
  7%|▋         | 4537/65536 [50:46<11:54:27,  1.42it/s]
  7%|▋         | 4538/65536 [50:47<11:43:42,  1.44it/s]
  7%|▋         | 4539/65536 [50:47<11:39:18,  1.45it/s]
  7%|▋         | 4540/65536 [50:48<11:30:11,  1.47it/s]
                                                       
{'loss': 1.1616, 'learning_rate': 9.402167258479246e-07, 'epoch': 280.25}

  7%|▋         | 4540/65536 [50:48<11:30:11,  1.47it/s]
  7%|▋         | 4541/65536 [50:49<11:27:25,  1.48it/s]
  7%|▋         | 4542/65536 [50:49<11:21:41,  1.49it/s]
  7%|▋         | 4543/65536 [50:50<11:10:34,  1.52it/s]
  7%|▋         | 4544/65536 [50:51<11:09:24,  1.52it/s]
  7%|▋         | 4545/65536 [50:51<11:08:49,  1.52it/s]
  7%|▋         | 4546/65536 [50:52<11:11:30,  1.51it/s]
  7%|▋         | 4547/65536 [50:53<11:05:57,  1.53it/s]
  7%|▋         | 4548/65536 [50:54<11:54:26,  1.42it/s]
  7%|▋         | 4549/65536 [50:54<11:47:40,  1.44it/s]
  7%|▋         | 4550/65536 [50:55<11:44:29,  1.44it/s]
  7%|▋         | 4551/65536 [50:56<11:20:45,  1.49it/s]
  7%|▋         | 4552/65536 [50:56<11:22:59,  1.49it/s]
  7%|▋         | 4553/65536 [50:57<11:36:34,  1.46it/s]
  7%|▋         | 4554/65536 [50:58<11:32:02,  1.47it/s]
  7%|▋         | 4555/65536 [50:58<11:24:18,  1.49it/s]
  7%|▋         | 4556/65536 [50:59<11:15:35,  1.50it/s]
  7%|▋         | 4557/65536 [51:00<11:15:39,  1.50it/s]
  7%|▋         | 4558/65536 [51:00<11:24:57,  1.48it/s]
  7%|▋         | 4559/65536 [51:01<11:41:54,  1.45it/s]
  7%|▋         | 4560/65536 [51:02<11:36:50,  1.46it/s]
                                                       
{'loss': 1.17, 'learning_rate': 9.399412268886984e-07, 'epoch': 281.48}

  7%|▋         | 4560/65536 [51:02<11:36:50,  1.46it/s]
  7%|▋         | 4561/65536 [51:02<11:37:18,  1.46it/s]
  7%|▋         | 4562/65536 [51:03<11:31:47,  1.47it/s]
  7%|▋         | 4563/65536 [51:04<11:39:04,  1.45it/s]
  7%|▋         | 4564/65536 [51:04<11:34:32,  1.46it/s]
  7%|▋         | 4565/65536 [51:05<11:28:30,  1.48it/s]
  7%|▋         | 4566/65536 [51:06<11:31:02,  1.47it/s]
  7%|▋         | 4567/65536 [51:06<11:20:11,  1.49it/s]
  7%|▋         | 4568/65536 [51:07<11:13:48,  1.51it/s]
  7%|▋         | 4569/65536 [51:08<11:40:27,  1.45it/s]
  7%|▋         | 4570/65536 [51:08<11:30:41,  1.47it/s]
  7%|▋         | 4571/65536 [51:09<11:39:14,  1.45it/s]
  7%|▋         | 4572/65536 [51:10<11:11:23,  1.51it/s]
  7%|▋         | 4573/65536 [51:10<11:17:29,  1.50it/s]
  7%|▋         | 4574/65536 [51:11<11:13:46,  1.51it/s]
  7%|▋         | 4575/65536 [51:12<11:10:51,  1.51it/s]
  7%|▋         | 4576/65536 [51:12<11:30:17,  1.47it/s]
  7%|▋         | 4577/65536 [51:13<11:43:25,  1.44it/s]
  7%|▋         | 4578/65536 [51:14<11:25:40,  1.48it/s]
  7%|▋         | 4579/65536 [51:14<11:18:53,  1.50it/s]
  7%|▋         | 4580/65536 [51:15<11:10:38,  1.51it/s]
                                                       
{'loss': 1.1648, 'learning_rate': 9.396657279294723e-07, 'epoch': 282.72}

  7%|▋         | 4580/65536 [51:15<11:10:38,  1.51it/s]
  7%|▋         | 4581/65536 [51:16<11:19:38,  1.49it/s]
  7%|▋         | 4582/65536 [51:16<11:27:42,  1.48it/s]
  7%|▋         | 4583/65536 [51:17<11:25:12,  1.48it/s]
  7%|▋         | 4584/65536 [51:18<11:18:03,  1.50it/s]
  7%|▋         | 4585/65536 [51:19<11:49:50,  1.43it/s]
  7%|▋         | 4586/65536 [51:19<11:40:15,  1.45it/s]
  7%|▋         | 4587/65536 [51:20<11:29:37,  1.47it/s]
  7%|▋         | 4588/65536 [51:21<11:20:30,  1.49it/s]
  7%|▋         | 4589/65536 [51:21<11:11:06,  1.51it/s]
  7%|▋         | 4590/65536 [51:22<11:14:30,  1.51it/s]
  7%|▋         | 4591/65536 [51:23<11:17:20,  1.50it/s]
  7%|▋         | 4592/65536 [51:23<11:31:19,  1.47it/s]
  7%|▋         | 4593/65536 [51:24<11:30:57,  1.47it/s]
  7%|▋         | 4594/65536 [51:25<11:15:13,  1.50it/s]
  7%|▋         | 4595/65536 [51:25<11:06:32,  1.52it/s]
  7%|▋         | 4596/65536 [51:26<11:04:49,  1.53it/s]
  7%|▋         | 4597/65536 [51:27<11:18:31,  1.50it/s]
  7%|▋         | 4598/65536 [51:27<11:13:11,  1.51it/s]
  7%|▋         | 4599/65536 [51:28<11:27:28,  1.48it/s]
  7%|▋         | 4600/65536 [51:29<11:15:17,  1.50it/s]
                                                       
{'loss': 1.1936, 'learning_rate': 9.39390228970246e-07, 'epoch': 283.95}

  7%|▋         | 4600/65536 [51:29<11:15:17,  1.50it/s]
  7%|▋         | 4601/65536 [51:29<11:28:38,  1.47it/s]
  7%|▋         | 4602/65536 [51:30<10:59:23,  1.54it/s]
  7%|▋         | 4603/65536 [51:31<11:10:21,  1.51it/s]
  7%|▋         | 4604/65536 [51:31<11:07:59,  1.52it/s]
  7%|▋         | 4605/65536 [51:32<11:07:50,  1.52it/s]
  7%|▋         | 4606/65536 [51:32<11:06:45,  1.52it/s]
  7%|▋         | 4607/65536 [51:33<11:09:03,  1.52it/s]
  7%|▋         | 4608/65536 [51:34<11:25:49,  1.48it/s]
  7%|▋         | 4609/65536 [51:35<11:38:36,  1.45it/s]
  7%|▋         | 4610/65536 [51:35<11:36:08,  1.46it/s]
  7%|▋         | 4611/65536 [51:36<11:55:48,  1.42it/s]
  7%|▋         | 4612/65536 [51:37<11:55:06,  1.42it/s]
  7%|▋         | 4613/65536 [51:37<11:45:11,  1.44it/s]
  7%|▋         | 4614/65536 [51:38<11:33:10,  1.46it/s]
  7%|▋         | 4615/65536 [51:39<11:23:34,  1.49it/s]
  7%|▋         | 4616/65536 [51:39<11:07:47,  1.52it/s]
  7%|▋         | 4617/65536 [51:40<11:01:31,  1.53it/s]
  7%|▋         | 4618/65536 [51:41<11:17:51,  1.50it/s]
  7%|▋         | 4619/65536 [51:41<11:27:59,  1.48it/s]
  7%|▋         | 4620/65536 [51:42<11:24:33,  1.48it/s]
                                                       
{'loss': 1.1803, 'learning_rate': 9.391147300110199e-07, 'epoch': 285.19}

  7%|▋         | 4620/65536 [51:42<11:24:33,  1.48it/s]
  7%|▋         | 4621/65536 [51:43<11:21:21,  1.49it/s]
  7%|▋         | 4622/65536 [51:43<11:42:33,  1.45it/s]
  7%|▋         | 4623/65536 [51:44<11:32:52,  1.47it/s]
  7%|▋         | 4624/65536 [51:45<11:36:59,  1.46it/s]
  7%|▋         | 4625/65536 [51:45<11:37:50,  1.45it/s]
  7%|▋         | 4626/65536 [51:46<11:17:37,  1.50it/s]
  7%|▋         | 4627/65536 [51:47<11:08:01,  1.52it/s]
  7%|▋         | 4628/65536 [51:47<10:58:49,  1.54it/s]
  7%|▋         | 4629/65536 [51:48<11:02:29,  1.53it/s]
  7%|▋         | 4630/65536 [51:49<11:13:10,  1.51it/s]
  7%|▋         | 4631/65536 [51:49<11:10:20,  1.51it/s]
  7%|▋         | 4632/65536 [51:50<11:35:23,  1.46it/s]
  7%|▋         | 4633/65536 [51:51<11:16:11,  1.50it/s]
  7%|▋         | 4634/65536 [51:51<11:30:16,  1.47it/s]
  7%|▋         | 4635/65536 [51:52<11:40:36,  1.45it/s]
  7%|▋         | 4636/65536 [51:53<11:26:07,  1.48it/s]
  7%|▋         | 4637/65536 [51:53<11:13:39,  1.51it/s]
  7%|▋         | 4638/65536 [51:54<11:04:35,  1.53it/s]
  7%|▋         | 4639/65536 [51:55<11:06:53,  1.52it/s]
  7%|▋         | 4640/65536 [51:55<11:16:45,  1.50it/s]
                                                       
{'loss': 1.1794, 'learning_rate': 9.388392310517938e-07, 'epoch': 286.42}

  7%|▋         | 4640/65536 [51:55<11:16:45,  1.50it/s]
  7%|▋         | 4641/65536 [51:56<11:10:10,  1.51it/s]
  7%|▋         | 4642/65536 [51:57<11:10:49,  1.51it/s]
  7%|▋         | 4643/65536 [51:57<11:00:33,  1.54it/s]
  7%|▋         | 4644/65536 [51:58<11:03:39,  1.53it/s]
  7%|▋         | 4645/65536 [51:59<11:07:14,  1.52it/s]
  7%|▋         | 4646/65536 [51:59<11:21:59,  1.49it/s]
  7%|▋         | 4647/65536 [52:00<11:33:04,  1.46it/s]
  7%|▋         | 4648/65536 [52:01<11:41:22,  1.45it/s]
  7%|▋         | 4649/65536 [52:01<11:33:10,  1.46it/s]
  7%|▋         | 4650/65536 [52:02<11:41:09,  1.45it/s]
  7%|▋         | 4651/65536 [52:03<11:37:06,  1.46it/s]
  7%|▋         | 4652/65536 [52:03<11:23:01,  1.49it/s]
  7%|▋         | 4653/65536 [52:04<11:14:33,  1.50it/s]
  7%|▋         | 4654/65536 [52:05<11:17:03,  1.50it/s]
  7%|▋         | 4655/65536 [52:05<11:13:09,  1.51it/s]
  7%|▋         | 4656/65536 [52:06<11:10:02,  1.51it/s]
  7%|▋         | 4657/65536 [52:07<11:08:14,  1.52it/s]
  7%|▋         | 4658/65536 [52:07<11:21:10,  1.49it/s]
  7%|▋         | 4659/65536 [52:08<11:45:55,  1.44it/s]
  7%|▋         | 4660/65536 [52:09<11:35:01,  1.46it/s]
                                                       
{'loss': 1.1656, 'learning_rate': 9.385637320925677e-07, 'epoch': 287.65}

  7%|▋         | 4660/65536 [52:09<11:35:01,  1.46it/s]
  7%|▋         | 4661/65536 [52:10<11:25:40,  1.48it/s]
  7%|▋         | 4662/65536 [52:10<11:27:33,  1.48it/s]
  7%|▋         | 4663/65536 [52:11<11:09:53,  1.51it/s]
  7%|▋         | 4664/65536 [52:12<11:09:08,  1.52it/s]
  7%|▋         | 4665/65536 [52:12<11:11:13,  1.51it/s]
  7%|▋         | 4666/65536 [52:13<11:46:33,  1.44it/s]
  7%|▋         | 4667/65536 [52:14<11:47:05,  1.43it/s]
  7%|▋         | 4668/65536 [52:14<11:34:12,  1.46it/s]
  7%|▋         | 4669/65536 [52:15<11:21:32,  1.49it/s]
  7%|▋         | 4670/65536 [52:16<11:23:05,  1.49it/s]
  7%|▋         | 4671/65536 [52:16<11:23:50,  1.48it/s]
  7%|▋         | 4672/65536 [52:17<11:16:03,  1.50it/s]
  7%|▋         | 4673/65536 [52:18<11:20:33,  1.49it/s]
  7%|▋         | 4674/65536 [52:18<11:19:14,  1.49it/s]
  7%|▋         | 4675/65536 [52:19<11:15:08,  1.50it/s]
  7%|▋         | 4676/65536 [52:20<10:54:11,  1.55it/s]
  7%|▋         | 4677/65536 [52:20<11:07:19,  1.52it/s]
  7%|▋         | 4678/65536 [52:21<11:18:00,  1.50it/s]
  7%|▋         | 4679/65536 [52:22<11:18:53,  1.49it/s]
  7%|▋         | 4680/65536 [52:22<11:26:46,  1.48it/s]
                                                       
{'loss': 1.1856, 'learning_rate': 9.382882331333415e-07, 'epoch': 288.89}

  7%|▋         | 4680/65536 [52:22<11:26:46,  1.48it/s]
  7%|▋         | 4681/65536 [52:23<11:31:11,  1.47it/s]
  7%|▋         | 4682/65536 [52:24<12:02:17,  1.40it/s]
  7%|▋         | 4683/65536 [52:24<11:39:06,  1.45it/s]
  7%|▋         | 4684/65536 [52:25<11:12:55,  1.51it/s]
  7%|▋         | 4685/65536 [52:26<11:06:56,  1.52it/s]
  7%|▋         | 4686/65536 [52:26<11:21:17,  1.49it/s]
  7%|▋         | 4687/65536 [52:27<11:22:04,  1.49it/s]
  7%|▋         | 4688/65536 [52:28<11:33:48,  1.46it/s]
  7%|▋         | 4689/65536 [52:28<11:33:35,  1.46it/s]
  7%|▋         | 4690/65536 [52:29<11:21:05,  1.49it/s]
  7%|▋         | 4691/65536 [52:30<11:19:36,  1.49it/s]
  7%|▋         | 4692/65536 [52:30<11:24:35,  1.48it/s]
  7%|▋         | 4693/65536 [52:31<11:20:11,  1.49it/s]
  7%|▋         | 4694/65536 [52:32<11:33:21,  1.46it/s]
  7%|▋         | 4695/65536 [52:32<11:19:51,  1.49it/s]
  7%|▋         | 4696/65536 [52:33<11:17:26,  1.50it/s]
  7%|▋         | 4697/65536 [52:34<11:28:17,  1.47it/s]
  7%|▋         | 4698/65536 [52:34<11:09:26,  1.51it/s]
  7%|▋         | 4699/65536 [52:35<11:15:32,  1.50it/s]
  7%|▋         | 4700/65536 [52:36<11:12:39,  1.51it/s]
                                                       
{'loss': 1.1767, 'learning_rate': 9.380127341741153e-07, 'epoch': 290.12}

  7%|▋         | 4700/65536 [52:36<11:12:39,  1.51it/s]
  7%|▋         | 4701/65536 [52:36<11:02:00,  1.53it/s]
  7%|▋         | 4702/65536 [52:37<11:00:15,  1.54it/s]
  7%|▋         | 4703/65536 [52:38<10:57:21,  1.54it/s]
  7%|▋         | 4704/65536 [52:38<11:10:49,  1.51it/s]
  7%|▋         | 4705/65536 [52:39<11:11:23,  1.51it/s]
  7%|▋         | 4706/65536 [52:40<11:18:18,  1.49it/s]
  7%|▋         | 4707/65536 [52:40<11:07:13,  1.52it/s]
  7%|▋         | 4708/65536 [52:41<10:57:12,  1.54it/s]
  7%|▋         | 4709/65536 [52:42<10:52:13,  1.55it/s]
  7%|▋         | 4710/65536 [52:42<11:14:39,  1.50it/s]
  7%|▋         | 4711/65536 [52:43<11:07:57,  1.52it/s]
  7%|▋         | 4712/65536 [52:44<11:22:03,  1.49it/s]
  7%|▋         | 4713/65536 [52:44<11:36:33,  1.46it/s]
  7%|▋         | 4714/65536 [52:45<11:31:11,  1.47it/s]
  7%|▋         | 4715/65536 [52:46<11:25:39,  1.48it/s]
  7%|▋         | 4716/65536 [52:46<11:33:29,  1.46it/s]
  7%|▋         | 4717/65536 [52:47<11:31:31,  1.47it/s]
  7%|▋         | 4718/65536 [52:48<11:39:27,  1.45it/s]
  7%|▋         | 4719/65536 [52:48<11:35:05,  1.46it/s]
  7%|▋         | 4720/65536 [52:49<11:28:21,  1.47it/s]
                                                       
{'loss': 1.1815, 'learning_rate': 9.377372352148891e-07, 'epoch': 291.36}

  7%|▋         | 4720/65536 [52:49<11:28:21,  1.47it/s]
  7%|▋         | 4721/65536 [52:50<11:25:27,  1.48it/s]
  7%|▋         | 4722/65536 [52:50<11:04:29,  1.53it/s]
  7%|▋         | 4723/65536 [52:51<10:51:52,  1.55it/s]
  7%|▋         | 4724/65536 [52:52<10:58:18,  1.54it/s]
  7%|▋         | 4725/65536 [52:52<11:23:15,  1.48it/s]
  7%|▋         | 4726/65536 [52:53<11:22:06,  1.49it/s]
  7%|▋         | 4727/65536 [52:54<11:18:54,  1.49it/s]
  7%|▋         | 4728/65536 [52:54<11:31:06,  1.47it/s]
  7%|▋         | 4729/65536 [52:55<11:42:48,  1.44it/s]
  7%|▋         | 4730/65536 [52:56<11:31:58,  1.46it/s]
  7%|▋         | 4731/65536 [52:57<11:31:39,  1.47it/s]
  7%|▋         | 4732/65536 [52:57<11:29:03,  1.47it/s]
  7%|▋         | 4733/65536 [52:58<11:28:19,  1.47it/s]
  7%|▋         | 4734/65536 [52:59<11:26:40,  1.48it/s]
  7%|▋         | 4735/65536 [52:59<11:17:24,  1.50it/s]
  7%|▋         | 4736/65536 [53:00<11:09:41,  1.51it/s]
  7%|▋         | 4737/65536 [53:01<11:26:18,  1.48it/s]
  7%|▋         | 4738/65536 [53:01<11:18:00,  1.49it/s]
  7%|▋         | 4739/65536 [53:02<11:20:28,  1.49it/s]
  7%|▋         | 4740/65536 [53:03<11:29:35,  1.47it/s]
                                                       
{'loss': 1.1586, 'learning_rate': 9.37461736255663e-07, 'epoch': 292.59}

  7%|▋         | 4740/65536 [53:03<11:29:35,  1.47it/s]
  7%|▋         | 4741/65536 [53:03<11:22:33,  1.48it/s]
  7%|▋         | 4742/65536 [53:04<11:25:34,  1.48it/s]
  7%|▋         | 4743/65536 [53:05<11:16:11,  1.50it/s]
  7%|▋         | 4744/65536 [53:05<11:00:36,  1.53it/s]
  7%|▋         | 4745/65536 [53:06<11:20:34,  1.49it/s]
  7%|▋         | 4746/65536 [53:07<11:39:52,  1.45it/s]
  7%|▋         | 4747/65536 [53:07<11:30:49,  1.47it/s]
  7%|▋         | 4748/65536 [53:08<11:36:09,  1.46it/s]
  7%|▋         | 4749/65536 [53:09<11:37:26,  1.45it/s]
  7%|▋         | 4750/65536 [53:09<11:36:34,  1.45it/s]
  7%|▋         | 4751/65536 [53:10<11:11:36,  1.51it/s]
  7%|▋         | 4752/65536 [53:11<11:08:21,  1.52it/s]
  7%|▋         | 4753/65536 [53:11<10:56:06,  1.54it/s]
  7%|▋         | 4754/65536 [53:12<11:07:38,  1.52it/s]
  7%|▋         | 4755/65536 [53:13<11:03:08,  1.53it/s]
  7%|▋         | 4756/65536 [53:13<11:16:56,  1.50it/s]
  7%|▋         | 4757/65536 [53:14<11:41:11,  1.44it/s]
  7%|▋         | 4758/65536 [53:15<11:51:21,  1.42it/s]
  7%|▋         | 4759/65536 [53:15<11:41:59,  1.44it/s]
  7%|▋         | 4760/65536 [53:16<11:14:37,  1.50it/s]
                                                       
{'loss': 1.1621, 'learning_rate': 9.371862372964368e-07, 'epoch': 293.83}

  7%|▋         | 4760/65536 [53:16<11:14:37,  1.50it/s]
  7%|▋         | 4761/65536 [53:17<11:28:43,  1.47it/s]
  7%|▋         | 4762/65536 [53:17<11:15:37,  1.50it/s]
  7%|▋         | 4763/65536 [53:18<11:23:19,  1.48it/s]
  7%|▋         | 4764/65536 [53:19<11:30:01,  1.47it/s]
  7%|▋         | 4765/65536 [53:19<11:24:14,  1.48it/s]
  7%|▋         | 4766/65536 [53:20<11:12:30,  1.51it/s]
  7%|▋         | 4767/65536 [53:21<11:10:52,  1.51it/s]
  7%|▋         | 4768/65536 [53:21<10:51:22,  1.55it/s]
  7%|▋         | 4769/65536 [53:22<11:09:31,  1.51it/s]
  7%|▋         | 4770/65536 [53:23<11:25:09,  1.48it/s]
  7%|▋         | 4771/65536 [53:23<11:24:00,  1.48it/s]
  7%|▋         | 4772/65536 [53:24<11:10:56,  1.51it/s]
  7%|▋         | 4773/65536 [53:25<11:02:44,  1.53it/s]
  7%|▋         | 4774/65536 [53:25<11:11:21,  1.51it/s]
  7%|▋         | 4775/65536 [53:26<11:23:46,  1.48it/s]
  7%|▋         | 4776/65536 [53:27<11:05:04,  1.52it/s]
  7%|▋         | 4777/65536 [53:27<11:16:27,  1.50it/s]
  7%|▋         | 4778/65536 [53:28<11:15:49,  1.50it/s]
  7%|▋         | 4779/65536 [53:29<11:37:48,  1.45it/s]
  7%|▋         | 4780/65536 [53:29<11:35:05,  1.46it/s]
                                                       
{'loss': 1.1824, 'learning_rate': 9.369107383372107e-07, 'epoch': 295.06}

  7%|▋         | 4780/65536 [53:29<11:35:05,  1.46it/s]
  7%|▋         | 4781/65536 [53:30<11:41:26,  1.44it/s]
  7%|▋         | 4782/65536 [53:31<11:30:10,  1.47it/s]
  7%|▋         | 4783/65536 [53:32<11:31:22,  1.46it/s]
  7%|▋         | 4784/65536 [53:32<11:10:06,  1.51it/s]
  7%|▋         | 4785/65536 [53:33<11:26:18,  1.48it/s]
  7%|▋         | 4786/65536 [53:34<11:18:13,  1.49it/s]
  7%|▋         | 4787/65536 [53:34<11:08:48,  1.51it/s]
  7%|▋         | 4788/65536 [53:35<11:00:58,  1.53it/s]
  7%|▋         | 4789/65536 [53:35<11:05:02,  1.52it/s]
  7%|▋         | 4790/65536 [53:36<11:18:57,  1.49it/s]
  7%|▋         | 4791/65536 [53:37<11:23:51,  1.48it/s]
  7%|▋         | 4792/65536 [53:38<11:18:30,  1.49it/s]
  7%|▋         | 4793/65536 [53:38<11:07:29,  1.52it/s]
  7%|▋         | 4794/65536 [53:39<11:21:36,  1.49it/s]
  7%|▋         | 4795/65536 [53:39<11:11:58,  1.51it/s]
  7%|▋         | 4796/65536 [53:40<11:15:35,  1.50it/s]
  7%|▋         | 4797/65536 [53:41<10:57:00,  1.54it/s]
  7%|▋         | 4798/65536 [53:41<11:00:54,  1.53it/s]
  7%|▋         | 4799/65536 [53:42<11:05:56,  1.52it/s]
  7%|▋         | 4800/65536 [53:43<11:03:46,  1.53it/s]
                                                       
{'loss': 1.1663, 'learning_rate': 9.366352393779845e-07, 'epoch': 296.3}

  7%|▋         | 4800/65536 [53:43<11:03:46,  1.53it/s]
  7%|▋         | 4801/65536 [53:43<11:14:51,  1.50it/s]
  7%|▋         | 4802/65536 [53:44<11:28:56,  1.47it/s]
  7%|▋         | 4803/65536 [53:45<11:19:34,  1.49it/s]
  7%|▋         | 4804/65536 [53:45<11:17:52,  1.49it/s]
  7%|▋         | 4805/65536 [53:46<11:11:31,  1.51it/s]
  7%|▋         | 4806/65536 [53:47<11:19:14,  1.49it/s]
  7%|▋         | 4807/65536 [53:47<11:20:08,  1.49it/s]
  7%|▋         | 4808/65536 [53:48<11:08:07,  1.51it/s]
  7%|▋         | 4809/65536 [53:49<11:34:37,  1.46it/s]
  7%|▋         | 4810/65536 [53:50<11:38:31,  1.45it/s]
  7%|▋         | 4811/65536 [53:50<11:10:20,  1.51it/s]
  7%|▋         | 4812/65536 [53:51<11:35:00,  1.46it/s]
  7%|▋         | 4813/65536 [53:52<11:40:16,  1.45it/s]
  7%|▋         | 4814/65536 [53:52<11:28:51,  1.47it/s]
  7%|▋         | 4815/65536 [53:53<11:17:48,  1.49it/s]
  7%|▋         | 4816/65536 [53:54<11:29:21,  1.47it/s]
  7%|▋         | 4817/65536 [53:54<11:48:51,  1.43it/s]
  7%|▋         | 4818/65536 [53:55<11:39:29,  1.45it/s]
  7%|▋         | 4819/65536 [53:56<11:33:08,  1.46it/s]
  7%|▋         | 4820/65536 [53:56<11:22:54,  1.48it/s]
                                                       
{'loss': 1.161, 'learning_rate': 9.363597404187584e-07, 'epoch': 297.53}

  7%|▋         | 4820/65536 [53:56<11:22:54,  1.48it/s]
  7%|▋         | 4821/65536 [53:57<11:21:52,  1.48it/s]
  7%|▋         | 4822/65536 [53:58<11:02:55,  1.53it/s]
  7%|▋         | 4823/65536 [53:58<11:16:03,  1.50it/s]
  7%|▋         | 4824/65536 [53:59<11:16:49,  1.50it/s]
  7%|▋         | 4825/65536 [54:00<11:07:26,  1.52it/s]
  7%|▋         | 4826/65536 [54:00<11:13:17,  1.50it/s]
  7%|▋         | 4827/65536 [54:01<11:09:10,  1.51it/s]
  7%|▋         | 4828/65536 [54:02<11:14:20,  1.50it/s]
  7%|▋         | 4829/65536 [54:02<11:06:30,  1.52it/s]
  7%|▋         | 4830/65536 [54:03<11:21:21,  1.48it/s]
  7%|▋         | 4831/65536 [54:04<11:27:46,  1.47it/s]
  7%|▋         | 4832/65536 [54:04<11:10:27,  1.51it/s]
  7%|▋         | 4833/65536 [54:05<11:09:18,  1.51it/s]
  7%|▋         | 4834/65536 [54:06<11:20:56,  1.49it/s]
  7%|▋         | 4835/65536 [54:06<11:37:11,  1.45it/s]
  7%|▋         | 4836/65536 [54:07<11:13:07,  1.50it/s]
  7%|▋         | 4837/65536 [54:08<11:27:08,  1.47it/s]
  7%|▋         | 4838/65536 [54:08<11:30:44,  1.46it/s]
  7%|▋         | 4839/65536 [54:09<11:22:09,  1.48it/s]
  7%|▋         | 4840/65536 [54:10<11:22:17,  1.48it/s]
                                                       
{'loss': 1.1499, 'learning_rate': 9.360842414595322e-07, 'epoch': 298.77}

  7%|▋         | 4840/65536 [54:10<11:22:17,  1.48it/s]
  7%|▋         | 4841/65536 [54:10<11:26:24,  1.47it/s]
  7%|▋         | 4842/65536 [54:11<11:15:06,  1.50it/s]
  7%|▋         | 4843/65536 [54:12<11:22:40,  1.48it/s]
  7%|▋         | 4844/65536 [54:12<11:28:56,  1.47it/s]
  7%|▋         | 4845/65536 [54:13<11:19:35,  1.49it/s]
  7%|▋         | 4846/65536 [54:14<11:09:10,  1.51it/s]
  7%|▋         | 4847/65536 [54:14<11:13:27,  1.50it/s]
  7%|▋         | 4848/65536 [54:15<11:07:58,  1.51it/s]
  7%|▋         | 4849/65536 [54:16<10:48:09,  1.56it/s]
  7%|▋         | 4850/65536 [54:16<10:55:22,  1.54it/s]
  7%|▋         | 4851/65536 [54:17<11:05:46,  1.52it/s]
  7%|▋         | 4852/65536 [54:18<11:15:48,  1.50it/s]
  7%|▋         | 4853/65536 [54:18<11:22:59,  1.48it/s]
  7%|▋         | 4854/65536 [54:19<11:29:50,  1.47it/s]
  7%|▋         | 4855/65536 [54:20<11:33:32,  1.46it/s]
  7%|▋         | 4856/65536 [54:20<11:22:11,  1.48it/s]
  7%|▋         | 4857/65536 [54:21<11:16:08,  1.50it/s]
  7%|▋         | 4858/65536 [54:22<11:18:12,  1.49it/s]
  7%|▋         | 4859/65536 [54:23<11:50:16,  1.42it/s]
  7%|▋         | 4860/65536 [54:23<11:31:18,  1.46it/s]
                                                       
{'loss': 1.1641, 'learning_rate': 9.35808742500306e-07, 'epoch': 300.0}

  7%|▋         | 4860/65536 [54:23<11:31:18,  1.46it/s]
  7%|▋         | 4861/65536 [54:24<12:06:13,  1.39it/s]
  7%|▋         | 4862/65536 [54:25<11:58:22,  1.41it/s]
  7%|▋         | 4863/65536 [54:25<12:02:41,  1.40it/s]
  7%|▋         | 4864/65536 [54:26<11:48:23,  1.43it/s]
  7%|▋         | 4865/65536 [54:27<11:40:19,  1.44it/s]
  7%|▋         | 4866/65536 [54:27<11:22:57,  1.48it/s]
  7%|▋         | 4867/65536 [54:28<11:12:16,  1.50it/s]
  7%|▋         | 4868/65536 [54:29<11:07:05,  1.52it/s]
  7%|▋         | 4869/65536 [54:29<11:11:11,  1.51it/s]
  7%|▋         | 4870/65536 [54:30<11:11:48,  1.51it/s]
  7%|▋         | 4871/65536 [54:31<11:09:53,  1.51it/s]
  7%|▋         | 4872/65536 [54:31<11:16:23,  1.49it/s]
  7%|▋         | 4873/65536 [54:32<11:24:25,  1.48it/s]
  7%|▋         | 4874/65536 [54:33<11:30:43,  1.46it/s]
  7%|▋         | 4875/65536 [54:33<11:11:04,  1.51it/s]
  7%|▋         | 4876/65536 [54:34<11:17:49,  1.49it/s]
  7%|▋         | 4877/65536 [54:35<11:38:45,  1.45it/s]
  7%|▋         | 4878/65536 [54:35<11:45:48,  1.43it/s]
  7%|▋         | 4879/65536 [54:36<12:03:26,  1.40it/s]
  7%|▋         | 4880/65536 [54:37<11:49:05,  1.43it/s]
                                                       
{'loss': 1.119, 'learning_rate': 9.355332435410799e-07, 'epoch': 301.23}

  7%|▋         | 4880/65536 [54:37<11:49:05,  1.43it/s]
  7%|▋         | 4881/65536 [54:38<11:23:04,  1.48it/s]
  7%|▋         | 4882/65536 [54:38<11:18:59,  1.49it/s]
  7%|▋         | 4883/65536 [54:39<11:06:34,  1.52it/s]
  7%|▋         | 4884/65536 [54:39<10:58:07,  1.54it/s]
  7%|▋         | 4885/65536 [54:40<10:57:46,  1.54it/s]
  7%|▋         | 4886/65536 [54:41<11:01:20,  1.53it/s]
  7%|▋         | 4887/65536 [54:41<11:06:55,  1.52it/s]
  7%|▋         | 4888/65536 [54:42<11:05:19,  1.52it/s]
  7%|▋         | 4889/65536 [54:43<11:11:13,  1.51it/s]
  7%|▋         | 4890/65536 [54:43<11:20:43,  1.48it/s]
  7%|▋         | 4891/65536 [54:44<11:11:19,  1.51it/s]
  7%|▋         | 4892/65536 [54:45<11:05:11,  1.52it/s]
  7%|▋         | 4893/65536 [54:45<11:23:05,  1.48it/s]
  7%|▋         | 4894/65536 [54:46<11:16:27,  1.49it/s]
  7%|▋         | 4895/65536 [54:47<11:09:47,  1.51it/s]
  7%|▋         | 4896/65536 [54:47<11:12:48,  1.50it/s]
  7%|▋         | 4897/65536 [54:48<11:17:19,  1.49it/s]
  7%|▋         | 4898/65536 [54:49<11:31:05,  1.46it/s]
  7%|▋         | 4899/65536 [54:49<11:20:13,  1.49it/s]
  7%|▋         | 4900/65536 [54:50<11:46:08,  1.43it/s]
                                                       
{'loss': 1.1643, 'learning_rate': 9.352577445818537e-07, 'epoch': 302.47}

  7%|▋         | 4900/65536 [54:50<11:46:08,  1.43it/s]
  7%|▋         | 4901/65536 [54:51<11:41:47,  1.44it/s]
  7%|▋         | 4902/65536 [54:52<11:21:24,  1.48it/s]
  7%|▋         | 4903/65536 [54:52<11:09:20,  1.51it/s]
  7%|▋         | 4904/65536 [54:53<11:10:41,  1.51it/s]
  7%|▋         | 4905/65536 [54:54<11:27:21,  1.47it/s]
  7%|▋         | 4906/65536 [54:54<11:15:45,  1.50it/s]
  7%|▋         | 4907/65536 [54:55<11:02:00,  1.53it/s]
  7%|▋         | 4908/65536 [54:55<10:53:25,  1.55it/s]
  7%|▋         | 4909/65536 [54:56<11:13:30,  1.50it/s]
  7%|▋         | 4910/65536 [54:57<11:16:43,  1.49it/s]
  7%|▋         | 4911/65536 [54:58<11:14:25,  1.50it/s]
  7%|▋         | 4912/65536 [54:58<11:02:09,  1.53it/s]
  7%|▋         | 4913/65536 [54:59<11:21:40,  1.48it/s]
  7%|▋         | 4914/65536 [55:00<11:25:31,  1.47it/s]
  7%|▋         | 4915/65536 [55:00<11:17:40,  1.49it/s]
  8%|▊         | 4916/65536 [55:01<11:00:01,  1.53it/s]
  8%|▊         | 4917/65536 [55:02<11:05:34,  1.52it/s]
  8%|▊         | 4918/65536 [55:02<10:57:26,  1.54it/s]
  8%|▊         | 4919/65536 [55:03<11:06:00,  1.52it/s]
  8%|▊         | 4920/65536 [55:04<11:19:40,  1.49it/s]
                                                       
{'loss': 1.1778, 'learning_rate': 9.349822456226276e-07, 'epoch': 303.7}

  8%|▊         | 4920/65536 [55:04<11:19:40,  1.49it/s]
  8%|▊         | 4921/65536 [55:04<11:10:29,  1.51it/s]
  8%|▊         | 4922/65536 [55:05<11:35:44,  1.45it/s]
  8%|▊         | 4923/65536 [55:06<11:34:38,  1.45it/s]
  8%|▊         | 4924/65536 [55:06<11:21:42,  1.48it/s]
  8%|▊         | 4925/65536 [55:07<11:37:15,  1.45it/s]
  8%|▊         | 4926/65536 [55:08<11:25:19,  1.47it/s]
  8%|▊         | 4927/65536 [55:08<11:20:58,  1.48it/s]
  8%|▊         | 4928/65536 [55:09<11:17:46,  1.49it/s]
  8%|▊         | 4929/65536 [55:10<11:50:16,  1.42it/s]
  8%|▊         | 4930/65536 [55:10<11:30:43,  1.46it/s]
  8%|▊         | 4931/65536 [55:11<11:22:56,  1.48it/s]
  8%|▊         | 4932/65536 [55:12<11:18:17,  1.49it/s]
  8%|▊         | 4933/65536 [55:12<11:19:57,  1.49it/s]
  8%|▊         | 4934/65536 [55:13<11:12:57,  1.50it/s]
  8%|▊         | 4935/65536 [55:14<11:18:16,  1.49it/s]
  8%|▊         | 4936/65536 [55:14<11:05:27,  1.52it/s]
  8%|▊         | 4937/65536 [55:15<11:21:36,  1.48it/s]
  8%|▊         | 4938/65536 [55:16<11:19:26,  1.49it/s]
  8%|▊         | 4939/65536 [55:16<11:08:22,  1.51it/s]
  8%|▊         | 4940/65536 [55:17<11:09:59,  1.51it/s]
                                                       
{'loss': 1.1507, 'learning_rate': 9.347067466634014e-07, 'epoch': 304.94}

  8%|▊         | 4940/65536 [55:17<11:09:59,  1.51it/s]
  8%|▊         | 4941/65536 [55:18<11:09:11,  1.51it/s]
  8%|▊         | 4942/65536 [55:18<11:32:16,  1.46it/s]
  8%|▊         | 4943/65536 [55:19<11:13:39,  1.50it/s]
  8%|▊         | 4944/65536 [55:20<11:08:44,  1.51it/s]
  8%|▊         | 4945/65536 [55:20<11:08:13,  1.51it/s]
  8%|▊         | 4946/65536 [55:21<11:30:18,  1.46it/s]
  8%|▊         | 4947/65536 [55:22<11:37:30,  1.45it/s]
  8%|▊         | 4948/65536 [55:22<11:38:27,  1.45it/s]
  8%|▊         | 4949/65536 [55:23<11:22:03,  1.48it/s]
  8%|▊         | 4950/65536 [55:24<11:18:25,  1.49it/s]
  8%|▊         | 4951/65536 [55:24<11:20:33,  1.48it/s]
  8%|▊         | 4952/65536 [55:25<11:22:30,  1.48it/s]
  8%|▊         | 4953/65536 [55:26<11:23:42,  1.48it/s]
  8%|▊         | 4954/65536 [55:26<11:18:41,  1.49it/s]
  8%|▊         | 4955/65536 [55:27<11:21:36,  1.48it/s]
  8%|▊         | 4956/65536 [55:28<11:17:10,  1.49it/s]
  8%|▊         | 4957/65536 [55:28<11:13:44,  1.50it/s]
  8%|▊         | 4958/65536 [55:29<11:43:34,  1.44it/s]
  8%|▊         | 4959/65536 [55:30<11:29:34,  1.46it/s]
  8%|▊         | 4960/65536 [55:31<11:23:12,  1.48it/s]
                                                       
{'loss': 1.1558, 'learning_rate': 9.344312477041753e-07, 'epoch': 306.17}

  8%|▊         | 4960/65536 [55:31<11:23:12,  1.48it/s]
  8%|▊         | 4961/65536 [55:31<11:23:51,  1.48it/s]
  8%|▊         | 4962/65536 [55:32<11:29:34,  1.46it/s]
  8%|▊         | 4963/65536 [55:33<11:39:22,  1.44it/s]
  8%|▊         | 4964/65536 [55:33<11:18:11,  1.49it/s]
  8%|▊         | 4965/65536 [55:34<11:01:26,  1.53it/s]
  8%|▊         | 4966/65536 [55:35<11:08:33,  1.51it/s]
  8%|▊         | 4967/65536 [55:35<11:10:43,  1.51it/s]
  8%|▊         | 4968/65536 [55:36<11:01:14,  1.53it/s]
  8%|▊         | 4969/65536 [55:37<11:13:24,  1.50it/s]
  8%|▊         | 4970/65536 [55:37<11:09:51,  1.51it/s]
  8%|▊         | 4971/65536 [55:38<11:09:52,  1.51it/s]
  8%|▊         | 4972/65536 [55:39<11:14:08,  1.50it/s]
  8%|▊         | 4973/65536 [55:39<11:09:10,  1.51it/s]
  8%|▊         | 4974/65536 [55:40<11:27:09,  1.47it/s]
  8%|▊         | 4975/65536 [55:41<11:12:20,  1.50it/s]
  8%|▊         | 4976/65536 [55:41<11:20:03,  1.48it/s]
  8%|▊         | 4977/65536 [55:42<11:33:12,  1.46it/s]
  8%|▊         | 4978/65536 [55:43<11:23:11,  1.48it/s]
  8%|▊         | 4979/65536 [55:43<11:15:15,  1.49it/s]
  8%|▊         | 4980/65536 [55:44<11:18:44,  1.49it/s]
                                                       
{'loss': 1.166, 'learning_rate': 9.34155748744949e-07, 'epoch': 307.41}

  8%|▊         | 4980/65536 [55:44<11:18:44,  1.49it/s]
  8%|▊         | 4981/65536 [55:45<11:13:45,  1.50it/s]
  8%|▊         | 4982/65536 [55:45<11:23:45,  1.48it/s]
  8%|▊         | 4983/65536 [55:46<11:09:31,  1.51it/s]
  8%|▊         | 4984/65536 [55:47<11:09:08,  1.51it/s]
  8%|▊         | 4985/65536 [55:47<11:02:11,  1.52it/s]
  8%|▊         | 4986/65536 [55:48<11:06:36,  1.51it/s]
  8%|▊         | 4987/65536 [55:49<10:45:18,  1.56it/s]
  8%|▊         | 4988/65536 [55:49<11:07:34,  1.51it/s]
  8%|▊         | 4989/65536 [55:50<11:05:42,  1.52it/s]
  8%|▊         | 4990/65536 [55:51<11:23:20,  1.48it/s]
  8%|▊         | 4991/65536 [55:51<11:39:19,  1.44it/s]
  8%|▊         | 4992/65536 [55:52<11:33:02,  1.46it/s]
  8%|▊         | 4993/65536 [55:53<11:23:17,  1.48it/s]
  8%|▊         | 4994/65536 [55:53<11:18:20,  1.49it/s]
  8%|▊         | 4995/65536 [55:54<11:16:46,  1.49it/s]
  8%|▊         | 4996/65536 [55:55<11:13:16,  1.50it/s]
  8%|▊         | 4997/65536 [55:55<11:10:05,  1.51it/s]
  8%|▊         | 4998/65536 [55:56<10:53:37,  1.54it/s]
  8%|▊         | 4999/65536 [55:57<10:55:29,  1.54it/s]
  8%|▊         | 5000/65536 [55:57<11:23:24,  1.48it/s]
                                                       
{'loss': 1.1631, 'learning_rate': 9.338802497857229e-07, 'epoch': 308.64}

  8%|▊         | 5000/65536 [55:57<11:23:24,  1.48it/s]
  8%|▊         | 5001/65536 [55:58<11:14:49,  1.50it/s]
  8%|▊         | 5002/65536 [55:59<10:54:33,  1.54it/s]
  8%|▊         | 5003/65536 [55:59<10:54:34,  1.54it/s]
  8%|▊         | 5004/65536 [56:00<11:04:06,  1.52it/s]
  8%|▊         | 5005/65536 [56:01<11:14:46,  1.50it/s]
  8%|▊         | 5006/65536 [56:01<11:21:23,  1.48it/s]
  8%|▊         | 5007/65536 [56:02<11:22:57,  1.48it/s]
  8%|▊         | 5008/65536 [56:03<11:28:40,  1.46it/s]
  8%|▊         | 5009/65536 [56:03<11:34:14,  1.45it/s]
  8%|▊         | 5010/65536 [56:04<11:22:16,  1.48it/s]
  8%|▊         | 5011/65536 [56:05<11:14:51,  1.49it/s]
  8%|▊         | 5012/65536 [56:05<11:21:16,  1.48it/s]
  8%|▊         | 5013/65536 [56:06<11:13:21,  1.50it/s]
  8%|▊         | 5014/65536 [56:07<10:56:19,  1.54it/s]
  8%|▊         | 5015/65536 [56:07<11:02:24,  1.52it/s]
  8%|▊         | 5016/65536 [56:08<10:56:55,  1.54it/s]
  8%|▊         | 5017/65536 [56:09<11:04:58,  1.52it/s]
  8%|▊         | 5018/65536 [56:09<11:23:38,  1.48it/s]
  8%|▊         | 5019/65536 [56:10<11:24:23,  1.47it/s]
  8%|▊         | 5020/65536 [56:11<11:40:16,  1.44it/s]
                                                       
{'loss': 1.1528, 'learning_rate': 9.336047508264968e-07, 'epoch': 309.88}

  8%|▊         | 5020/65536 [56:11<11:40:16,  1.44it/s]
  8%|▊         | 5021/65536 [56:11<11:27:48,  1.47it/s]
  8%|▊         | 5022/65536 [56:12<11:03:02,  1.52it/s]
  8%|▊         | 5023/65536 [56:13<11:27:44,  1.47it/s]
  8%|▊         | 5024/65536 [56:13<11:46:35,  1.43it/s]
  8%|▊         | 5025/65536 [56:14<11:45:09,  1.43it/s]
  8%|▊         | 5026/65536 [56:15<11:41:58,  1.44it/s]
  8%|▊         | 5027/65536 [56:15<11:14:20,  1.50it/s]
  8%|▊         | 5028/65536 [56:16<11:05:10,  1.52it/s]
  8%|▊         | 5029/65536 [56:17<10:57:14,  1.53it/s]
  8%|▊         | 5030/65536 [56:17<10:53:13,  1.54it/s]
  8%|▊         | 5031/65536 [56:18<11:09:49,  1.51it/s]
  8%|▊         | 5032/65536 [56:19<11:26:58,  1.47it/s]
  8%|▊         | 5033/65536 [56:19<11:17:29,  1.49it/s]
  8%|▊         | 5034/65536 [56:20<11:11:02,  1.50it/s]
  8%|▊         | 5035/65536 [56:21<11:06:41,  1.51it/s]
  8%|▊         | 5036/65536 [56:21<11:05:03,  1.52it/s]
  8%|▊         | 5037/65536 [56:22<11:06:41,  1.51it/s]
  8%|▊         | 5038/65536 [56:23<11:15:43,  1.49it/s]
  8%|▊         | 5039/65536 [56:24<11:44:09,  1.43it/s]
  8%|▊         | 5040/65536 [56:24<11:12:08,  1.50it/s]
                                                       
{'loss': 1.1665, 'learning_rate': 9.333292518672707e-07, 'epoch': 311.11}

  8%|▊         | 5040/65536 [56:24<11:12:08,  1.50it/s]
  8%|▊         | 5041/65536 [56:25<11:05:43,  1.51it/s]
  8%|▊         | 5042/65536 [56:25<11:05:54,  1.51it/s]
  8%|▊         | 5043/65536 [56:26<10:37:19,  1.58it/s]
  8%|▊         | 5044/65536 [56:27<10:46:14,  1.56it/s]
  8%|▊         | 5045/65536 [56:27<10:58:59,  1.53it/s]
  8%|▊         | 5046/65536 [56:28<11:13:30,  1.50it/s]
  8%|▊         | 5047/65536 [56:29<11:11:10,  1.50it/s]
  8%|▊         | 5048/65536 [56:29<11:01:39,  1.52it/s]
  8%|▊         | 5049/65536 [56:30<11:08:00,  1.51it/s]
  8%|▊         | 5050/65536 [56:31<11:18:31,  1.49it/s]
  8%|▊         | 5051/65536 [56:31<11:28:04,  1.47it/s]
  8%|▊         | 5052/65536 [56:32<11:38:06,  1.44it/s]
  8%|▊         | 5053/65536 [56:33<11:21:05,  1.48it/s]
  8%|▊         | 5054/65536 [56:33<11:18:56,  1.48it/s]
  8%|▊         | 5055/65536 [56:34<11:39:46,  1.44it/s]
  8%|▊         | 5056/65536 [56:35<11:50:57,  1.42it/s]
  8%|▊         | 5057/65536 [56:36<11:37:01,  1.45it/s]
  8%|▊         | 5058/65536 [56:36<11:23:39,  1.47it/s]
  8%|▊         | 5059/65536 [56:37<11:13:53,  1.50it/s]
  8%|▊         | 5060/65536 [56:38<11:31:52,  1.46it/s]
                                                       
{'loss': 1.1782, 'learning_rate': 9.330537529080446e-07, 'epoch': 312.35}

  8%|▊         | 5060/65536 [56:38<11:31:52,  1.46it/s]
  8%|▊         | 5061/65536 [56:38<11:09:28,  1.51it/s]
  8%|▊         | 5062/65536 [56:39<10:59:55,  1.53it/s]
  8%|▊         | 5063/65536 [56:39<11:01:49,  1.52it/s]
  8%|▊         | 5064/65536 [56:40<10:59:51,  1.53it/s]
  8%|▊         | 5065/65536 [56:41<11:07:56,  1.51it/s]
  8%|▊         | 5066/65536 [56:41<11:05:16,  1.51it/s]
  8%|▊         | 5067/65536 [56:42<11:05:30,  1.51it/s]
  8%|▊         | 5068/65536 [56:43<10:55:48,  1.54it/s]
  8%|▊         | 5069/65536 [56:43<11:00:27,  1.53it/s]
  8%|▊         | 5070/65536 [56:44<10:50:01,  1.55it/s]
  8%|▊         | 5071/65536 [56:45<11:10:15,  1.50it/s]
  8%|▊         | 5072/65536 [56:45<11:17:22,  1.49it/s]
  8%|▊         | 5073/65536 [56:46<11:05:49,  1.51it/s]
  8%|▊         | 5074/65536 [56:47<10:58:09,  1.53it/s]
  8%|▊         | 5075/65536 [56:47<10:57:25,  1.53it/s]
  8%|▊         | 5076/65536 [56:48<11:08:52,  1.51it/s]
  8%|▊         | 5077/65536 [56:49<11:02:40,  1.52it/s]
  8%|▊         | 5078/65536 [56:49<10:44:36,  1.56it/s]
  8%|▊         | 5079/65536 [56:50<10:59:32,  1.53it/s]
  8%|▊         | 5080/65536 [56:51<11:30:22,  1.46it/s]
                                                       
{'loss': 1.1805, 'learning_rate': 9.327782539488184e-07, 'epoch': 313.58}

  8%|▊         | 5080/65536 [56:51<11:30:22,  1.46it/s]
  8%|▊         | 5081/65536 [56:51<11:30:26,  1.46it/s]
  8%|▊         | 5082/65536 [56:52<11:16:31,  1.49it/s]
  8%|▊         | 5083/65536 [56:53<11:19:14,  1.48it/s]
  8%|▊         | 5084/65536 [56:53<11:11:26,  1.50it/s]
  8%|▊         | 5085/65536 [56:54<11:08:45,  1.51it/s]
  8%|▊         | 5086/65536 [56:55<11:23:25,  1.47it/s]
  8%|▊         | 5087/65536 [56:55<11:35:05,  1.45it/s]
  8%|▊         | 5088/65536 [56:56<11:26:08,  1.47it/s]
  8%|▊         | 5089/65536 [56:57<11:18:08,  1.49it/s]
  8%|▊         | 5090/65536 [56:57<11:24:33,  1.47it/s]
  8%|▊         | 5091/65536 [56:58<11:38:27,  1.44it/s]
  8%|▊         | 5092/65536 [56:59<11:29:33,  1.46it/s]
  8%|▊         | 5093/65536 [56:59<11:10:36,  1.50it/s]
  8%|▊         | 5094/65536 [57:00<10:57:47,  1.53it/s]
  8%|▊         | 5095/65536 [57:01<11:11:48,  1.50it/s]
  8%|▊         | 5096/65536 [57:01<11:07:33,  1.51it/s]
  8%|▊         | 5097/65536 [57:02<11:11:26,  1.50it/s]
  8%|▊         | 5098/65536 [57:03<11:14:14,  1.49it/s]
  8%|▊         | 5099/65536 [57:04<11:19:02,  1.48it/s]
  8%|▊         | 5100/65536 [57:04<11:03:06,  1.52it/s]
                                                       
{'loss': 1.169, 'learning_rate': 9.325027549895923e-07, 'epoch': 314.81}

  8%|▊         | 5100/65536 [57:04<11:03:06,  1.52it/s]
  8%|▊         | 5101/65536 [57:05<11:10:15,  1.50it/s]
  8%|▊         | 5102/65536 [57:05<11:15:10,  1.49it/s]
  8%|▊         | 5103/65536 [57:06<11:08:54,  1.51it/s]
  8%|▊         | 5104/65536 [57:07<11:25:05,  1.47it/s]
  8%|▊         | 5105/65536 [57:08<11:25:37,  1.47it/s]
  8%|▊         | 5106/65536 [57:08<11:35:23,  1.45it/s]
  8%|▊         | 5107/65536 [57:09<11:38:09,  1.44it/s]
  8%|▊         | 5108/65536 [57:10<11:15:27,  1.49it/s]
  8%|▊         | 5109/65536 [57:10<11:03:07,  1.52it/s]
  8%|▊         | 5110/65536 [57:11<11:14:58,  1.49it/s]
  8%|▊         | 5111/65536 [57:12<11:18:40,  1.48it/s]
  8%|▊         | 5112/65536 [57:12<11:19:55,  1.48it/s]
  8%|▊         | 5113/65536 [57:13<11:17:39,  1.49it/s]
  8%|▊         | 5114/65536 [57:14<11:10:33,  1.50it/s]
  8%|▊         | 5115/65536 [57:14<11:35:54,  1.45it/s]
  8%|▊         | 5116/65536 [57:15<11:39:07,  1.44it/s]
  8%|▊         | 5117/65536 [57:16<11:34:40,  1.45it/s]
  8%|▊         | 5118/65536 [57:16<11:19:27,  1.48it/s]
  8%|▊         | 5119/65536 [57:17<10:52:50,  1.54it/s]
  8%|▊         | 5120/65536 [57:18<11:07:59,  1.51it/s]
                                                       
{'loss': 1.1641, 'learning_rate': 9.322272560303662e-07, 'epoch': 316.05}

  8%|▊         | 5120/65536 [57:18<11:07:59,  1.51it/s]
  8%|▊         | 5121/65536 [57:18<11:07:44,  1.51it/s]
  8%|▊         | 5122/65536 [57:19<11:00:26,  1.52it/s]
  8%|▊         | 5123/65536 [57:20<11:12:02,  1.50it/s]
  8%|▊         | 5124/65536 [57:20<11:17:34,  1.49it/s]
  8%|▊         | 5125/65536 [57:21<10:56:17,  1.53it/s]
  8%|▊         | 5126/65536 [57:22<10:58:42,  1.53it/s]
  8%|▊         | 5127/65536 [57:22<11:05:51,  1.51it/s]
  8%|▊         | 5128/65536 [57:23<11:10:04,  1.50it/s]
  8%|▊         | 5129/65536 [57:24<11:15:07,  1.49it/s]
  8%|▊         | 5130/65536 [57:24<11:09:41,  1.50it/s]
  8%|▊         | 5131/65536 [57:25<11:12:59,  1.50it/s]
  8%|▊         | 5132/65536 [57:26<11:09:17,  1.50it/s]
  8%|▊         | 5133/65536 [57:26<11:10:21,  1.50it/s]
  8%|▊         | 5134/65536 [57:27<11:27:50,  1.46it/s]
  8%|▊         | 5135/65536 [57:28<11:31:37,  1.46it/s]
  8%|▊         | 5136/65536 [57:28<11:46:07,  1.43it/s]
  8%|▊         | 5137/65536 [57:29<11:29:35,  1.46it/s]
  8%|▊         | 5138/65536 [57:30<11:24:17,  1.47it/s]
  8%|▊         | 5139/65536 [57:30<11:05:47,  1.51it/s]
  8%|▊         | 5140/65536 [57:31<11:19:36,  1.48it/s]
                                                       
{'loss': 1.1333, 'learning_rate': 9.319517570711399e-07, 'epoch': 317.28}

  8%|▊         | 5140/65536 [57:31<11:19:36,  1.48it/s]
  8%|▊         | 5141/65536 [57:32<11:18:29,  1.48it/s]
  8%|▊         | 5142/65536 [57:32<11:21:43,  1.48it/s]
  8%|▊         | 5143/65536 [57:33<11:03:12,  1.52it/s]
  8%|▊         | 5144/65536 [57:34<10:45:12,  1.56it/s]
  8%|▊         | 5145/65536 [57:34<10:51:36,  1.54it/s]
  8%|▊         | 5146/65536 [57:35<11:26:46,  1.47it/s]
  8%|▊         | 5147/65536 [57:36<11:46:33,  1.42it/s]
  8%|▊         | 5148/65536 [57:36<11:24:33,  1.47it/s]
  8%|▊         | 5149/65536 [57:37<11:06:09,  1.51it/s]
  8%|▊         | 5150/65536 [57:38<11:00:26,  1.52it/s]
  8%|▊         | 5151/65536 [57:38<11:10:11,  1.50it/s]
  8%|▊         | 5152/65536 [57:39<11:38:24,  1.44it/s]
  8%|▊         | 5153/65536 [57:40<11:14:39,  1.49it/s]
  8%|▊         | 5154/65536 [57:40<11:18:53,  1.48it/s]
  8%|▊         | 5155/65536 [57:41<11:07:19,  1.51it/s]
  8%|▊         | 5156/65536 [57:42<11:37:59,  1.44it/s]
  8%|▊         | 5157/65536 [57:43<11:49:54,  1.42it/s]
  8%|▊         | 5158/65536 [57:43<11:39:14,  1.44it/s]
  8%|▊         | 5159/65536 [57:44<11:12:01,  1.50it/s]
  8%|▊         | 5160/65536 [57:44<11:02:55,  1.52it/s]
                                                       
{'loss': 1.1659, 'learning_rate': 9.316762581119138e-07, 'epoch': 318.52}

  8%|▊         | 5160/65536 [57:44<11:02:55,  1.52it/s]
  8%|▊         | 5161/65536 [57:45<11:14:47,  1.49it/s]
  8%|▊         | 5162/65536 [57:46<11:30:54,  1.46it/s]
  8%|▊         | 5163/65536 [57:47<11:11:39,  1.50it/s]
  8%|▊         | 5164/65536 [57:47<11:07:24,  1.51it/s]
  8%|▊         | 5165/65536 [57:48<11:14:25,  1.49it/s]
  8%|▊         | 5166/65536 [57:48<11:00:03,  1.52it/s]
  8%|▊         | 5167/65536 [57:49<10:52:40,  1.54it/s]
  8%|▊         | 5168/65536 [57:50<10:56:13,  1.53it/s]
  8%|▊         | 5169/65536 [57:50<10:55:07,  1.54it/s]
  8%|▊         | 5170/65536 [57:51<11:07:09,  1.51it/s]
  8%|▊         | 5171/65536 [57:52<11:00:00,  1.52it/s]
  8%|▊         | 5172/65536 [57:52<11:09:05,  1.50it/s]
  8%|▊         | 5173/65536 [57:53<11:08:07,  1.51it/s]
  8%|▊         | 5174/65536 [57:54<10:54:42,  1.54it/s]
  8%|▊         | 5175/65536 [57:54<11:06:55,  1.51it/s]
  8%|▊         | 5176/65536 [57:55<11:16:15,  1.49it/s]
  8%|▊         | 5177/65536 [57:56<11:16:19,  1.49it/s]
  8%|▊         | 5178/65536 [57:56<11:22:05,  1.47it/s]
  8%|▊         | 5179/65536 [57:57<11:03:48,  1.52it/s]
  8%|▊         | 5180/65536 [57:58<11:17:34,  1.48it/s]
                                                       
{'loss': 1.1485, 'learning_rate': 9.314007591526876e-07, 'epoch': 319.75}

  8%|▊         | 5180/65536 [57:58<11:17:34,  1.48it/s]
  8%|▊         | 5181/65536 [57:58<11:13:32,  1.49it/s]
  8%|▊         | 5182/65536 [57:59<11:30:54,  1.46it/s]
  8%|▊         | 5183/65536 [58:00<11:34:28,  1.45it/s]
  8%|▊         | 5184/65536 [58:01<11:14:22,  1.49it/s]
  8%|▊         | 5185/65536 [58:01<11:22:19,  1.47it/s]
  8%|▊         | 5186/65536 [58:02<11:34:51,  1.45it/s]
  8%|▊         | 5187/65536 [58:03<11:17:03,  1.49it/s]
  8%|▊         | 5188/65536 [58:03<11:10:51,  1.50it/s]
  8%|▊         | 5189/65536 [58:04<11:00:23,  1.52it/s]
  8%|▊         | 5190/65536 [58:05<11:12:14,  1.50it/s]
  8%|▊         | 5191/65536 [58:05<10:55:37,  1.53it/s]
  8%|▊         | 5192/65536 [58:06<10:58:41,  1.53it/s]
  8%|▊         | 5193/65536 [58:07<11:24:32,  1.47it/s]
  8%|▊         | 5194/65536 [58:07<11:13:06,  1.49it/s]
  8%|▊         | 5195/65536 [58:08<11:18:08,  1.48it/s]
  8%|▊         | 5196/65536 [58:09<11:16:57,  1.49it/s]
  8%|▊         | 5197/65536 [58:09<11:15:58,  1.49it/s]
  8%|▊         | 5198/65536 [58:10<11:18:42,  1.48it/s]
  8%|▊         | 5199/65536 [58:11<11:11:13,  1.50it/s]
  8%|▊         | 5200/65536 [58:11<11:09:58,  1.50it/s]
                                                       
{'loss': 1.1513, 'learning_rate': 9.311252601934615e-07, 'epoch': 320.99}

  8%|▊         | 5200/65536 [58:11<11:09:58,  1.50it/s]
  8%|▊         | 5201/65536 [58:12<11:11:04,  1.50it/s]
  8%|▊         | 5202/65536 [58:13<10:58:58,  1.53it/s]
  8%|▊         | 5203/65536 [58:13<11:15:20,  1.49it/s]
  8%|▊         | 5204/65536 [58:14<10:56:05,  1.53it/s]
  8%|▊         | 5205/65536 [58:15<11:04:44,  1.51it/s]
  8%|▊         | 5206/65536 [58:15<11:00:36,  1.52it/s]
  8%|▊         | 5207/65536 [58:16<11:16:11,  1.49it/s]
  8%|▊         | 5208/65536 [58:17<11:06:29,  1.51it/s]
  8%|▊         | 5209/65536 [58:17<11:11:20,  1.50it/s]
  8%|▊         | 5210/65536 [58:18<11:15:15,  1.49it/s]
  8%|▊         | 5211/65536 [58:19<11:25:28,  1.47it/s]
  8%|▊         | 5212/65536 [58:19<11:18:35,  1.48it/s]
  8%|▊         | 5213/65536 [58:20<11:07:42,  1.51it/s]
  8%|▊         | 5214/65536 [58:21<11:13:12,  1.49it/s]
  8%|▊         | 5215/65536 [58:21<11:03:56,  1.51it/s]
  8%|▊         | 5216/65536 [58:22<11:07:59,  1.51it/s]
  8%|▊         | 5217/65536 [58:23<11:11:34,  1.50it/s]
  8%|▊         | 5218/65536 [58:23<11:09:04,  1.50it/s]
  8%|▊         | 5219/65536 [58:24<11:02:00,  1.52it/s]
  8%|▊         | 5220/65536 [58:24<10:53:53,  1.54it/s]
                                                       
{'loss': 1.1603, 'learning_rate': 9.308497612342353e-07, 'epoch': 322.22}

  8%|▊         | 5220/65536 [58:24<10:53:53,  1.54it/s]
  8%|▊         | 5221/65536 [58:25<11:12:11,  1.50it/s]
  8%|▊         | 5222/65536 [58:26<11:30:30,  1.46it/s]
  8%|▊         | 5223/65536 [58:27<11:21:45,  1.47it/s]
  8%|▊         | 5224/65536 [58:27<11:06:19,  1.51it/s]
  8%|▊         | 5225/65536 [58:28<10:47:40,  1.55it/s]
  8%|▊         | 5226/65536 [58:28<10:55:16,  1.53it/s]
  8%|▊         | 5227/65536 [58:29<10:48:32,  1.55it/s]
  8%|▊         | 5228/65536 [58:30<10:53:50,  1.54it/s]
  8%|▊         | 5229/65536 [58:30<11:08:26,  1.50it/s]
  8%|▊         | 5230/65536 [58:31<11:08:50,  1.50it/s]
  8%|▊         | 5231/65536 [58:32<11:28:48,  1.46it/s]
  8%|▊         | 5232/65536 [58:33<11:26:28,  1.46it/s]
  8%|▊         | 5233/65536 [58:33<11:45:13,  1.43it/s]
  8%|▊         | 5234/65536 [58:34<11:15:52,  1.49it/s]
  8%|▊         | 5235/65536 [58:35<11:12:58,  1.49it/s]
  8%|▊         | 5236/65536 [58:35<11:06:27,  1.51it/s]
  8%|▊         | 5237/65536 [58:36<11:15:59,  1.49it/s]
  8%|▊         | 5238/65536 [58:37<11:01:54,  1.52it/s]
  8%|▊         | 5239/65536 [58:37<11:06:04,  1.51it/s]
  8%|▊         | 5240/65536 [58:38<11:11:05,  1.50it/s]
                                                       
{'loss': 1.1543, 'learning_rate': 9.305742622750092e-07, 'epoch': 323.46}

  8%|▊         | 5240/65536 [58:38<11:11:05,  1.50it/s]
  8%|▊         | 5241/65536 [58:39<11:22:18,  1.47it/s]
  8%|▊         | 5242/65536 [58:39<11:29:26,  1.46it/s]
  8%|▊         | 5243/65536 [58:40<11:11:21,  1.50it/s]
  8%|▊         | 5244/65536 [58:41<11:32:06,  1.45it/s]
  8%|▊         | 5245/65536 [58:41<11:40:11,  1.44it/s]
  8%|▊         | 5246/65536 [58:42<11:22:01,  1.47it/s]
  8%|▊         | 5247/65536 [58:43<11:01:02,  1.52it/s]
  8%|▊         | 5248/65536 [58:43<11:03:23,  1.51it/s]
  8%|▊         | 5249/65536 [58:44<11:30:39,  1.45it/s]
  8%|▊         | 5250/65536 [58:45<11:14:36,  1.49it/s]
  8%|▊         | 5251/65536 [58:45<11:04:55,  1.51it/s]
  8%|▊         | 5252/65536 [58:46<11:06:12,  1.51it/s]
  8%|▊         | 5253/65536 [58:47<11:08:42,  1.50it/s]
  8%|▊         | 5254/65536 [58:47<11:29:12,  1.46it/s]
  8%|▊         | 5255/65536 [58:48<11:28:15,  1.46it/s]
  8%|▊         | 5256/65536 [58:49<11:21:45,  1.47it/s]
  8%|▊         | 5257/65536 [58:49<11:01:54,  1.52it/s]
  8%|▊         | 5258/65536 [58:50<11:08:11,  1.50it/s]
  8%|▊         | 5259/65536 [58:51<11:17:59,  1.48it/s]
  8%|▊         | 5260/65536 [58:51<11:11:56,  1.50it/s]
                                                       
{'loss': 1.1449, 'learning_rate': 9.30298763315783e-07, 'epoch': 324.69}

  8%|▊         | 5260/65536 [58:51<11:11:56,  1.50it/s]
  8%|▊         | 5261/65536 [58:52<11:29:51,  1.46it/s]
  8%|▊         | 5262/65536 [58:53<11:21:42,  1.47it/s]
  8%|▊         | 5263/65536 [58:53<11:21:11,  1.47it/s]
  8%|▊         | 5264/65536 [58:54<11:17:16,  1.48it/s]
  8%|▊         | 5265/65536 [58:55<10:59:26,  1.52it/s]
  8%|▊         | 5266/65536 [58:55<11:07:15,  1.51it/s]
  8%|▊         | 5267/65536 [58:56<11:33:36,  1.45it/s]
  8%|▊         | 5268/65536 [58:57<11:28:00,  1.46it/s]
  8%|▊         | 5269/65536 [58:57<11:21:14,  1.47it/s]
  8%|▊         | 5270/65536 [58:58<11:36:53,  1.44it/s]
  8%|▊         | 5271/65536 [58:59<11:18:53,  1.48it/s]
  8%|▊         | 5272/65536 [58:59<11:08:09,  1.50it/s]
  8%|▊         | 5273/65536 [59:00<11:07:48,  1.50it/s]
  8%|▊         | 5274/65536 [59:01<11:18:33,  1.48it/s]
  8%|▊         | 5275/65536 [59:02<11:16:36,  1.48it/s]
  8%|▊         | 5276/65536 [59:02<11:11:58,  1.49it/s]
  8%|▊         | 5277/65536 [59:03<11:14:29,  1.49it/s]
  8%|▊         | 5278/65536 [59:04<11:07:35,  1.50it/s]
  8%|▊         | 5279/65536 [59:04<11:06:37,  1.51it/s]
  8%|▊         | 5280/65536 [59:05<11:07:52,  1.50it/s]
                                                       
{'loss': 1.1507, 'learning_rate': 9.300232643565568e-07, 'epoch': 325.93}

  8%|▊         | 5280/65536 [59:05<11:07:52,  1.50it/s]
  8%|▊         | 5281/65536 [59:05<11:06:19,  1.51it/s]
  8%|▊         | 5282/65536 [59:06<11:46:29,  1.42it/s]
  8%|▊         | 5283/65536 [59:07<11:51:25,  1.41it/s]
  8%|▊         | 5284/65536 [59:08<11:23:06,  1.47it/s]
  8%|▊         | 5285/65536 [59:08<11:22:04,  1.47it/s]
  8%|▊         | 5286/65536 [59:09<11:14:05,  1.49it/s]
  8%|▊         | 5287/65536 [59:10<11:22:03,  1.47it/s]
  8%|▊         | 5288/65536 [59:10<11:22:21,  1.47it/s]
  8%|▊         | 5289/65536 [59:11<11:23:55,  1.47it/s]
  8%|▊         | 5290/65536 [59:12<11:31:43,  1.45it/s]
  8%|▊         | 5291/65536 [59:12<11:00:05,  1.52it/s]
  8%|▊         | 5292/65536 [59:13<11:04:46,  1.51it/s]
  8%|▊         | 5293/65536 [59:14<11:19:23,  1.48it/s]
  8%|▊         | 5294/65536 [59:14<10:58:13,  1.53it/s]
  8%|▊         | 5295/65536 [59:15<11:06:10,  1.51it/s]
  8%|▊         | 5296/65536 [59:16<11:05:21,  1.51it/s]
  8%|▊         | 5297/65536 [59:16<10:53:40,  1.54it/s]
  8%|▊         | 5298/65536 [59:17<10:56:51,  1.53it/s]
  8%|▊         | 5299/65536 [59:18<11:00:49,  1.52it/s]
  8%|▊         | 5300/65536 [59:18<11:09:00,  1.50it/s]
                                                       
{'loss': 1.1578, 'learning_rate': 9.297477653973307e-07, 'epoch': 327.16}

  8%|▊         | 5300/65536 [59:18<11:09:00,  1.50it/s]
  8%|▊         | 5301/65536 [59:19<11:09:43,  1.50it/s]
  8%|▊         | 5302/65536 [59:20<11:12:19,  1.49it/s]
  8%|▊         | 5303/65536 [59:20<10:57:51,  1.53it/s]
  8%|▊         | 5304/65536 [59:21<10:54:28,  1.53it/s]
  8%|▊         | 5305/65536 [59:22<11:01:51,  1.52it/s]
  8%|▊         | 5306/65536 [59:22<11:01:56,  1.52it/s]
  8%|▊         | 5307/65536 [59:23<10:59:10,  1.52it/s]
  8%|▊         | 5308/65536 [59:24<11:10:34,  1.50it/s]
  8%|▊         | 5309/65536 [59:24<11:04:32,  1.51it/s]
  8%|▊         | 5310/65536 [59:25<11:06:44,  1.51it/s]
  8%|▊         | 5311/65536 [59:26<11:16:44,  1.48it/s]
  8%|▊         | 5312/65536 [59:26<11:16:33,  1.48it/s]
  8%|▊         | 5313/65536 [59:27<11:28:38,  1.46it/s]
  8%|▊         | 5314/65536 [59:28<11:33:20,  1.45it/s]
  8%|▊         | 5315/65536 [59:28<11:43:22,  1.43it/s]
  8%|▊         | 5316/65536 [59:29<11:30:58,  1.45it/s]
  8%|▊         | 5317/65536 [59:30<10:59:16,  1.52it/s]
  8%|▊         | 5318/65536 [59:30<10:51:52,  1.54it/s]
  8%|▊         | 5319/65536 [59:31<11:05:44,  1.51it/s]
  8%|▊         | 5320/65536 [59:32<10:50:26,  1.54it/s]
                                                       
{'loss': 1.1583, 'learning_rate': 9.294722664381045e-07, 'epoch': 328.4}

  8%|▊         | 5320/65536 [59:32<10:50:26,  1.54it/s]
  8%|▊         | 5321/65536 [59:32<10:45:22,  1.56it/s]
  8%|▊         | 5322/65536 [59:33<11:03:07,  1.51it/s]
  8%|▊         | 5323/65536 [59:34<11:08:13,  1.50it/s]
  8%|▊         | 5324/65536 [59:34<11:15:28,  1.49it/s]
  8%|▊         | 5325/65536 [59:35<11:26:27,  1.46it/s]
  8%|▊         | 5326/65536 [59:36<11:20:39,  1.47it/s]
  8%|▊         | 5327/65536 [59:36<11:08:21,  1.50it/s]
  8%|▊         | 5328/65536 [59:37<11:21:17,  1.47it/s]
  8%|▊         | 5329/65536 [59:38<11:00:13,  1.52it/s]
  8%|▊         | 5330/65536 [59:38<11:20:04,  1.48it/s]
  8%|▊         | 5331/65536 [59:39<11:38:09,  1.44it/s]
  8%|▊         | 5332/65536 [59:40<11:23:24,  1.47it/s]
  8%|▊         | 5333/65536 [59:40<11:25:28,  1.46it/s]
  8%|▊         | 5334/65536 [59:41<11:25:53,  1.46it/s]
  8%|▊         | 5335/65536 [59:42<11:12:59,  1.49it/s]
  8%|▊         | 5336/65536 [59:42<11:14:27,  1.49it/s]
  8%|▊         | 5337/65536 [59:43<11:10:58,  1.50it/s]
  8%|▊         | 5338/65536 [59:44<11:33:33,  1.45it/s]
  8%|▊         | 5339/65536 [59:44<11:21:46,  1.47it/s]
  8%|▊         | 5340/65536 [59:45<11:20:24,  1.47it/s]
                                                       
{'loss': 1.1304, 'learning_rate': 9.291967674788784e-07, 'epoch': 329.63}

  8%|▊         | 5340/65536 [59:45<11:20:24,  1.47it/s]
  8%|▊         | 5341/65536 [59:46<11:20:58,  1.47it/s]
  8%|▊         | 5342/65536 [59:47<11:20:58,  1.47it/s]
  8%|▊         | 5343/65536 [59:47<11:08:18,  1.50it/s]
  8%|▊         | 5344/65536 [59:48<11:24:33,  1.47it/s]
  8%|▊         | 5345/65536 [59:49<11:22:11,  1.47it/s]
  8%|▊         | 5346/65536 [59:49<10:59:31,  1.52it/s]
  8%|▊         | 5347/65536 [59:50<11:33:12,  1.45it/s]
  8%|▊         | 5348/65536 [59:51<11:21:10,  1.47it/s]
  8%|▊         | 5349/65536 [59:51<11:21:36,  1.47it/s]
  8%|▊         | 5350/65536 [59:52<11:12:04,  1.49it/s]
  8%|▊         | 5351/65536 [59:53<11:09:04,  1.50it/s]
  8%|▊         | 5352/65536 [59:53<11:10:15,  1.50it/s]
  8%|▊         | 5353/65536 [59:54<10:55:43,  1.53it/s]
  8%|▊         | 5354/65536 [59:55<11:13:48,  1.49it/s]
  8%|▊         | 5355/65536 [59:55<11:10:57,  1.49it/s]
  8%|▊         | 5356/65536 [59:56<11:20:26,  1.47it/s]
  8%|▊         | 5357/65536 [59:57<11:07:11,  1.50it/s]
  8%|▊         | 5358/65536 [59:57<11:08:58,  1.50it/s]
  8%|▊         | 5359/65536 [59:58<11:00:02,  1.52it/s]
  8%|▊         | 5360/65536 [59:59<11:01:47,  1.52it/s]
                                                       
{'loss': 1.1422, 'learning_rate': 9.289212685196523e-07, 'epoch': 330.86}

  8%|▊         | 5360/65536 [59:59<11:01:47,  1.52it/s]
  8%|▊         | 5361/65536 [59:59<11:07:25,  1.50it/s]
  8%|▊         | 5362/65536 [1:00:00<11:00:45,  1.52it/s]
  8%|▊         | 5363/65536 [1:00:01<11:23:13,  1.47it/s]
  8%|▊         | 5364/65536 [1:00:01<11:25:36,  1.46it/s]
  8%|▊         | 5365/65536 [1:00:02<11:38:11,  1.44it/s]
  8%|▊         | 5366/65536 [1:00:03<11:12:04,  1.49it/s]
  8%|▊         | 5367/65536 [1:00:03<11:07:33,  1.50it/s]
  8%|▊         | 5368/65536 [1:00:04<11:07:11,  1.50it/s]
  8%|▊         | 5369/65536 [1:00:05<11:07:16,  1.50it/s]
  8%|▊         | 5370/65536 [1:00:05<11:11:51,  1.49it/s]
  8%|▊         | 5371/65536 [1:00:06<11:18:47,  1.48it/s]
  8%|▊         | 5372/65536 [1:00:07<11:11:57,  1.49it/s]
  8%|▊         | 5373/65536 [1:00:07<11:12:00,  1.49it/s]
  8%|▊         | 5374/65536 [1:00:08<11:19:28,  1.48it/s]
  8%|▊         | 5375/65536 [1:00:09<11:14:44,  1.49it/s]
  8%|▊         | 5376/65536 [1:00:09<11:28:23,  1.46it/s]
  8%|▊         | 5377/65536 [1:00:10<11:13:18,  1.49it/s]
  8%|▊         | 5378/65536 [1:00:11<11:13:50,  1.49it/s]
  8%|▊         | 5379/65536 [1:00:11<11:30:25,  1.45it/s]
  8%|▊         | 5380/65536 [1:00:12<11:36:12,  1.44it/s]
                                                         
{'loss': 1.1262, 'learning_rate': 9.286457695604261e-07, 'epoch': 332.1}

  8%|▊         | 5380/65536 [1:00:12<11:36:12,  1.44it/s]
  8%|▊         | 5381/65536 [1:00:13<11:12:41,  1.49it/s]
  8%|▊         | 5382/65536 [1:00:13<11:05:23,  1.51it/s]
  8%|▊         | 5383/65536 [1:00:14<11:23:13,  1.47it/s]
  8%|▊         | 5384/65536 [1:00:15<11:26:09,  1.46it/s]
  8%|▊         | 5385/65536 [1:00:15<11:02:00,  1.51it/s]
  8%|▊         | 5386/65536 [1:00:16<11:02:36,  1.51it/s]
  8%|▊         | 5387/65536 [1:00:17<11:01:50,  1.51it/s]
  8%|▊         | 5388/65536 [1:00:17<11:08:13,  1.50it/s]
  8%|▊         | 5389/65536 [1:00:18<11:12:22,  1.49it/s]
  8%|▊         | 5390/65536 [1:00:19<11:18:50,  1.48it/s]
  8%|▊         | 5391/65536 [1:00:19<11:18:09,  1.48it/s]
  8%|▊         | 5392/65536 [1:00:20<11:18:11,  1.48it/s]
  8%|▊         | 5393/65536 [1:00:21<11:02:20,  1.51it/s]
  8%|▊         | 5394/65536 [1:00:21<11:01:57,  1.51it/s]
  8%|▊         | 5395/65536 [1:00:22<11:31:42,  1.45it/s]
  8%|▊         | 5396/65536 [1:00:23<11:24:58,  1.46it/s]
  8%|▊         | 5397/65536 [1:00:23<11:21:38,  1.47it/s]
  8%|▊         | 5398/65536 [1:00:24<11:10:28,  1.49it/s]
  8%|▊         | 5399/65536 [1:00:25<11:06:16,  1.50it/s]
  8%|▊         | 5400/65536 [1:00:25<11:08:48,  1.50it/s]
                                                         
{'loss': 1.1319, 'learning_rate': 9.283702706011999e-07, 'epoch': 333.33}

  8%|▊         | 5400/65536 [1:00:25<11:08:48,  1.50it/s]
  8%|▊         | 5401/65536 [1:00:26<11:07:39,  1.50it/s]
  8%|▊         | 5402/65536 [1:00:27<10:59:33,  1.52it/s]
  8%|▊         | 5403/65536 [1:00:27<10:45:00,  1.55it/s]
  8%|▊         | 5404/65536 [1:00:28<10:59:45,  1.52it/s]
  8%|▊         | 5405/65536 [1:00:29<11:03:02,  1.51it/s]
  8%|▊         | 5406/65536 [1:00:29<11:15:43,  1.48it/s]
  8%|▊         | 5407/65536 [1:00:30<11:24:42,  1.46it/s]
  8%|▊         | 5408/65536 [1:00:31<11:37:56,  1.44it/s]
  8%|▊         | 5409/65536 [1:00:32<11:32:10,  1.45it/s]
  8%|▊         | 5410/65536 [1:00:32<11:15:56,  1.48it/s]
  8%|▊         | 5411/65536 [1:00:33<11:26:45,  1.46it/s]
  8%|▊         | 5412/65536 [1:00:34<11:18:24,  1.48it/s]
  8%|▊         | 5413/65536 [1:00:34<11:12:21,  1.49it/s]
  8%|▊         | 5414/65536 [1:00:35<11:02:59,  1.51it/s]
  8%|▊         | 5415/65536 [1:00:36<11:09:24,  1.50it/s]
  8%|▊         | 5416/65536 [1:00:36<10:54:10,  1.53it/s]
  8%|▊         | 5417/65536 [1:00:37<11:06:17,  1.50it/s]
  8%|▊         | 5418/65536 [1:00:38<11:17:10,  1.48it/s]
  8%|▊         | 5419/65536 [1:00:38<11:13:44,  1.49it/s]
  8%|▊         | 5420/65536 [1:00:39<11:36:20,  1.44it/s]
                                                         
{'loss': 1.1484, 'learning_rate': 9.280947716419737e-07, 'epoch': 334.57}

  8%|▊         | 5420/65536 [1:00:39<11:36:20,  1.44it/s]
  8%|▊         | 5421/65536 [1:00:40<11:23:31,  1.47it/s]
  8%|▊         | 5422/65536 [1:00:40<11:12:58,  1.49it/s]
  8%|▊         | 5423/65536 [1:00:41<11:16:09,  1.48it/s]
  8%|▊         | 5424/65536 [1:00:42<10:58:49,  1.52it/s]
  8%|▊         | 5425/65536 [1:00:42<11:00:12,  1.52it/s]
  8%|▊         | 5426/65536 [1:00:43<10:44:59,  1.55it/s]
  8%|▊         | 5427/65536 [1:00:44<10:56:50,  1.53it/s]
  8%|▊         | 5428/65536 [1:00:44<11:16:26,  1.48it/s]
  8%|▊         | 5429/65536 [1:00:45<11:05:17,  1.51it/s]
  8%|▊         | 5430/65536 [1:00:46<11:18:15,  1.48it/s]
  8%|▊         | 5431/65536 [1:00:46<11:08:49,  1.50it/s]
  8%|▊         | 5432/65536 [1:00:47<11:05:56,  1.50it/s]
  8%|▊         | 5433/65536 [1:00:48<10:58:38,  1.52it/s]
  8%|▊         | 5434/65536 [1:00:48<11:05:51,  1.50it/s]
  8%|▊         | 5435/65536 [1:00:49<11:19:05,  1.48it/s]
  8%|▊         | 5436/65536 [1:00:50<11:10:09,  1.49it/s]
  8%|▊         | 5437/65536 [1:00:50<11:09:44,  1.50it/s]
  8%|▊         | 5438/65536 [1:00:51<11:07:58,  1.50it/s]
  8%|▊         | 5439/65536 [1:00:52<11:02:00,  1.51it/s]
  8%|▊         | 5440/65536 [1:00:52<11:15:45,  1.48it/s]
                                                         
{'loss': 1.1447, 'learning_rate': 9.278192726827476e-07, 'epoch': 335.8}

  8%|▊         | 5440/65536 [1:00:52<11:15:45,  1.48it/s]
  8%|▊         | 5441/65536 [1:00:53<11:10:23,  1.49it/s]
  8%|▊         | 5442/65536 [1:00:54<10:57:50,  1.52it/s]
  8%|▊         | 5443/65536 [1:00:54<10:59:08,  1.52it/s]
  8%|▊         | 5444/65536 [1:00:55<11:06:45,  1.50it/s]
  8%|▊         | 5445/65536 [1:00:56<11:19:29,  1.47it/s]
  8%|▊         | 5446/65536 [1:00:56<11:14:15,  1.49it/s]
  8%|▊         | 5447/65536 [1:00:57<10:54:24,  1.53it/s]
  8%|▊         | 5448/65536 [1:00:58<11:01:14,  1.51it/s]
  8%|▊         | 5449/65536 [1:00:58<11:17:40,  1.48it/s]
  8%|▊         | 5450/65536 [1:00:59<11:12:55,  1.49it/s]
  8%|▊         | 5451/65536 [1:01:00<11:16:17,  1.48it/s]
  8%|▊         | 5452/65536 [1:01:00<11:07:22,  1.50it/s]
  8%|▊         | 5453/65536 [1:01:01<10:52:34,  1.53it/s]
  8%|▊         | 5454/65536 [1:01:02<10:56:38,  1.52it/s]
  8%|▊         | 5455/65536 [1:01:02<11:01:04,  1.51it/s]
  8%|▊         | 5456/65536 [1:01:03<11:14:04,  1.49it/s]
  8%|▊         | 5457/65536 [1:01:04<11:02:48,  1.51it/s]
  8%|▊         | 5458/65536 [1:01:04<11:02:28,  1.51it/s]
  8%|▊         | 5459/65536 [1:01:05<10:58:52,  1.52it/s]
  8%|▊         | 5460/65536 [1:01:06<11:30:07,  1.45it/s]
                                                         
{'loss': 1.1659, 'learning_rate': 9.275437737235214e-07, 'epoch': 337.04}

  8%|▊         | 5460/65536 [1:01:06<11:30:07,  1.45it/s]
  8%|▊         | 5461/65536 [1:01:06<11:21:49,  1.47it/s]
  8%|▊         | 5462/65536 [1:01:07<11:13:41,  1.49it/s]
  8%|▊         | 5463/65536 [1:01:08<11:14:26,  1.48it/s]
  8%|▊         | 5464/65536 [1:01:08<11:14:15,  1.48it/s]
  8%|▊         | 5465/65536 [1:01:09<11:16:48,  1.48it/s]
  8%|▊         | 5466/65536 [1:01:10<11:07:54,  1.50it/s]
  8%|▊         | 5467/65536 [1:01:10<11:10:32,  1.49it/s]
  8%|▊         | 5468/65536 [1:01:11<11:19:05,  1.47it/s]
  8%|▊         | 5469/65536 [1:01:12<11:22:15,  1.47it/s]
  8%|▊         | 5470/65536 [1:01:12<11:09:14,  1.50it/s]
  8%|▊         | 5471/65536 [1:01:13<11:03:38,  1.51it/s]
  8%|▊         | 5472/65536 [1:01:14<11:21:44,  1.47it/s]
  8%|▊         | 5473/65536 [1:01:14<11:15:45,  1.48it/s]
  8%|▊         | 5474/65536 [1:01:15<11:12:42,  1.49it/s]
  8%|▊         | 5475/65536 [1:01:16<11:14:55,  1.48it/s]
  8%|▊         | 5476/65536 [1:01:16<11:34:20,  1.44it/s]
  8%|▊         | 5477/65536 [1:01:17<11:37:36,  1.43it/s]
  8%|▊         | 5478/65536 [1:01:18<11:22:12,  1.47it/s]
  8%|▊         | 5479/65536 [1:01:18<11:30:18,  1.45it/s]
  8%|▊         | 5480/65536 [1:01:19<11:24:49,  1.46it/s]
                                                         
{'loss': 1.1103, 'learning_rate': 9.272682747642953e-07, 'epoch': 338.27}

  8%|▊         | 5480/65536 [1:01:19<11:24:49,  1.46it/s]
  8%|▊         | 5481/65536 [1:01:20<11:28:28,  1.45it/s]
  8%|▊         | 5482/65536 [1:01:21<11:39:20,  1.43it/s]
  8%|▊         | 5483/65536 [1:01:21<11:35:39,  1.44it/s]
  8%|▊         | 5484/65536 [1:01:22<11:18:55,  1.47it/s]
  8%|▊         | 5485/65536 [1:01:23<11:06:01,  1.50it/s]
  8%|▊         | 5486/65536 [1:01:23<11:07:03,  1.50it/s]
  8%|▊         | 5487/65536 [1:01:24<11:11:25,  1.49it/s]
  8%|▊         | 5488/65536 [1:01:24<10:50:45,  1.54it/s]
  8%|▊         | 5489/65536 [1:01:25<11:08:04,  1.50it/s]
  8%|▊         | 5490/65536 [1:01:26<11:04:38,  1.51it/s]
  8%|▊         | 5491/65536 [1:01:26<10:57:03,  1.52it/s]
  8%|▊         | 5492/65536 [1:01:27<11:08:11,  1.50it/s]
  8%|▊         | 5493/65536 [1:01:28<11:31:29,  1.45it/s]
  8%|▊         | 5494/65536 [1:01:29<11:27:03,  1.46it/s]
  8%|▊         | 5495/65536 [1:01:29<11:36:19,  1.44it/s]
  8%|▊         | 5496/65536 [1:01:30<11:11:42,  1.49it/s]
  8%|▊         | 5497/65536 [1:01:31<11:00:57,  1.51it/s]
  8%|▊         | 5498/65536 [1:01:31<10:58:41,  1.52it/s]
  8%|▊         | 5499/65536 [1:01:32<11:01:39,  1.51it/s]
  8%|▊         | 5500/65536 [1:01:33<11:04:53,  1.50it/s]
                                                         
{'loss': 1.142, 'learning_rate': 9.269927758050692e-07, 'epoch': 339.51}

  8%|▊         | 5500/65536 [1:01:33<11:04:53,  1.50it/s]
  8%|▊         | 5501/65536 [1:01:33<11:17:44,  1.48it/s]
  8%|▊         | 5502/65536 [1:01:34<11:00:49,  1.51it/s]
  8%|▊         | 5503/65536 [1:01:35<11:05:09,  1.50it/s]
  8%|▊         | 5504/65536 [1:01:35<11:12:16,  1.49it/s]
  8%|▊         | 5505/65536 [1:01:36<11:09:00,  1.50it/s]
  8%|▊         | 5506/65536 [1:01:37<10:58:01,  1.52it/s]
  8%|▊         | 5507/65536 [1:01:37<10:45:55,  1.55it/s]
  8%|▊         | 5508/65536 [1:01:38<10:37:30,  1.57it/s]
  8%|▊         | 5509/65536 [1:01:38<10:49:47,  1.54it/s]
  8%|▊         | 5510/65536 [1:01:39<11:02:34,  1.51it/s]
  8%|▊         | 5511/65536 [1:01:40<10:56:04,  1.52it/s]
  8%|▊         | 5512/65536 [1:01:40<11:00:47,  1.51it/s]
  8%|▊         | 5513/65536 [1:01:41<11:10:15,  1.49it/s]
  8%|▊         | 5514/65536 [1:01:42<11:08:50,  1.50it/s]
  8%|▊         | 5515/65536 [1:01:42<11:01:20,  1.51it/s]
  8%|▊         | 5516/65536 [1:01:43<11:06:05,  1.50it/s]
  8%|▊         | 5517/65536 [1:01:44<11:12:52,  1.49it/s]
  8%|▊         | 5518/65536 [1:01:45<11:17:43,  1.48it/s]
  8%|▊         | 5519/65536 [1:01:45<11:13:45,  1.48it/s]
  8%|▊         | 5520/65536 [1:01:46<11:10:06,  1.49it/s]
                                                         
{'loss': 1.1358, 'learning_rate': 9.267172768458429e-07, 'epoch': 340.74}

  8%|▊         | 5520/65536 [1:01:46<11:10:06,  1.49it/s]
  8%|▊         | 5521/65536 [1:01:47<11:10:09,  1.49it/s]
  8%|▊         | 5522/65536 [1:01:47<11:23:09,  1.46it/s]
  8%|▊         | 5523/65536 [1:01:48<11:25:37,  1.46it/s]
  8%|▊         | 5524/65536 [1:01:49<11:10:00,  1.49it/s]
  8%|▊         | 5525/65536 [1:01:49<11:25:15,  1.46it/s]
  8%|▊         | 5526/65536 [1:01:50<11:17:01,  1.48it/s]
  8%|▊         | 5527/65536 [1:01:51<11:04:38,  1.50it/s]
  8%|▊         | 5528/65536 [1:01:51<11:16:01,  1.48it/s]
  8%|▊         | 5529/65536 [1:01:52<11:09:39,  1.49it/s]
  8%|▊         | 5530/65536 [1:01:53<11:03:01,  1.51it/s]
  8%|▊         | 5531/65536 [1:01:53<10:55:06,  1.53it/s]
  8%|▊         | 5532/65536 [1:01:54<11:01:53,  1.51it/s]
  8%|▊         | 5533/65536 [1:01:55<10:53:40,  1.53it/s]
  8%|▊         | 5534/65536 [1:01:55<11:04:27,  1.51it/s]
  8%|▊         | 5535/65536 [1:01:56<11:01:17,  1.51it/s]
  8%|▊         | 5536/65536 [1:01:56<10:42:58,  1.56it/s]
  8%|▊         | 5537/65536 [1:01:57<10:51:38,  1.53it/s]
  8%|▊         | 5538/65536 [1:01:58<10:58:36,  1.52it/s]
  8%|▊         | 5539/65536 [1:01:58<11:00:15,  1.51it/s]
  8%|▊         | 5540/65536 [1:01:59<11:18:08,  1.47it/s]
                                                         
{'loss': 1.1637, 'learning_rate': 9.264417778866168e-07, 'epoch': 341.98}

  8%|▊         | 5540/65536 [1:01:59<11:18:08,  1.47it/s]
  8%|▊         | 5541/65536 [1:02:00<11:39:41,  1.43it/s]
  8%|▊         | 5542/65536 [1:02:01<11:21:46,  1.47it/s]
  8%|▊         | 5543/65536 [1:02:01<11:16:01,  1.48it/s]
  8%|▊         | 5544/65536 [1:02:02<11:07:44,  1.50it/s]
  8%|▊         | 5545/65536 [1:02:03<11:05:19,  1.50it/s]
  8%|▊         | 5546/65536 [1:02:03<10:53:38,  1.53it/s]
  8%|▊         | 5547/65536 [1:02:04<11:08:41,  1.50it/s]
  8%|▊         | 5548/65536 [1:02:05<11:13:21,  1.48it/s]
  8%|▊         | 5549/65536 [1:02:05<11:19:56,  1.47it/s]
  8%|▊         | 5550/65536 [1:02:06<11:18:39,  1.47it/s]
  8%|▊         | 5551/65536 [1:02:07<11:01:31,  1.51it/s]
  8%|▊         | 5552/65536 [1:02:07<11:05:58,  1.50it/s]
  8%|▊         | 5553/65536 [1:02:08<11:00:29,  1.51it/s]
  8%|▊         | 5554/65536 [1:02:09<11:11:23,  1.49it/s]
  8%|▊         | 5555/65536 [1:02:09<11:17:39,  1.48it/s]
  8%|▊         | 5556/65536 [1:02:10<11:19:50,  1.47it/s]
  8%|▊         | 5557/65536 [1:02:11<11:31:16,  1.45it/s]
  8%|▊         | 5558/65536 [1:02:11<11:26:14,  1.46it/s]
  8%|▊         | 5559/65536 [1:02:12<11:13:43,  1.48it/s]
  8%|▊         | 5560/65536 [1:02:13<11:28:17,  1.45it/s]
                                                         
{'loss': 1.1323, 'learning_rate': 9.261662789273906e-07, 'epoch': 343.21}

  8%|▊         | 5560/65536 [1:02:13<11:28:17,  1.45it/s]
  8%|▊         | 5561/65536 [1:02:13<11:30:23,  1.45it/s]
  8%|▊         | 5562/65536 [1:02:14<11:24:08,  1.46it/s]
  8%|▊         | 5563/65536 [1:02:15<11:03:05,  1.51it/s]
  8%|▊         | 5564/65536 [1:02:15<11:26:51,  1.46it/s]
  8%|▊         | 5565/65536 [1:02:16<11:09:14,  1.49it/s]
  8%|▊         | 5566/65536 [1:02:17<11:15:32,  1.48it/s]
  8%|▊         | 5567/65536 [1:02:17<11:08:31,  1.50it/s]
  8%|▊         | 5568/65536 [1:02:18<11:07:13,  1.50it/s]
  8%|▊         | 5569/65536 [1:02:19<11:15:37,  1.48it/s]
  8%|▊         | 5570/65536 [1:02:19<11:11:12,  1.49it/s]
  9%|▊         | 5571/65536 [1:02:20<11:03:10,  1.51it/s]
  9%|▊         | 5572/65536 [1:02:21<10:51:13,  1.53it/s]
  9%|▊         | 5573/65536 [1:02:21<11:06:39,  1.50it/s]
  9%|▊         | 5574/65536 [1:02:22<11:06:27,  1.50it/s]
  9%|▊         | 5575/65536 [1:02:23<11:06:33,  1.50it/s]
  9%|▊         | 5576/65536 [1:02:23<11:17:01,  1.48it/s]
  9%|▊         | 5577/65536 [1:02:24<11:13:46,  1.48it/s]
  9%|▊         | 5578/65536 [1:02:25<11:23:58,  1.46it/s]
  9%|▊         | 5579/65536 [1:02:26<11:23:58,  1.46it/s]
  9%|▊         | 5580/65536 [1:02:26<11:26:48,  1.45it/s]
                                                         
{'loss': 1.1233, 'learning_rate': 9.258907799681645e-07, 'epoch': 344.44}

  9%|▊         | 5580/65536 [1:02:26<11:26:48,  1.45it/s]
  9%|▊         | 5581/65536 [1:02:27<11:06:57,  1.50it/s]
  9%|▊         | 5582/65536 [1:02:27<11:08:28,  1.49it/s]
  9%|▊         | 5583/65536 [1:02:28<11:10:13,  1.49it/s]
  9%|▊         | 5584/65536 [1:02:29<11:13:33,  1.48it/s]
  9%|▊         | 5585/65536 [1:02:30<11:35:29,  1.44it/s]
  9%|▊         | 5586/65536 [1:02:30<11:29:44,  1.45it/s]
  9%|▊         | 5587/65536 [1:02:31<11:20:19,  1.47it/s]
  9%|▊         | 5588/65536 [1:02:32<10:58:44,  1.52it/s]
  9%|▊         | 5589/65536 [1:02:32<10:47:46,  1.54it/s]
  9%|▊         | 5590/65536 [1:02:33<11:12:04,  1.49it/s]
  9%|▊         | 5591/65536 [1:02:34<11:10:17,  1.49it/s]
  9%|▊         | 5592/65536 [1:02:34<10:57:17,  1.52it/s]
  9%|▊         | 5593/65536 [1:02:35<11:11:37,  1.49it/s]
  9%|▊         | 5594/65536 [1:02:36<11:12:09,  1.49it/s]
  9%|▊         | 5595/65536 [1:02:36<11:04:56,  1.50it/s]
  9%|▊         | 5596/65536 [1:02:37<11:05:13,  1.50it/s]
  9%|▊         | 5597/65536 [1:02:38<11:24:55,  1.46it/s]
  9%|▊         | 5598/65536 [1:02:38<11:04:35,  1.50it/s]
  9%|▊         | 5599/65536 [1:02:39<11:14:05,  1.48it/s]
  9%|▊         | 5600/65536 [1:02:40<11:28:07,  1.45it/s]
                                                         
{'loss': 1.1131, 'learning_rate': 9.256152810089383e-07, 'epoch': 345.68}

  9%|▊         | 5600/65536 [1:02:40<11:28:07,  1.45it/s]
  9%|▊         | 5601/65536 [1:02:40<11:20:45,  1.47it/s]
  9%|▊         | 5602/65536 [1:02:41<11:08:01,  1.50it/s]
  9%|▊         | 5603/65536 [1:02:42<11:06:03,  1.50it/s]
  9%|▊         | 5604/65536 [1:02:42<10:54:53,  1.53it/s]
  9%|▊         | 5605/65536 [1:02:43<10:59:07,  1.52it/s]
  9%|▊         | 5606/65536 [1:02:44<11:19:50,  1.47it/s]
  9%|▊         | 5607/65536 [1:02:44<11:22:37,  1.46it/s]
  9%|▊         | 5608/65536 [1:02:45<11:38:38,  1.43it/s]
  9%|▊         | 5609/65536 [1:02:46<11:24:11,  1.46it/s]
  9%|▊         | 5610/65536 [1:02:46<11:05:02,  1.50it/s]
  9%|▊         | 5611/65536 [1:02:47<11:16:12,  1.48it/s]
  9%|▊         | 5612/65536 [1:02:48<11:17:45,  1.47it/s]
  9%|▊         | 5613/65536 [1:02:48<10:58:59,  1.52it/s]
  9%|▊         | 5614/65536 [1:02:49<11:04:41,  1.50it/s]
  9%|▊         | 5615/65536 [1:02:50<11:01:50,  1.51it/s]
  9%|▊         | 5616/65536 [1:02:50<11:00:17,  1.51it/s]
  9%|▊         | 5617/65536 [1:02:51<11:04:20,  1.50it/s]
  9%|▊         | 5618/65536 [1:02:52<10:56:24,  1.52it/s]
  9%|▊         | 5619/65536 [1:02:52<10:58:53,  1.52it/s]
  9%|▊         | 5620/65536 [1:02:53<10:49:19,  1.54it/s]
                                                         
{'loss': 1.1353, 'learning_rate': 9.253397820497122e-07, 'epoch': 346.91}

  9%|▊         | 5620/65536 [1:02:53<10:49:19,  1.54it/s]
  9%|▊         | 5621/65536 [1:02:54<10:55:27,  1.52it/s]
  9%|▊         | 5622/65536 [1:02:54<11:14:28,  1.48it/s]
  9%|▊         | 5623/65536 [1:02:55<11:12:04,  1.49it/s]
  9%|▊         | 5624/65536 [1:02:56<10:53:22,  1.53it/s]
  9%|▊         | 5625/65536 [1:02:56<11:07:20,  1.50it/s]
  9%|▊         | 5626/65536 [1:02:57<11:14:23,  1.48it/s]
  9%|▊         | 5627/65536 [1:02:58<10:59:00,  1.52it/s]
  9%|▊         | 5628/65536 [1:02:58<10:54:38,  1.53it/s]
  9%|▊         | 5629/65536 [1:02:59<11:00:05,  1.51it/s]
  9%|▊         | 5630/65536 [1:03:00<10:55:59,  1.52it/s]
  9%|▊         | 5631/65536 [1:03:00<11:06:13,  1.50it/s]
  9%|▊         | 5632/65536 [1:03:01<11:11:38,  1.49it/s]
  9%|▊         | 5633/65536 [1:03:02<11:28:28,  1.45it/s]
  9%|▊         | 5634/65536 [1:03:02<11:35:52,  1.43it/s]
  9%|▊         | 5635/65536 [1:03:03<11:22:04,  1.46it/s]
  9%|▊         | 5636/65536 [1:03:04<11:06:16,  1.50it/s]
  9%|▊         | 5637/65536 [1:03:04<10:56:21,  1.52it/s]
  9%|▊         | 5638/65536 [1:03:05<11:09:49,  1.49it/s]
  9%|▊         | 5639/65536 [1:03:06<10:56:22,  1.52it/s]
  9%|▊         | 5640/65536 [1:03:06<11:15:38,  1.48it/s]
                                                         
{'loss': 1.1398, 'learning_rate': 9.250642830904861e-07, 'epoch': 348.15}

  9%|▊         | 5640/65536 [1:03:06<11:15:38,  1.48it/s]
  9%|▊         | 5641/65536 [1:03:07<11:05:36,  1.50it/s]
  9%|▊         | 5642/65536 [1:03:08<10:58:46,  1.52it/s]
  9%|▊         | 5643/65536 [1:03:08<10:52:47,  1.53it/s]
  9%|▊         | 5644/65536 [1:03:09<10:55:48,  1.52it/s]
  9%|▊         | 5645/65536 [1:03:10<11:01:03,  1.51it/s]
  9%|▊         | 5646/65536 [1:03:10<11:13:42,  1.48it/s]
  9%|▊         | 5647/65536 [1:03:11<11:05:51,  1.50it/s]
  9%|▊         | 5648/65536 [1:03:12<10:54:06,  1.53it/s]
  9%|▊         | 5649/65536 [1:03:12<10:55:59,  1.52it/s]
  9%|▊         | 5650/65536 [1:03:13<10:55:50,  1.52it/s]
  9%|▊         | 5651/65536 [1:03:14<11:05:30,  1.50it/s]
  9%|▊         | 5652/65536 [1:03:14<11:13:36,  1.48it/s]
  9%|▊         | 5653/65536 [1:03:15<11:39:59,  1.43it/s]
  9%|▊         | 5654/65536 [1:03:16<11:54:28,  1.40it/s]
  9%|▊         | 5655/65536 [1:03:17<11:53:32,  1.40it/s]
  9%|▊         | 5656/65536 [1:03:17<11:19:13,  1.47it/s]
  9%|▊         | 5657/65536 [1:03:18<11:43:21,  1.42it/s]
  9%|▊         | 5658/65536 [1:03:19<11:17:55,  1.47it/s]
  9%|▊         | 5659/65536 [1:03:19<11:21:14,  1.46it/s]
  9%|▊         | 5660/65536 [1:03:20<11:08:41,  1.49it/s]
                                                         
{'loss': 1.139, 'learning_rate': 9.247887841312599e-07, 'epoch': 349.38}

  9%|▊         | 5660/65536 [1:03:20<11:08:41,  1.49it/s]
  9%|▊         | 5661/65536 [1:03:21<11:07:48,  1.49it/s]
  9%|▊         | 5662/65536 [1:03:21<11:08:32,  1.49it/s]
  9%|▊         | 5663/65536 [1:03:22<11:20:45,  1.47it/s]
  9%|▊         | 5664/65536 [1:03:23<11:01:00,  1.51it/s]
  9%|▊         | 5665/65536 [1:03:23<10:56:52,  1.52it/s]
  9%|▊         | 5666/65536 [1:03:24<10:59:28,  1.51it/s]
  9%|▊         | 5667/65536 [1:03:24<10:39:46,  1.56it/s]
  9%|▊         | 5668/65536 [1:03:25<10:47:24,  1.54it/s]
  9%|▊         | 5669/65536 [1:03:26<10:56:42,  1.52it/s]
  9%|▊         | 5670/65536 [1:03:26<10:55:47,  1.52it/s]
  9%|▊         | 5671/65536 [1:03:27<11:23:49,  1.46it/s]
  9%|▊         | 5672/65536 [1:03:28<11:36:49,  1.43it/s]
  9%|▊         | 5673/65536 [1:03:29<11:31:08,  1.44it/s]
  9%|▊         | 5674/65536 [1:03:29<11:28:10,  1.45it/s]
  9%|▊         | 5675/65536 [1:03:30<11:21:59,  1.46it/s]
  9%|▊         | 5676/65536 [1:03:31<11:06:45,  1.50it/s]
  9%|▊         | 5677/65536 [1:03:31<11:07:25,  1.49it/s]
  9%|▊         | 5678/65536 [1:03:32<11:02:46,  1.51it/s]
  9%|▊         | 5679/65536 [1:03:33<11:07:21,  1.49it/s]
  9%|▊         | 5680/65536 [1:03:33<10:51:55,  1.53it/s]
                                                         
{'loss': 1.1331, 'learning_rate': 9.245132851720337e-07, 'epoch': 350.62}

  9%|▊         | 5680/65536 [1:03:33<10:51:55,  1.53it/s]
  9%|▊         | 5681/65536 [1:03:34<10:58:47,  1.51it/s]
  9%|▊         | 5682/65536 [1:03:35<10:56:49,  1.52it/s]
  9%|▊         | 5683/65536 [1:03:35<11:16:07,  1.48it/s]
  9%|▊         | 5684/65536 [1:03:36<10:56:53,  1.52it/s]
  9%|▊         | 5685/65536 [1:03:36<10:43:28,  1.55it/s]
  9%|▊         | 5686/65536 [1:03:37<10:57:38,  1.52it/s]
  9%|▊         | 5687/65536 [1:03:38<11:21:17,  1.46it/s]
  9%|▊         | 5688/65536 [1:03:39<11:15:58,  1.48it/s]
  9%|▊         | 5689/65536 [1:03:39<11:25:48,  1.45it/s]
  9%|▊         | 5690/65536 [1:03:40<11:26:32,  1.45it/s]
  9%|▊         | 5691/65536 [1:03:41<11:05:46,  1.50it/s]
  9%|▊         | 5692/65536 [1:03:41<11:14:02,  1.48it/s]
  9%|▊         | 5693/65536 [1:03:42<10:59:21,  1.51it/s]
  9%|▊         | 5694/65536 [1:03:43<10:45:13,  1.55it/s]
  9%|▊         | 5695/65536 [1:03:43<10:53:00,  1.53it/s]
  9%|▊         | 5696/65536 [1:03:44<10:59:24,  1.51it/s]
  9%|▊         | 5697/65536 [1:03:44<10:37:32,  1.56it/s]
  9%|▊         | 5698/65536 [1:03:45<10:41:35,  1.55it/s]
  9%|▊         | 5699/65536 [1:03:46<10:53:53,  1.53it/s]
  9%|▊         | 5700/65536 [1:03:47<11:11:57,  1.48it/s]
                                                         
{'loss': 1.1194, 'learning_rate': 9.242377862128075e-07, 'epoch': 351.85}

  9%|▊         | 5700/65536 [1:03:47<11:11:57,  1.48it/s]
  9%|▊         | 5701/65536 [1:03:47<10:59:47,  1.51it/s]
  9%|▊         | 5702/65536 [1:03:48<11:05:31,  1.50it/s]
  9%|▊         | 5703/65536 [1:03:49<11:19:10,  1.47it/s]
  9%|▊         | 5704/65536 [1:03:49<11:27:58,  1.45it/s]
  9%|▊         | 5705/65536 [1:03:50<11:13:57,  1.48it/s]
  9%|▊         | 5706/65536 [1:03:51<11:17:56,  1.47it/s]
  9%|▊         | 5707/65536 [1:03:51<11:06:13,  1.50it/s]
  9%|▊         | 5708/65536 [1:03:52<10:51:46,  1.53it/s]
  9%|▊         | 5709/65536 [1:03:53<11:11:14,  1.49it/s]
  9%|▊         | 5710/65536 [1:03:53<11:13:21,  1.48it/s]
  9%|▊         | 5711/65536 [1:03:54<11:19:01,  1.47it/s]
  9%|▊         | 5712/65536 [1:03:55<11:33:18,  1.44it/s]
  9%|▊         | 5713/65536 [1:03:55<11:18:54,  1.47it/s]
  9%|▊         | 5714/65536 [1:03:56<11:14:20,  1.48it/s]
  9%|▊         | 5715/65536 [1:03:57<11:26:37,  1.45it/s]
  9%|▊         | 5716/65536 [1:03:57<11:11:31,  1.48it/s]
  9%|▊         | 5717/65536 [1:03:58<10:59:22,  1.51it/s]
  9%|▊         | 5718/65536 [1:03:59<11:06:06,  1.50it/s]
  9%|▊         | 5719/65536 [1:03:59<11:05:26,  1.50it/s]
  9%|▊         | 5720/65536 [1:04:00<10:58:06,  1.51it/s]
                                                         
{'loss': 1.123, 'learning_rate': 9.239622872535814e-07, 'epoch': 353.09}

  9%|▊         | 5720/65536 [1:04:00<10:58:06,  1.51it/s]
  9%|▊         | 5721/65536 [1:04:01<10:54:38,  1.52it/s]
  9%|▊         | 5722/65536 [1:04:01<10:58:25,  1.51it/s]
  9%|▊         | 5723/65536 [1:04:02<10:53:42,  1.52it/s]
  9%|▊         | 5724/65536 [1:04:03<10:51:43,  1.53it/s]
  9%|▊         | 5725/65536 [1:04:03<10:52:42,  1.53it/s]
  9%|▊         | 5726/65536 [1:04:04<11:19:10,  1.47it/s]
  9%|▊         | 5727/65536 [1:04:05<11:18:03,  1.47it/s]
  9%|▊         | 5728/65536 [1:04:05<11:01:33,  1.51it/s]
  9%|▊         | 5729/65536 [1:04:06<11:08:25,  1.49it/s]
  9%|▊         | 5730/65536 [1:04:07<11:16:38,  1.47it/s]
  9%|▊         | 5731/65536 [1:04:07<11:09:31,  1.49it/s]
  9%|▊         | 5732/65536 [1:04:08<11:04:38,  1.50it/s]
  9%|▊         | 5733/65536 [1:04:09<10:58:23,  1.51it/s]
  9%|▊         | 5734/65536 [1:04:09<11:06:30,  1.50it/s]
  9%|▉         | 5735/65536 [1:04:10<11:22:19,  1.46it/s]
  9%|▉         | 5736/65536 [1:04:11<11:06:22,  1.50it/s]
  9%|▉         | 5737/65536 [1:04:11<11:11:49,  1.48it/s]
  9%|▉         | 5738/65536 [1:04:12<11:13:30,  1.48it/s]
  9%|▉         | 5739/65536 [1:04:13<11:04:52,  1.50it/s]
  9%|▉         | 5740/65536 [1:04:13<11:05:07,  1.50it/s]
                                                         
{'loss': 1.1366, 'learning_rate': 9.236867882943551e-07, 'epoch': 354.32}

  9%|▉         | 5740/65536 [1:04:13<11:05:07,  1.50it/s]
  9%|▉         | 5741/65536 [1:04:14<11:03:59,  1.50it/s]
  9%|▉         | 5742/65536 [1:04:15<10:59:22,  1.51it/s]
  9%|▉         | 5743/65536 [1:04:15<10:50:17,  1.53it/s]
  9%|▉         | 5744/65536 [1:04:16<10:56:12,  1.52it/s]
  9%|▉         | 5745/65536 [1:04:17<10:54:45,  1.52it/s]
  9%|▉         | 5746/65536 [1:04:17<11:14:11,  1.48it/s]
  9%|▉         | 5747/65536 [1:04:18<11:01:00,  1.51it/s]
  9%|▉         | 5748/65536 [1:04:19<10:59:47,  1.51it/s]
  9%|▉         | 5749/65536 [1:04:19<11:09:06,  1.49it/s]
  9%|▉         | 5750/65536 [1:04:20<11:01:07,  1.51it/s]
  9%|▉         | 5751/65536 [1:04:21<10:46:55,  1.54it/s]
  9%|▉         | 5752/65536 [1:04:21<11:14:54,  1.48it/s]
  9%|▉         | 5753/65536 [1:04:22<11:20:21,  1.46it/s]
  9%|▉         | 5754/65536 [1:04:23<11:13:18,  1.48it/s]
  9%|▉         | 5755/65536 [1:04:23<11:30:37,  1.44it/s]
  9%|▉         | 5756/65536 [1:04:24<11:21:55,  1.46it/s]
  9%|▉         | 5757/65536 [1:04:25<11:21:29,  1.46it/s]
  9%|▉         | 5758/65536 [1:04:25<11:23:25,  1.46it/s]
  9%|▉         | 5759/65536 [1:04:26<11:14:16,  1.48it/s]
  9%|▉         | 5760/65536 [1:04:27<11:16:45,  1.47it/s]
                                                         
{'loss': 1.1125, 'learning_rate': 9.234112893351291e-07, 'epoch': 355.56}

  9%|▉         | 5760/65536 [1:04:27<11:16:45,  1.47it/s]
  9%|▉         | 5761/65536 [1:04:27<11:05:54,  1.50it/s]
  9%|▉         | 5762/65536 [1:04:28<11:13:00,  1.48it/s]
  9%|▉         | 5763/65536 [1:04:29<10:50:08,  1.53it/s]
  9%|▉         | 5764/65536 [1:04:29<10:36:45,  1.56it/s]
  9%|▉         | 5765/65536 [1:04:30<10:42:04,  1.55it/s]
  9%|▉         | 5766/65536 [1:04:31<10:43:18,  1.55it/s]
  9%|▉         | 5767/65536 [1:04:31<10:43:23,  1.55it/s]
  9%|▉         | 5768/65536 [1:04:32<10:59:11,  1.51it/s]
  9%|▉         | 5769/65536 [1:04:33<10:54:07,  1.52it/s]
  9%|▉         | 5770/65536 [1:04:33<10:54:54,  1.52it/s]
  9%|▉         | 5771/65536 [1:04:34<11:04:08,  1.50it/s]
  9%|▉         | 5772/65536 [1:04:35<10:53:19,  1.52it/s]
  9%|▉         | 5773/65536 [1:04:35<10:57:41,  1.51it/s]
  9%|▉         | 5774/65536 [1:04:36<10:53:24,  1.52it/s]
  9%|▉         | 5775/65536 [1:04:37<10:49:41,  1.53it/s]
  9%|▉         | 5776/65536 [1:04:37<10:28:21,  1.59it/s]
  9%|▉         | 5777/65536 [1:04:38<10:41:50,  1.55it/s]
  9%|▉         | 5778/65536 [1:04:39<11:02:51,  1.50it/s]
  9%|▉         | 5779/65536 [1:04:39<11:21:00,  1.46it/s]
  9%|▉         | 5780/65536 [1:04:40<11:25:40,  1.45it/s]
                                                         
{'loss': 1.1362, 'learning_rate': 9.23135790375903e-07, 'epoch': 356.79}

  9%|▉         | 5780/65536 [1:04:40<11:25:40,  1.45it/s]
  9%|▉         | 5781/65536 [1:04:41<11:10:16,  1.49it/s]
  9%|▉         | 5782/65536 [1:04:41<11:10:14,  1.49it/s]
  9%|▉         | 5783/65536 [1:04:42<11:16:55,  1.47it/s]
  9%|▉         | 5784/65536 [1:04:43<11:37:09,  1.43it/s]
  9%|▉         | 5785/65536 [1:04:43<11:11:48,  1.48it/s]
  9%|▉         | 5786/65536 [1:04:44<11:19:45,  1.46it/s]
  9%|▉         | 5787/65536 [1:04:45<10:59:50,  1.51it/s]
  9%|▉         | 5788/65536 [1:04:45<11:00:32,  1.51it/s]
  9%|▉         | 5789/65536 [1:04:46<11:00:50,  1.51it/s]
  9%|▉         | 5790/65536 [1:04:47<10:51:05,  1.53it/s]
  9%|▉         | 5791/65536 [1:04:47<10:52:52,  1.53it/s]
  9%|▉         | 5792/65536 [1:04:48<10:46:00,  1.54it/s]
  9%|▉         | 5793/65536 [1:04:49<11:21:37,  1.46it/s]
  9%|▉         | 5794/65536 [1:04:49<11:16:17,  1.47it/s]
  9%|▉         | 5795/65536 [1:04:50<11:10:26,  1.49it/s]
  9%|▉         | 5796/65536 [1:04:51<11:03:24,  1.50it/s]
  9%|▉         | 5797/65536 [1:04:51<11:15:39,  1.47it/s]
  9%|▉         | 5798/65536 [1:04:52<11:16:24,  1.47it/s]
  9%|▉         | 5799/65536 [1:04:53<10:58:06,  1.51it/s]
  9%|▉         | 5800/65536 [1:04:53<11:12:23,  1.48it/s]
                                                         
{'loss': 1.1598, 'learning_rate': 9.228602914166768e-07, 'epoch': 358.02}

  9%|▉         | 5800/65536 [1:04:53<11:12:23,  1.48it/s]
  9%|▉         | 5801/65536 [1:04:54<11:09:57,  1.49it/s]
  9%|▉         | 5802/65536 [1:04:55<11:04:28,  1.50it/s]
  9%|▉         | 5803/65536 [1:04:55<11:00:41,  1.51it/s]
  9%|▉         | 5804/65536 [1:04:56<10:58:27,  1.51it/s]
  9%|▉         | 5805/65536 [1:04:57<11:04:50,  1.50it/s]
  9%|▉         | 5806/65536 [1:04:57<11:05:19,  1.50it/s]
  9%|▉         | 5807/65536 [1:04:58<10:55:21,  1.52it/s]
  9%|▉         | 5808/65536 [1:04:59<10:47:09,  1.54it/s]
  9%|▉         | 5809/65536 [1:04:59<10:48:08,  1.54it/s]
  9%|▉         | 5810/65536 [1:05:00<10:58:26,  1.51it/s]
  9%|▉         | 5811/65536 [1:05:01<11:05:17,  1.50it/s]
  9%|▉         | 5812/65536 [1:05:01<11:01:21,  1.51it/s]
  9%|▉         | 5813/65536 [1:05:02<11:28:17,  1.45it/s]
  9%|▉         | 5814/65536 [1:05:03<11:09:08,  1.49it/s]
  9%|▉         | 5815/65536 [1:05:03<11:13:49,  1.48it/s]
  9%|▉         | 5816/65536 [1:05:04<11:14:11,  1.48it/s]
  9%|▉         | 5817/65536 [1:05:05<11:14:53,  1.47it/s]
  9%|▉         | 5818/65536 [1:05:05<11:21:57,  1.46it/s]
  9%|▉         | 5819/65536 [1:05:06<11:25:43,  1.45it/s]
  9%|▉         | 5820/65536 [1:05:07<11:20:44,  1.46it/s]
                                                         
{'loss': 1.1328, 'learning_rate': 9.225847924574507e-07, 'epoch': 359.26}

  9%|▉         | 5820/65536 [1:05:07<11:20:44,  1.46it/s]
  9%|▉         | 5821/65536 [1:05:08<11:23:42,  1.46it/s]
  9%|▉         | 5822/65536 [1:05:08<11:12:31,  1.48it/s]
  9%|▉         | 5823/65536 [1:05:09<11:23:01,  1.46it/s]
  9%|▉         | 5824/65536 [1:05:10<11:18:37,  1.47it/s]
  9%|▉         | 5825/65536 [1:05:10<11:22:57,  1.46it/s]
  9%|▉         | 5826/65536 [1:05:11<10:58:22,  1.51it/s]
  9%|▉         | 5827/65536 [1:05:12<11:05:07,  1.50it/s]
  9%|▉         | 5828/65536 [1:05:12<11:06:32,  1.49it/s]
  9%|▉         | 5829/65536 [1:05:13<10:48:49,  1.53it/s]
  9%|▉         | 5830/65536 [1:05:13<10:59:50,  1.51it/s]
  9%|▉         | 5831/65536 [1:05:14<10:51:10,  1.53it/s]
  9%|▉         | 5832/65536 [1:05:15<10:47:54,  1.54it/s]
  9%|▉         | 5833/65536 [1:05:15<11:01:50,  1.50it/s]
  9%|▉         | 5834/65536 [1:05:16<10:56:17,  1.52it/s]
  9%|▉         | 5835/65536 [1:05:17<10:53:40,  1.52it/s]
  9%|▉         | 5836/65536 [1:05:17<11:03:37,  1.50it/s]
  9%|▉         | 5837/65536 [1:05:18<10:57:51,  1.51it/s]
  9%|▉         | 5838/65536 [1:05:19<10:59:34,  1.51it/s]
  9%|▉         | 5839/65536 [1:05:19<10:52:34,  1.52it/s]
  9%|▉         | 5840/65536 [1:05:20<10:45:47,  1.54it/s]
                                                         
{'loss': 1.14, 'learning_rate': 9.223092934982245e-07, 'epoch': 360.49}

  9%|▉         | 5840/65536 [1:05:20<10:45:47,  1.54it/s]
  9%|▉         | 5841/65536 [1:05:21<10:47:55,  1.54it/s]
  9%|▉         | 5842/65536 [1:05:21<10:41:57,  1.55it/s]
  9%|▉         | 5843/65536 [1:05:22<11:01:01,  1.51it/s]
  9%|▉         | 5844/65536 [1:05:23<11:11:14,  1.48it/s]
  9%|▉         | 5845/65536 [1:05:23<11:31:48,  1.44it/s]
  9%|▉         | 5846/65536 [1:05:24<11:28:51,  1.44it/s]
  9%|▉         | 5847/65536 [1:05:25<11:09:46,  1.49it/s]
  9%|▉         | 5848/65536 [1:05:26<11:22:53,  1.46it/s]
  9%|▉         | 5849/65536 [1:05:26<11:52:48,  1.40it/s]
  9%|▉         | 5850/65536 [1:05:27<11:32:46,  1.44it/s]
  9%|▉         | 5851/65536 [1:05:28<11:25:28,  1.45it/s]
  9%|▉         | 5852/65536 [1:05:28<11:10:51,  1.48it/s]
  9%|▉         | 5853/65536 [1:05:29<10:51:29,  1.53it/s]
  9%|▉         | 5854/65536 [1:05:30<10:49:00,  1.53it/s]
  9%|▉         | 5855/65536 [1:05:30<10:35:45,  1.56it/s]
  9%|▉         | 5856/65536 [1:05:31<11:16:48,  1.47it/s]
  9%|▉         | 5857/65536 [1:05:32<11:13:37,  1.48it/s]
  9%|▉         | 5858/65536 [1:05:32<11:19:04,  1.46it/s]
  9%|▉         | 5859/65536 [1:05:33<11:18:23,  1.47it/s]
  9%|▉         | 5860/65536 [1:05:34<11:18:09,  1.47it/s]
                                                         
{'loss': 1.0972, 'learning_rate': 9.220337945389984e-07, 'epoch': 361.73}

  9%|▉         | 5860/65536 [1:05:34<11:18:09,  1.47it/s]
  9%|▉         | 5861/65536 [1:05:34<11:10:15,  1.48it/s]
  9%|▉         | 5862/65536 [1:05:35<11:04:26,  1.50it/s]
  9%|▉         | 5863/65536 [1:05:36<11:05:18,  1.49it/s]
  9%|▉         | 5864/65536 [1:05:36<11:03:04,  1.50it/s]
  9%|▉         | 5865/65536 [1:05:37<11:16:42,  1.47it/s]
  9%|▉         | 5866/65536 [1:05:38<11:08:33,  1.49it/s]
  9%|▉         | 5867/65536 [1:05:38<10:54:52,  1.52it/s]
  9%|▉         | 5868/65536 [1:05:39<11:01:41,  1.50it/s]
  9%|▉         | 5869/65536 [1:05:40<11:03:11,  1.50it/s]
  9%|▉         | 5870/65536 [1:05:40<10:58:10,  1.51it/s]
  9%|▉         | 5871/65536 [1:05:41<11:02:37,  1.50it/s]
  9%|▉         | 5872/65536 [1:05:42<11:31:49,  1.44it/s]
  9%|▉         | 5873/65536 [1:05:42<11:23:37,  1.45it/s]
  9%|▉         | 5874/65536 [1:05:43<11:13:08,  1.48it/s]
  9%|▉         | 5875/65536 [1:05:44<11:20:31,  1.46it/s]
  9%|▉         | 5876/65536 [1:05:44<11:10:36,  1.48it/s]
  9%|▉         | 5877/65536 [1:05:45<10:52:59,  1.52it/s]
  9%|▉         | 5878/65536 [1:05:46<10:43:04,  1.55it/s]
  9%|▉         | 5879/65536 [1:05:46<11:08:41,  1.49it/s]
  9%|▉         | 5880/65536 [1:05:47<11:04:12,  1.50it/s]
                                                         
{'loss': 1.1163, 'learning_rate': 9.217582955797723e-07, 'epoch': 362.96}

  9%|▉         | 5880/65536 [1:05:47<11:04:12,  1.50it/s]
  9%|▉         | 5881/65536 [1:05:48<11:27:28,  1.45it/s]
  9%|▉         | 5882/65536 [1:05:48<11:16:33,  1.47it/s]
  9%|▉         | 5883/65536 [1:05:49<11:14:55,  1.47it/s]
  9%|▉         | 5884/65536 [1:05:50<11:06:03,  1.49it/s]
  9%|▉         | 5885/65536 [1:05:50<11:04:32,  1.50it/s]
  9%|▉         | 5886/65536 [1:05:51<10:53:47,  1.52it/s]
  9%|▉         | 5887/65536 [1:05:52<11:01:03,  1.50it/s]
  9%|▉         | 5888/65536 [1:05:52<11:00:25,  1.51it/s]
  9%|▉         | 5889/65536 [1:05:53<11:23:08,  1.46it/s]
  9%|▉         | 5890/65536 [1:05:54<11:17:35,  1.47it/s]
  9%|▉         | 5891/65536 [1:05:54<10:46:59,  1.54it/s]
  9%|▉         | 5892/65536 [1:05:55<10:55:05,  1.52it/s]
  9%|▉         | 5893/65536 [1:05:56<10:56:47,  1.51it/s]
  9%|▉         | 5894/65536 [1:05:56<11:03:44,  1.50it/s]
  9%|▉         | 5895/65536 [1:05:57<10:57:21,  1.51it/s]
  9%|▉         | 5896/65536 [1:05:58<11:07:16,  1.49it/s]
  9%|▉         | 5897/65536 [1:05:58<11:22:00,  1.46it/s]
  9%|▉         | 5898/65536 [1:05:59<11:23:02,  1.46it/s]
  9%|▉         | 5899/65536 [1:06:00<11:10:18,  1.48it/s]
  9%|▉         | 5900/65536 [1:06:00<11:08:22,  1.49it/s]
                                                         
{'loss': 1.1319, 'learning_rate': 9.214827966205461e-07, 'epoch': 364.2}

  9%|▉         | 5900/65536 [1:06:00<11:08:22,  1.49it/s]
  9%|▉         | 5901/65536 [1:06:01<11:19:17,  1.46it/s]
  9%|▉         | 5902/65536 [1:06:02<11:08:35,  1.49it/s]
  9%|▉         | 5903/65536 [1:06:02<10:56:37,  1.51it/s]
  9%|▉         | 5904/65536 [1:06:03<11:04:17,  1.50it/s]
  9%|▉         | 5905/65536 [1:06:04<11:08:26,  1.49it/s]
  9%|▉         | 5906/65536 [1:06:04<11:00:08,  1.51it/s]
  9%|▉         | 5907/65536 [1:06:05<10:50:13,  1.53it/s]
  9%|▉         | 5908/65536 [1:06:06<10:55:57,  1.52it/s]
  9%|▉         | 5909/65536 [1:06:07<11:20:57,  1.46it/s]
  9%|▉         | 5910/65536 [1:06:07<11:27:28,  1.45it/s]
  9%|▉         | 5911/65536 [1:06:08<11:25:07,  1.45it/s]
  9%|▉         | 5912/65536 [1:06:09<11:06:11,  1.49it/s]
  9%|▉         | 5913/65536 [1:06:09<10:50:48,  1.53it/s]
  9%|▉         | 5914/65536 [1:06:10<11:23:55,  1.45it/s]
  9%|▉         | 5915/65536 [1:06:11<10:59:42,  1.51it/s]
  9%|▉         | 5916/65536 [1:06:11<10:51:23,  1.53it/s]
  9%|▉         | 5917/65536 [1:06:12<10:46:46,  1.54it/s]
  9%|▉         | 5918/65536 [1:06:12<11:01:46,  1.50it/s]
  9%|▉         | 5919/65536 [1:06:13<10:58:18,  1.51it/s]
  9%|▉         | 5920/65536 [1:06:14<11:20:17,  1.46it/s]
                                                         
{'loss': 1.1174, 'learning_rate': 9.2120729766132e-07, 'epoch': 365.43}

  9%|▉         | 5920/65536 [1:06:14<11:20:17,  1.46it/s]
  9%|▉         | 5921/65536 [1:06:15<11:26:29,  1.45it/s]
  9%|▉         | 5922/65536 [1:06:15<11:24:35,  1.45it/s]
  9%|▉         | 5923/65536 [1:06:16<11:25:31,  1.45it/s]
  9%|▉         | 5924/65536 [1:06:17<11:13:28,  1.48it/s]
  9%|▉         | 5925/65536 [1:06:17<11:07:56,  1.49it/s]
  9%|▉         | 5926/65536 [1:06:18<10:57:55,  1.51it/s]
  9%|▉         | 5927/65536 [1:06:19<10:44:54,  1.54it/s]
  9%|▉         | 5928/65536 [1:06:19<10:48:49,  1.53it/s]
  9%|▉         | 5929/65536 [1:06:20<10:47:12,  1.53it/s]
  9%|▉         | 5930/65536 [1:06:21<11:00:23,  1.50it/s]
  9%|▉         | 5931/65536 [1:06:21<10:50:52,  1.53it/s]
  9%|▉         | 5932/65536 [1:06:22<10:54:59,  1.52it/s]
  9%|▉         | 5933/65536 [1:06:23<11:10:31,  1.48it/s]
  9%|▉         | 5934/65536 [1:06:23<11:02:22,  1.50it/s]
  9%|▉         | 5935/65536 [1:06:24<11:06:38,  1.49it/s]
  9%|▉         | 5936/65536 [1:06:25<11:23:29,  1.45it/s]
  9%|▉         | 5937/65536 [1:06:25<11:14:25,  1.47it/s]
  9%|▉         | 5938/65536 [1:06:26<11:20:19,  1.46it/s]
  9%|▉         | 5939/65536 [1:06:27<11:12:15,  1.48it/s]
  9%|▉         | 5940/65536 [1:06:27<11:14:08,  1.47it/s]
                                                         
{'loss': 1.1175, 'learning_rate': 9.209317987020937e-07, 'epoch': 366.67}

  9%|▉         | 5940/65536 [1:06:27<11:14:08,  1.47it/s]
  9%|▉         | 5941/65536 [1:06:28<11:12:39,  1.48it/s]
  9%|▉         | 5942/65536 [1:06:29<11:04:22,  1.49it/s]
  9%|▉         | 5943/65536 [1:06:29<11:05:27,  1.49it/s]
  9%|▉         | 5944/65536 [1:06:30<11:00:02,  1.50it/s]
  9%|▉         | 5945/65536 [1:06:31<10:58:56,  1.51it/s]
  9%|▉         | 5946/65536 [1:06:31<11:06:37,  1.49it/s]
  9%|▉         | 5947/65536 [1:06:32<11:15:09,  1.47it/s]
  9%|▉         | 5948/65536 [1:06:33<11:02:55,  1.50it/s]
  9%|▉         | 5949/65536 [1:06:33<10:48:03,  1.53it/s]
  9%|▉         | 5950/65536 [1:06:34<11:05:33,  1.49it/s]
  9%|▉         | 5951/65536 [1:06:35<10:54:57,  1.52it/s]
  9%|▉         | 5952/65536 [1:06:35<10:55:56,  1.51it/s]
  9%|▉         | 5953/65536 [1:06:36<10:52:12,  1.52it/s]
  9%|▉         | 5954/65536 [1:06:37<11:00:52,  1.50it/s]
  9%|▉         | 5955/65536 [1:06:37<10:58:00,  1.51it/s]
  9%|▉         | 5956/65536 [1:06:38<10:59:56,  1.50it/s]
  9%|▉         | 5957/65536 [1:06:39<10:58:23,  1.51it/s]
  9%|▉         | 5958/65536 [1:06:39<10:59:15,  1.51it/s]
  9%|▉         | 5959/65536 [1:06:40<11:27:43,  1.44it/s]
  9%|▉         | 5960/65536 [1:06:41<11:35:04,  1.43it/s]
                                                         
{'loss': 1.1006, 'learning_rate': 9.206562997428676e-07, 'epoch': 367.9}

  9%|▉         | 5960/65536 [1:06:41<11:35:04,  1.43it/s]
  9%|▉         | 5961/65536 [1:06:41<11:22:05,  1.46it/s]
  9%|▉         | 5962/65536 [1:06:42<11:19:44,  1.46it/s]
  9%|▉         | 5963/65536 [1:06:43<11:07:33,  1.49it/s]
  9%|▉         | 5964/65536 [1:06:43<11:19:12,  1.46it/s]
  9%|▉         | 5965/65536 [1:06:44<11:06:05,  1.49it/s]
  9%|▉         | 5966/65536 [1:06:45<11:11:03,  1.48it/s]
  9%|▉         | 5967/65536 [1:06:45<10:54:04,  1.52it/s]
  9%|▉         | 5968/65536 [1:06:46<11:04:55,  1.49it/s]
  9%|▉         | 5969/65536 [1:06:47<11:04:26,  1.49it/s]
  9%|▉         | 5970/65536 [1:06:47<11:05:33,  1.49it/s]
  9%|▉         | 5971/65536 [1:06:48<11:04:37,  1.49it/s]
  9%|▉         | 5972/65536 [1:06:49<10:52:47,  1.52it/s]
  9%|▉         | 5973/65536 [1:06:49<10:49:41,  1.53it/s]
  9%|▉         | 5974/65536 [1:06:50<11:12:17,  1.48it/s]
  9%|▉         | 5975/65536 [1:06:51<10:46:25,  1.54it/s]
  9%|▉         | 5976/65536 [1:06:51<11:00:42,  1.50it/s]
  9%|▉         | 5977/65536 [1:06:52<10:59:49,  1.50it/s]
  9%|▉         | 5978/65536 [1:06:53<11:26:21,  1.45it/s]
  9%|▉         | 5979/65536 [1:06:54<11:34:22,  1.43it/s]
  9%|▉         | 5980/65536 [1:06:54<11:29:25,  1.44it/s]
                                                         
{'loss': 1.1215, 'learning_rate': 9.203808007836415e-07, 'epoch': 369.14}

  9%|▉         | 5980/65536 [1:06:54<11:29:25,  1.44it/s]
  9%|▉         | 5981/65536 [1:06:55<11:11:29,  1.48it/s]
  9%|▉         | 5982/65536 [1:06:55<10:59:26,  1.51it/s]
  9%|▉         | 5983/65536 [1:06:56<11:10:49,  1.48it/s]
  9%|▉         | 5984/65536 [1:06:57<10:54:36,  1.52it/s]
  9%|▉         | 5985/65536 [1:06:58<11:14:53,  1.47it/s]
  9%|▉         | 5986/65536 [1:06:58<10:54:12,  1.52it/s]
  9%|▉         | 5987/65536 [1:06:59<10:55:31,  1.51it/s]
  9%|▉         | 5988/65536 [1:06:59<11:05:57,  1.49it/s]
  9%|▉         | 5989/65536 [1:07:00<11:05:31,  1.49it/s]
  9%|▉         | 5990/65536 [1:07:01<11:04:17,  1.49it/s]
  9%|▉         | 5991/65536 [1:07:01<10:58:20,  1.51it/s]
  9%|▉         | 5992/65536 [1:07:02<10:57:55,  1.51it/s]
  9%|▉         | 5993/65536 [1:07:03<11:16:34,  1.47it/s]
  9%|▉         | 5994/65536 [1:07:04<11:09:46,  1.48it/s]
  9%|▉         | 5995/65536 [1:07:04<11:31:41,  1.43it/s]
  9%|▉         | 5996/65536 [1:07:05<11:27:07,  1.44it/s]
  9%|▉         | 5997/65536 [1:07:06<11:14:33,  1.47it/s]
  9%|▉         | 5998/65536 [1:07:06<11:14:36,  1.47it/s]
  9%|▉         | 5999/65536 [1:07:07<11:09:13,  1.48it/s]
  9%|▉         | 6000/65536 [1:07:08<11:05:50,  1.49it/s]
                                                         
{'loss': 1.1241, 'learning_rate': 9.201053018244152e-07, 'epoch': 370.37}

  9%|▉         | 6000/65536 [1:07:08<11:05:50,  1.49it/s]
  9%|▉         | 6001/65536 [1:07:08<11:02:34,  1.50it/s]
  9%|▉         | 6002/65536 [1:07:09<11:10:13,  1.48it/s]
  9%|▉         | 6003/65536 [1:07:10<11:05:44,  1.49it/s]
  9%|▉         | 6004/65536 [1:07:10<11:07:33,  1.49it/s]
  9%|▉         | 6005/65536 [1:07:11<10:54:02,  1.52it/s]
  9%|▉         | 6006/65536 [1:07:12<10:55:06,  1.51it/s]
  9%|▉         | 6007/65536 [1:07:12<10:59:15,  1.50it/s]
  9%|▉         | 6008/65536 [1:07:13<10:58:13,  1.51it/s]
  9%|▉         | 6009/65536 [1:07:14<11:06:55,  1.49it/s]
  9%|▉         | 6010/65536 [1:07:14<11:31:01,  1.44it/s]
  9%|▉         | 6011/65536 [1:07:15<11:47:18,  1.40it/s]
  9%|▉         | 6012/65536 [1:07:16<11:35:24,  1.43it/s]
  9%|▉         | 6013/65536 [1:07:16<11:13:09,  1.47it/s]
  9%|▉         | 6014/65536 [1:07:17<10:58:40,  1.51it/s]
  9%|▉         | 6015/65536 [1:07:18<11:08:05,  1.48it/s]
  9%|▉         | 6016/65536 [1:07:18<10:45:34,  1.54it/s]
  9%|▉         | 6017/65536 [1:07:19<10:47:46,  1.53it/s]
  9%|▉         | 6018/65536 [1:07:20<11:02:54,  1.50it/s]
  9%|▉         | 6019/65536 [1:07:20<11:04:30,  1.49it/s]
  9%|▉         | 6020/65536 [1:07:21<11:07:16,  1.49it/s]
                                                         
{'loss': 1.0916, 'learning_rate': 9.198298028651892e-07, 'epoch': 371.6}

  9%|▉         | 6020/65536 [1:07:21<11:07:16,  1.49it/s]
  9%|▉         | 6021/65536 [1:07:22<11:22:56,  1.45it/s]
  9%|▉         | 6022/65536 [1:07:22<11:12:54,  1.47it/s]
  9%|▉         | 6023/65536 [1:07:23<11:13:45,  1.47it/s]
  9%|▉         | 6024/65536 [1:07:24<10:57:07,  1.51it/s]
  9%|▉         | 6025/65536 [1:07:24<11:23:19,  1.45it/s]
  9%|▉         | 6026/65536 [1:07:25<11:27:58,  1.44it/s]
  9%|▉         | 6027/65536 [1:07:26<11:21:26,  1.46it/s]
  9%|▉         | 6028/65536 [1:07:27<11:13:51,  1.47it/s]
  9%|▉         | 6029/65536 [1:07:27<11:07:07,  1.49it/s]
  9%|▉         | 6030/65536 [1:07:28<10:52:00,  1.52it/s]
  9%|▉         | 6031/65536 [1:07:29<11:04:58,  1.49it/s]
  9%|▉         | 6032/65536 [1:07:29<11:17:24,  1.46it/s]
  9%|▉         | 6033/65536 [1:07:30<11:20:29,  1.46it/s]
  9%|▉         | 6034/65536 [1:07:31<11:23:34,  1.45it/s]
  9%|▉         | 6035/65536 [1:07:31<11:14:24,  1.47it/s]
  9%|▉         | 6036/65536 [1:07:32<11:00:58,  1.50it/s]
  9%|▉         | 6037/65536 [1:07:33<11:07:42,  1.49it/s]
  9%|▉         | 6038/65536 [1:07:33<10:50:45,  1.52it/s]
  9%|▉         | 6039/65536 [1:07:34<10:57:23,  1.51it/s]
  9%|▉         | 6040/65536 [1:07:35<11:09:55,  1.48it/s]
                                                         
{'loss': 1.093, 'learning_rate': 9.19554303905963e-07, 'epoch': 372.84}

  9%|▉         | 6040/65536 [1:07:35<11:09:55,  1.48it/s]
  9%|▉         | 6041/65536 [1:07:35<10:58:09,  1.51it/s]
  9%|▉         | 6042/65536 [1:07:36<10:50:44,  1.52it/s]
  9%|▉         | 6043/65536 [1:07:37<11:06:32,  1.49it/s]
  9%|▉         | 6044/65536 [1:07:37<11:23:40,  1.45it/s]
  9%|▉         | 6045/65536 [1:07:38<11:06:02,  1.49it/s]
  9%|▉         | 6046/65536 [1:07:39<11:06:14,  1.49it/s]
  9%|▉         | 6047/65536 [1:07:39<10:58:51,  1.50it/s]
  9%|▉         | 6048/65536 [1:07:40<10:57:07,  1.51it/s]
  9%|▉         | 6049/65536 [1:07:41<11:03:23,  1.49it/s]
  9%|▉         | 6050/65536 [1:07:41<10:59:46,  1.50it/s]
  9%|▉         | 6051/65536 [1:07:42<11:12:25,  1.47it/s]
  9%|▉         | 6052/65536 [1:07:43<10:56:08,  1.51it/s]
  9%|▉         | 6053/65536 [1:07:43<11:03:11,  1.49it/s]
  9%|▉         | 6054/65536 [1:07:44<11:16:36,  1.47it/s]
  9%|▉         | 6055/65536 [1:07:45<11:06:20,  1.49it/s]
  9%|▉         | 6056/65536 [1:07:45<11:00:27,  1.50it/s]
  9%|▉         | 6057/65536 [1:07:46<10:39:37,  1.55it/s]
  9%|▉         | 6058/65536 [1:07:47<10:39:51,  1.55it/s]
  9%|▉         | 6059/65536 [1:07:47<10:52:14,  1.52it/s]
  9%|▉         | 6060/65536 [1:07:48<10:49:39,  1.53it/s]
                                                         
{'loss': 1.158, 'learning_rate': 9.192788049467368e-07, 'epoch': 374.07}

  9%|▉         | 6060/65536 [1:07:48<10:49:39,  1.53it/s]
  9%|▉         | 6061/65536 [1:07:49<11:02:11,  1.50it/s]
  9%|▉         | 6062/65536 [1:07:49<11:00:56,  1.50it/s]
  9%|▉         | 6063/65536 [1:07:50<10:52:07,  1.52it/s]
  9%|▉         | 6064/65536 [1:07:51<10:58:19,  1.51it/s]
  9%|▉         | 6065/65536 [1:07:51<11:09:58,  1.48it/s]
  9%|▉         | 6066/65536 [1:07:52<10:56:20,  1.51it/s]
  9%|▉         | 6067/65536 [1:07:53<10:49:39,  1.53it/s]
  9%|▉         | 6068/65536 [1:07:53<10:42:58,  1.54it/s]
  9%|▉         | 6069/65536 [1:07:54<10:55:46,  1.51it/s]
  9%|▉         | 6070/65536 [1:07:55<11:22:02,  1.45it/s]
  9%|▉         | 6071/65536 [1:07:55<11:22:27,  1.45it/s]
  9%|▉         | 6072/65536 [1:07:56<11:14:24,  1.47it/s]
  9%|▉         | 6073/65536 [1:07:57<11:12:04,  1.47it/s]
  9%|▉         | 6074/65536 [1:07:57<11:11:55,  1.47it/s]
  9%|▉         | 6075/65536 [1:07:58<11:12:00,  1.47it/s]
  9%|▉         | 6076/65536 [1:07:59<11:29:47,  1.44it/s]
  9%|▉         | 6077/65536 [1:07:59<11:34:22,  1.43it/s]
  9%|▉         | 6078/65536 [1:08:00<11:20:59,  1.46it/s]
  9%|▉         | 6079/65536 [1:08:01<11:17:48,  1.46it/s]
  9%|▉         | 6080/65536 [1:08:01<11:09:35,  1.48it/s]
                                                         
{'loss': 1.0833, 'learning_rate': 9.190033059875106e-07, 'epoch': 375.31}

  9%|▉         | 6080/65536 [1:08:01<11:09:35,  1.48it/s]
  9%|▉         | 6081/65536 [1:08:02<11:20:11,  1.46it/s]
  9%|▉         | 6082/65536 [1:08:03<11:17:06,  1.46it/s]
  9%|▉         | 6083/65536 [1:08:03<11:01:28,  1.50it/s]
  9%|▉         | 6084/65536 [1:08:04<11:33:56,  1.43it/s]
  9%|▉         | 6085/65536 [1:08:05<11:20:41,  1.46it/s]
  9%|▉         | 6086/65536 [1:08:05<11:05:51,  1.49it/s]
  9%|▉         | 6087/65536 [1:08:06<10:56:56,  1.51it/s]
  9%|▉         | 6088/65536 [1:08:07<10:49:54,  1.52it/s]
  9%|▉         | 6089/65536 [1:08:07<10:59:48,  1.50it/s]
  9%|▉         | 6090/65536 [1:08:08<11:11:28,  1.48it/s]
  9%|▉         | 6091/65536 [1:08:09<11:01:14,  1.50it/s]
  9%|▉         | 6092/65536 [1:08:10<11:13:11,  1.47it/s]
  9%|▉         | 6093/65536 [1:08:10<10:58:42,  1.50it/s]
  9%|▉         | 6094/65536 [1:08:11<10:56:40,  1.51it/s]
  9%|▉         | 6095/65536 [1:08:11<10:56:08,  1.51it/s]
  9%|▉         | 6096/65536 [1:08:12<10:41:49,  1.54it/s]
  9%|▉         | 6097/65536 [1:08:13<11:07:43,  1.48it/s]
  9%|▉         | 6098/65536 [1:08:14<11:11:48,  1.47it/s]
  9%|▉         | 6099/65536 [1:08:14<11:07:30,  1.48it/s]
  9%|▉         | 6100/65536 [1:08:15<11:34:23,  1.43it/s]
                                                         
{'loss': 1.1005, 'learning_rate': 9.187278070282845e-07, 'epoch': 376.54}

  9%|▉         | 6100/65536 [1:08:15<11:34:23,  1.43it/s]
  9%|▉         | 6101/65536 [1:08:16<11:20:48,  1.45it/s]
  9%|▉         | 6102/65536 [1:08:16<11:19:26,  1.46it/s]
  9%|▉         | 6103/65536 [1:08:17<10:50:08,  1.52it/s]
  9%|▉         | 6104/65536 [1:08:18<10:51:31,  1.52it/s]
  9%|▉         | 6105/65536 [1:08:18<11:14:31,  1.47it/s]
  9%|▉         | 6106/65536 [1:08:19<11:03:50,  1.49it/s]
  9%|▉         | 6107/65536 [1:08:20<10:59:38,  1.50it/s]
  9%|▉         | 6108/65536 [1:08:20<11:11:53,  1.47it/s]
  9%|▉         | 6109/65536 [1:08:21<11:11:13,  1.48it/s]
  9%|▉         | 6110/65536 [1:08:22<11:08:14,  1.48it/s]
  9%|▉         | 6111/65536 [1:08:22<10:52:45,  1.52it/s]
  9%|▉         | 6112/65536 [1:08:23<10:58:10,  1.50it/s]
  9%|▉         | 6113/65536 [1:08:24<10:53:10,  1.52it/s]
  9%|▉         | 6114/65536 [1:08:24<10:41:15,  1.54it/s]
  9%|▉         | 6115/65536 [1:08:25<10:51:21,  1.52it/s]
  9%|▉         | 6116/65536 [1:08:26<10:51:01,  1.52it/s]
  9%|▉         | 6117/65536 [1:08:26<11:01:59,  1.50it/s]
  9%|▉         | 6118/65536 [1:08:27<11:07:10,  1.48it/s]
  9%|▉         | 6119/65536 [1:08:28<10:55:39,  1.51it/s]
  9%|▉         | 6120/65536 [1:08:28<11:16:25,  1.46it/s]
                                                         
{'loss': 1.1336, 'learning_rate': 9.184523080690584e-07, 'epoch': 377.78}

  9%|▉         | 6120/65536 [1:08:28<11:16:25,  1.46it/s]
  9%|▉         | 6121/65536 [1:08:29<11:07:24,  1.48it/s]
  9%|▉         | 6122/65536 [1:08:30<10:48:54,  1.53it/s]
  9%|▉         | 6123/65536 [1:08:30<10:50:14,  1.52it/s]
  9%|▉         | 6124/65536 [1:08:31<11:03:03,  1.49it/s]
  9%|▉         | 6125/65536 [1:08:32<11:21:01,  1.45it/s]
  9%|▉         | 6126/65536 [1:08:32<11:08:42,  1.48it/s]
  9%|▉         | 6127/65536 [1:08:33<11:06:57,  1.48it/s]
  9%|▉         | 6128/65536 [1:08:34<11:02:48,  1.49it/s]
  9%|▉         | 6129/65536 [1:08:34<11:17:20,  1.46it/s]
  9%|▉         | 6130/65536 [1:08:35<11:19:10,  1.46it/s]
  9%|▉         | 6131/65536 [1:08:36<11:12:25,  1.47it/s]
  9%|▉         | 6132/65536 [1:08:36<11:06:02,  1.49it/s]
  9%|▉         | 6133/65536 [1:08:37<11:03:59,  1.49it/s]
  9%|▉         | 6134/65536 [1:08:38<11:15:24,  1.47it/s]
  9%|▉         | 6135/65536 [1:08:38<11:07:52,  1.48it/s]
  9%|▉         | 6136/65536 [1:08:39<10:57:56,  1.50it/s]
  9%|▉         | 6137/65536 [1:08:40<10:52:35,  1.52it/s]
  9%|▉         | 6138/65536 [1:08:40<10:36:38,  1.55it/s]
  9%|▉         | 6139/65536 [1:08:41<10:43:47,  1.54it/s]
  9%|▉         | 6140/65536 [1:08:42<10:52:59,  1.52it/s]
                                                         
{'loss': 1.1173, 'learning_rate': 9.181768091098322e-07, 'epoch': 379.01}

  9%|▉         | 6140/65536 [1:08:42<10:52:59,  1.52it/s]
  9%|▉         | 6141/65536 [1:08:42<11:04:44,  1.49it/s]
  9%|▉         | 6142/65536 [1:08:43<11:07:34,  1.48it/s]
  9%|▉         | 6143/65536 [1:08:44<11:06:09,  1.49it/s]
  9%|▉         | 6144/65536 [1:08:44<10:58:00,  1.50it/s]
  9%|▉         | 6145/65536 [1:08:45<10:46:43,  1.53it/s]
  9%|▉         | 6146/65536 [1:08:46<10:43:41,  1.54it/s]
  9%|▉         | 6147/65536 [1:08:46<10:47:17,  1.53it/s]
  9%|▉         | 6148/65536 [1:08:47<10:35:43,  1.56it/s]
  9%|▉         | 6149/65536 [1:08:48<10:49:50,  1.52it/s]
  9%|▉         | 6150/65536 [1:08:48<10:59:15,  1.50it/s]
  9%|▉         | 6151/65536 [1:08:49<11:09:57,  1.48it/s]
  9%|▉         | 6152/65536 [1:08:50<11:19:19,  1.46it/s]
  9%|▉         | 6153/65536 [1:08:50<11:28:49,  1.44it/s]
  9%|▉         | 6154/65536 [1:08:51<11:30:07,  1.43it/s]
  9%|▉         | 6155/65536 [1:08:52<11:15:46,  1.46it/s]
  9%|▉         | 6156/65536 [1:08:52<11:09:24,  1.48it/s]
  9%|▉         | 6157/65536 [1:08:53<11:15:14,  1.47it/s]
  9%|▉         | 6158/65536 [1:08:54<11:12:06,  1.47it/s]
  9%|▉         | 6159/65536 [1:08:54<11:16:39,  1.46it/s]
  9%|▉         | 6160/65536 [1:08:55<11:07:57,  1.48it/s]
                                                         
{'loss': 1.0928, 'learning_rate': 9.179013101506061e-07, 'epoch': 380.25}

  9%|▉         | 6160/65536 [1:08:55<11:07:57,  1.48it/s]
  9%|▉         | 6161/65536 [1:08:56<10:59:59,  1.50it/s]
  9%|▉         | 6162/65536 [1:08:56<11:17:08,  1.46it/s]
  9%|▉         | 6163/65536 [1:08:57<11:09:22,  1.48it/s]
  9%|▉         | 6164/65536 [1:08:58<11:07:32,  1.48it/s]
  9%|▉         | 6165/65536 [1:08:58<11:05:39,  1.49it/s]
  9%|▉         | 6166/65536 [1:08:59<10:53:28,  1.51it/s]
  9%|▉         | 6167/65536 [1:09:00<10:51:23,  1.52it/s]
  9%|▉         | 6168/65536 [1:09:00<10:56:21,  1.51it/s]
  9%|▉         | 6169/65536 [1:09:01<10:55:27,  1.51it/s]
  9%|▉         | 6170/65536 [1:09:02<10:58:34,  1.50it/s]
  9%|▉         | 6171/65536 [1:09:02<11:03:04,  1.49it/s]
  9%|▉         | 6172/65536 [1:09:03<11:23:55,  1.45it/s]
  9%|▉         | 6173/65536 [1:09:04<11:26:06,  1.44it/s]
  9%|▉         | 6174/65536 [1:09:05<11:14:26,  1.47it/s]
  9%|▉         | 6175/65536 [1:09:05<11:03:16,  1.49it/s]
  9%|▉         | 6176/65536 [1:09:06<10:56:48,  1.51it/s]
  9%|▉         | 6177/65536 [1:09:06<10:51:27,  1.52it/s]
  9%|▉         | 6178/65536 [1:09:07<11:41:59,  1.41it/s]
  9%|▉         | 6179/65536 [1:09:08<11:14:36,  1.47it/s]
  9%|▉         | 6180/65536 [1:09:09<11:05:15,  1.49it/s]
                                                         
{'loss': 1.1037, 'learning_rate': 9.176258111913799e-07, 'epoch': 381.48}

  9%|▉         | 6180/65536 [1:09:09<11:05:15,  1.49it/s]
  9%|▉         | 6181/65536 [1:09:09<11:21:35,  1.45it/s]
  9%|▉         | 6182/65536 [1:09:10<11:10:17,  1.48it/s]
  9%|▉         | 6183/65536 [1:09:11<11:07:23,  1.48it/s]
  9%|▉         | 6184/65536 [1:09:11<11:03:44,  1.49it/s]
  9%|▉         | 6185/65536 [1:09:12<10:49:19,  1.52it/s]
  9%|▉         | 6186/65536 [1:09:13<10:51:12,  1.52it/s]
  9%|▉         | 6187/65536 [1:09:13<10:36:35,  1.55it/s]
  9%|▉         | 6188/65536 [1:09:14<10:37:38,  1.55it/s]
  9%|▉         | 6189/65536 [1:09:15<10:56:53,  1.51it/s]
  9%|▉         | 6190/65536 [1:09:15<10:51:14,  1.52it/s]
  9%|▉         | 6191/65536 [1:09:16<10:47:31,  1.53it/s]
  9%|▉         | 6192/65536 [1:09:17<11:03:16,  1.49it/s]
  9%|▉         | 6193/65536 [1:09:17<10:47:15,  1.53it/s]
  9%|▉         | 6194/65536 [1:09:18<10:43:27,  1.54it/s]
  9%|▉         | 6195/65536 [1:09:18<11:01:07,  1.50it/s]
  9%|▉         | 6196/65536 [1:09:19<10:47:10,  1.53it/s]
  9%|▉         | 6197/65536 [1:09:20<10:47:36,  1.53it/s]
  9%|▉         | 6198/65536 [1:09:20<11:03:17,  1.49it/s]
  9%|▉         | 6199/65536 [1:09:21<11:15:26,  1.46it/s]
  9%|▉         | 6200/65536 [1:09:22<11:12:47,  1.47it/s]
                                                         
{'loss': 1.1009, 'learning_rate': 9.173503122321538e-07, 'epoch': 382.72}

  9%|▉         | 6200/65536 [1:09:22<11:12:47,  1.47it/s]
  9%|▉         | 6201/65536 [1:09:23<11:19:03,  1.46it/s]
  9%|▉         | 6202/65536 [1:09:23<11:20:36,  1.45it/s]
  9%|▉         | 6203/65536 [1:09:24<11:28:51,  1.44it/s]
  9%|▉         | 6204/65536 [1:09:25<11:18:53,  1.46it/s]
  9%|▉         | 6205/65536 [1:09:25<11:15:10,  1.46it/s]
  9%|▉         | 6206/65536 [1:09:26<11:28:30,  1.44it/s]
  9%|▉         | 6207/65536 [1:09:27<11:11:09,  1.47it/s]
  9%|▉         | 6208/65536 [1:09:27<10:58:25,  1.50it/s]
  9%|▉         | 6209/65536 [1:09:28<10:48:48,  1.52it/s]
  9%|▉         | 6210/65536 [1:09:29<10:55:25,  1.51it/s]
  9%|▉         | 6211/65536 [1:09:29<11:07:31,  1.48it/s]
  9%|▉         | 6212/65536 [1:09:30<11:16:59,  1.46it/s]
  9%|▉         | 6213/65536 [1:09:31<11:10:48,  1.47it/s]
  9%|▉         | 6214/65536 [1:09:31<11:12:01,  1.47it/s]
  9%|▉         | 6215/65536 [1:09:32<10:59:23,  1.50it/s]
  9%|▉         | 6216/65536 [1:09:33<11:18:46,  1.46it/s]
  9%|▉         | 6217/65536 [1:09:33<11:06:50,  1.48it/s]
  9%|▉         | 6218/65536 [1:09:34<11:00:35,  1.50it/s]
  9%|▉         | 6219/65536 [1:09:35<10:50:02,  1.52it/s]
  9%|▉         | 6220/65536 [1:09:35<10:55:11,  1.51it/s]
                                                         
{'loss': 1.0996, 'learning_rate': 9.170748132729275e-07, 'epoch': 383.95}

  9%|▉         | 6220/65536 [1:09:35<10:55:11,  1.51it/s]
  9%|▉         | 6221/65536 [1:09:36<11:08:59,  1.48it/s]
  9%|▉         | 6222/65536 [1:09:37<11:02:37,  1.49it/s]
  9%|▉         | 6223/65536 [1:09:37<10:58:26,  1.50it/s]
  9%|▉         | 6224/65536 [1:09:38<10:57:03,  1.50it/s]
  9%|▉         | 6225/65536 [1:09:39<10:56:47,  1.51it/s]
 10%|▉         | 6226/65536 [1:09:39<11:21:21,  1.45it/s]
 10%|▉         | 6227/65536 [1:09:40<11:16:21,  1.46it/s]
 10%|▉         | 6228/65536 [1:09:41<11:07:31,  1.48it/s]
 10%|▉         | 6229/65536 [1:09:41<11:11:27,  1.47it/s]
 10%|▉         | 6230/65536 [1:09:42<10:59:36,  1.50it/s]
 10%|▉         | 6231/65536 [1:09:43<10:58:50,  1.50it/s]
 10%|▉         | 6232/65536 [1:09:43<10:55:16,  1.51it/s]
 10%|▉         | 6233/65536 [1:09:44<11:13:13,  1.47it/s]
 10%|▉         | 6234/65536 [1:09:45<11:09:03,  1.48it/s]
 10%|▉         | 6235/65536 [1:09:45<11:15:15,  1.46it/s]
 10%|▉         | 6236/65536 [1:09:46<11:14:42,  1.46it/s]
 10%|▉         | 6237/65536 [1:09:47<10:49:54,  1.52it/s]
 10%|▉         | 6238/65536 [1:09:48<11:21:40,  1.45it/s]
 10%|▉         | 6239/65536 [1:09:48<11:05:50,  1.48it/s]
 10%|▉         | 6240/65536 [1:09:49<11:15:10,  1.46it/s]
                                                         
{'loss': 1.1067, 'learning_rate': 9.167993143137014e-07, 'epoch': 385.19}

 10%|▉         | 6240/65536 [1:09:49<11:15:10,  1.46it/s]
 10%|▉         | 6241/65536 [1:09:50<11:04:34,  1.49it/s]
 10%|▉         | 6242/65536 [1:09:50<10:56:14,  1.51it/s]
 10%|▉         | 6243/65536 [1:09:51<10:46:10,  1.53it/s]
 10%|▉         | 6244/65536 [1:09:51<10:52:18,  1.51it/s]
 10%|▉         | 6245/65536 [1:09:52<10:50:53,  1.52it/s]
 10%|▉         | 6246/65536 [1:09:53<10:46:16,  1.53it/s]
 10%|▉         | 6247/65536 [1:09:53<10:59:14,  1.50it/s]
 10%|▉         | 6248/65536 [1:09:54<10:33:01,  1.56it/s]
 10%|▉         | 6249/65536 [1:09:55<11:00:00,  1.50it/s]
 10%|▉         | 6250/65536 [1:09:55<11:12:14,  1.47it/s]
 10%|▉         | 6251/65536 [1:09:56<11:05:57,  1.48it/s]
 10%|▉         | 6252/65536 [1:09:57<11:06:52,  1.48it/s]
 10%|▉         | 6253/65536 [1:09:57<11:00:36,  1.50it/s]
 10%|▉         | 6254/65536 [1:09:58<11:17:45,  1.46it/s]
 10%|▉         | 6255/65536 [1:09:59<11:21:25,  1.45it/s]
 10%|▉         | 6256/65536 [1:10:00<11:02:50,  1.49it/s]
 10%|▉         | 6257/65536 [1:10:00<11:02:21,  1.49it/s]
 10%|▉         | 6258/65536 [1:10:01<10:54:17,  1.51it/s]
 10%|▉         | 6259/65536 [1:10:02<10:52:14,  1.51it/s]
 10%|▉         | 6260/65536 [1:10:02<10:46:20,  1.53it/s]
                                                         
{'loss': 1.1042, 'learning_rate': 9.165238153544753e-07, 'epoch': 386.42}

 10%|▉         | 6260/65536 [1:10:02<10:46:20,  1.53it/s]
 10%|▉         | 6261/65536 [1:10:03<10:47:15,  1.53it/s]
 10%|▉         | 6262/65536 [1:10:04<11:09:23,  1.48it/s]
 10%|▉         | 6263/65536 [1:10:04<11:04:04,  1.49it/s]
 10%|▉         | 6264/65536 [1:10:05<10:58:49,  1.50it/s]
 10%|▉         | 6265/65536 [1:10:06<11:01:32,  1.49it/s]
 10%|▉         | 6266/65536 [1:10:06<10:58:48,  1.50it/s]
 10%|▉         | 6267/65536 [1:10:07<11:15:22,  1.46it/s]
 10%|▉         | 6268/65536 [1:10:08<11:21:46,  1.45it/s]
 10%|▉         | 6269/65536 [1:10:08<11:06:09,  1.48it/s]
 10%|▉         | 6270/65536 [1:10:09<11:16:23,  1.46it/s]
 10%|▉         | 6271/65536 [1:10:10<11:22:24,  1.45it/s]
 10%|▉         | 6272/65536 [1:10:10<11:04:58,  1.49it/s]
 10%|▉         | 6273/65536 [1:10:11<10:50:37,  1.52it/s]
 10%|▉         | 6274/65536 [1:10:12<10:42:29,  1.54it/s]
 10%|▉         | 6275/65536 [1:10:12<10:53:38,  1.51it/s]
 10%|▉         | 6276/65536 [1:10:13<11:03:09,  1.49it/s]
 10%|▉         | 6277/65536 [1:10:14<11:22:00,  1.45it/s]
 10%|▉         | 6278/65536 [1:10:14<11:17:03,  1.46it/s]
 10%|▉         | 6279/65536 [1:10:15<11:28:59,  1.43it/s]
 10%|▉         | 6280/65536 [1:10:16<11:21:20,  1.45it/s]
                                                         
{'loss': 1.0814, 'learning_rate': 9.162483163952491e-07, 'epoch': 387.65}

 10%|▉         | 6280/65536 [1:10:16<11:21:20,  1.45it/s]
 10%|▉         | 6281/65536 [1:10:16<11:10:51,  1.47it/s]
 10%|▉         | 6282/65536 [1:10:17<10:58:58,  1.50it/s]
 10%|▉         | 6283/65536 [1:10:18<11:05:58,  1.48it/s]
 10%|▉         | 6284/65536 [1:10:18<10:57:28,  1.50it/s]
 10%|▉         | 6285/65536 [1:10:19<10:44:47,  1.53it/s]
 10%|▉         | 6286/65536 [1:10:20<11:13:07,  1.47it/s]
 10%|▉         | 6287/65536 [1:10:20<11:09:40,  1.47it/s]
 10%|▉         | 6288/65536 [1:10:21<11:11:35,  1.47it/s]
 10%|▉         | 6289/65536 [1:10:22<11:15:26,  1.46it/s]
 10%|▉         | 6290/65536 [1:10:22<11:12:31,  1.47it/s]
 10%|▉         | 6291/65536 [1:10:23<11:31:06,  1.43it/s]
 10%|▉         | 6292/65536 [1:10:24<11:19:27,  1.45it/s]
 10%|▉         | 6293/65536 [1:10:25<11:15:13,  1.46it/s]
 10%|▉         | 6294/65536 [1:10:25<11:15:11,  1.46it/s]
 10%|▉         | 6295/65536 [1:10:26<11:11:20,  1.47it/s]
 10%|▉         | 6296/65536 [1:10:27<10:54:49,  1.51it/s]
 10%|▉         | 6297/65536 [1:10:27<11:04:49,  1.49it/s]
 10%|▉         | 6298/65536 [1:10:28<10:55:39,  1.51it/s]
 10%|▉         | 6299/65536 [1:10:29<10:50:23,  1.52it/s]
 10%|▉         | 6300/65536 [1:10:29<11:00:04,  1.50it/s]
                                                         
{'loss': 1.071, 'learning_rate': 9.15972817436023e-07, 'epoch': 388.89}

 10%|▉         | 6300/65536 [1:10:29<11:00:04,  1.50it/s]
 10%|▉         | 6301/65536 [1:10:30<11:00:57,  1.49it/s]
 10%|▉         | 6302/65536 [1:10:31<11:01:48,  1.49it/s]
 10%|▉         | 6303/65536 [1:10:31<11:18:47,  1.45it/s]
 10%|▉         | 6304/65536 [1:10:32<11:14:47,  1.46it/s]
 10%|▉         | 6305/65536 [1:10:33<11:32:39,  1.43it/s]
 10%|▉         | 6306/65536 [1:10:33<11:14:13,  1.46it/s]
 10%|▉         | 6307/65536 [1:10:34<11:17:02,  1.46it/s]
 10%|▉         | 6308/65536 [1:10:35<10:57:13,  1.50it/s]
 10%|▉         | 6309/65536 [1:10:35<10:52:54,  1.51it/s]
 10%|▉         | 6310/65536 [1:10:36<10:35:59,  1.55it/s]
 10%|▉         | 6311/65536 [1:10:37<10:35:00,  1.55it/s]
 10%|▉         | 6312/65536 [1:10:37<10:44:15,  1.53it/s]
 10%|▉         | 6313/65536 [1:10:38<10:41:39,  1.54it/s]
 10%|▉         | 6314/65536 [1:10:38<10:30:57,  1.56it/s]
 10%|▉         | 6315/65536 [1:10:39<10:51:37,  1.51it/s]
 10%|▉         | 6316/65536 [1:10:40<10:59:37,  1.50it/s]
 10%|▉         | 6317/65536 [1:10:40<10:43:10,  1.53it/s]
 10%|▉         | 6318/65536 [1:10:41<10:50:12,  1.52it/s]
 10%|▉         | 6319/65536 [1:10:42<10:57:22,  1.50it/s]
 10%|▉         | 6320/65536 [1:10:42<10:51:48,  1.51it/s]
                                                         
{'loss': 1.1144, 'learning_rate': 9.156973184767968e-07, 'epoch': 390.12}

 10%|▉         | 6320/65536 [1:10:42<10:51:48,  1.51it/s]
 10%|▉         | 6321/65536 [1:10:43<10:48:37,  1.52it/s]
 10%|▉         | 6322/65536 [1:10:44<11:05:31,  1.48it/s]
 10%|▉         | 6323/65536 [1:10:44<10:56:50,  1.50it/s]
 10%|▉         | 6324/65536 [1:10:45<11:15:00,  1.46it/s]
 10%|▉         | 6325/65536 [1:10:46<11:25:24,  1.44it/s]
 10%|▉         | 6326/65536 [1:10:47<11:29:41,  1.43it/s]
 10%|▉         | 6327/65536 [1:10:47<11:17:24,  1.46it/s]
 10%|▉         | 6328/65536 [1:10:48<11:20:54,  1.45it/s]
 10%|▉         | 6329/65536 [1:10:49<11:15:23,  1.46it/s]
 10%|▉         | 6330/65536 [1:10:49<11:15:46,  1.46it/s]
 10%|▉         | 6331/65536 [1:10:50<10:57:53,  1.50it/s]
 10%|▉         | 6332/65536 [1:10:51<10:57:28,  1.50it/s]
 10%|▉         | 6333/65536 [1:10:51<10:48:19,  1.52it/s]
 10%|▉         | 6334/65536 [1:10:52<10:22:04,  1.59it/s]
 10%|▉         | 6335/65536 [1:10:53<10:52:24,  1.51it/s]
 10%|▉         | 6336/65536 [1:10:53<11:09:07,  1.47it/s]
 10%|▉         | 6337/65536 [1:10:54<11:03:04,  1.49it/s]
 10%|▉         | 6338/65536 [1:10:55<10:58:59,  1.50it/s]
 10%|▉         | 6339/65536 [1:10:55<11:18:09,  1.45it/s]
 10%|▉         | 6340/65536 [1:10:56<11:15:39,  1.46it/s]
                                                         
{'loss': 1.1073, 'learning_rate': 9.154218195175706e-07, 'epoch': 391.36}

 10%|▉         | 6340/65536 [1:10:56<11:15:39,  1.46it/s]
 10%|▉         | 6341/65536 [1:10:57<11:03:28,  1.49it/s]
 10%|▉         | 6342/65536 [1:10:57<11:08:35,  1.48it/s]
 10%|▉         | 6343/65536 [1:10:58<11:05:32,  1.48it/s]
 10%|▉         | 6344/65536 [1:10:59<11:31:39,  1.43it/s]
 10%|▉         | 6345/65536 [1:10:59<11:20:10,  1.45it/s]
 10%|▉         | 6346/65536 [1:11:00<11:18:00,  1.45it/s]
 10%|▉         | 6347/65536 [1:11:01<10:59:21,  1.50it/s]
 10%|▉         | 6348/65536 [1:11:01<10:52:39,  1.51it/s]
 10%|▉         | 6349/65536 [1:11:02<10:34:51,  1.55it/s]
 10%|▉         | 6350/65536 [1:11:03<10:29:12,  1.57it/s]
 10%|▉         | 6351/65536 [1:11:03<10:47:49,  1.52it/s]
 10%|▉         | 6352/65536 [1:11:04<10:53:52,  1.51it/s]
 10%|▉         | 6353/65536 [1:11:05<10:50:34,  1.52it/s]
 10%|▉         | 6354/65536 [1:11:05<10:53:52,  1.51it/s]
 10%|▉         | 6355/65536 [1:11:06<10:57:10,  1.50it/s]
 10%|▉         | 6356/65536 [1:11:07<11:18:42,  1.45it/s]
 10%|▉         | 6357/65536 [1:11:07<11:10:34,  1.47it/s]
 10%|▉         | 6358/65536 [1:11:08<11:06:00,  1.48it/s]
 10%|▉         | 6359/65536 [1:11:09<11:23:59,  1.44it/s]
 10%|▉         | 6360/65536 [1:11:09<11:05:50,  1.48it/s]
                                                         
{'loss': 1.0804, 'learning_rate': 9.151463205583446e-07, 'epoch': 392.59}

 10%|▉         | 6360/65536 [1:11:09<11:05:50,  1.48it/s]
 10%|▉         | 6361/65536 [1:11:10<11:18:58,  1.45it/s]
 10%|▉         | 6362/65536 [1:11:11<11:01:11,  1.49it/s]
 10%|▉         | 6363/65536 [1:11:12<11:18:41,  1.45it/s]
 10%|▉         | 6364/65536 [1:11:12<11:16:21,  1.46it/s]
 10%|▉         | 6365/65536 [1:11:13<11:11:49,  1.47it/s]
 10%|▉         | 6366/65536 [1:11:14<10:56:52,  1.50it/s]
 10%|▉         | 6367/65536 [1:11:14<10:51:47,  1.51it/s]
 10%|▉         | 6368/65536 [1:11:15<11:02:24,  1.49it/s]
 10%|▉         | 6369/65536 [1:11:15<10:53:02,  1.51it/s]
 10%|▉         | 6370/65536 [1:11:16<10:48:58,  1.52it/s]
 10%|▉         | 6371/65536 [1:11:17<10:47:53,  1.52it/s]
 10%|▉         | 6372/65536 [1:11:17<10:56:21,  1.50it/s]
 10%|▉         | 6373/65536 [1:11:18<10:57:25,  1.50it/s]
 10%|▉         | 6374/65536 [1:11:19<10:53:12,  1.51it/s]
 10%|▉         | 6375/65536 [1:11:19<10:55:56,  1.50it/s]
 10%|▉         | 6376/65536 [1:11:20<11:07:29,  1.48it/s]
 10%|▉         | 6377/65536 [1:11:21<10:55:26,  1.50it/s]
 10%|▉         | 6378/65536 [1:11:21<10:48:31,  1.52it/s]
 10%|▉         | 6379/65536 [1:11:22<11:20:49,  1.45it/s]
 10%|▉         | 6380/65536 [1:11:23<11:08:51,  1.47it/s]
                                                         
{'loss': 1.1076, 'learning_rate': 9.148708215991183e-07, 'epoch': 393.83}

 10%|▉         | 6380/65536 [1:11:23<11:08:51,  1.47it/s]
 10%|▉         | 6381/65536 [1:11:24<10:56:17,  1.50it/s]
 10%|▉         | 6382/65536 [1:11:24<10:52:26,  1.51it/s]
 10%|▉         | 6383/65536 [1:11:25<11:00:32,  1.49it/s]
 10%|▉         | 6384/65536 [1:11:25<10:41:59,  1.54it/s]
 10%|▉         | 6385/65536 [1:11:26<10:42:38,  1.53it/s]
 10%|▉         | 6386/65536 [1:11:27<10:42:59,  1.53it/s]
 10%|▉         | 6387/65536 [1:11:27<10:57:55,  1.50it/s]
 10%|▉         | 6388/65536 [1:11:28<10:55:48,  1.50it/s]
 10%|▉         | 6389/65536 [1:11:29<11:03:35,  1.49it/s]
 10%|▉         | 6390/65536 [1:11:29<10:56:59,  1.50it/s]
 10%|▉         | 6391/65536 [1:11:30<10:52:41,  1.51it/s]
 10%|▉         | 6392/65536 [1:11:31<10:58:51,  1.50it/s]
 10%|▉         | 6393/65536 [1:11:31<10:45:03,  1.53it/s]
 10%|▉         | 6394/65536 [1:11:32<11:01:07,  1.49it/s]
 10%|▉         | 6395/65536 [1:11:33<10:53:03,  1.51it/s]
 10%|▉         | 6396/65536 [1:11:34<11:12:40,  1.47it/s]
 10%|▉         | 6397/65536 [1:11:34<11:10:27,  1.47it/s]
 10%|▉         | 6398/65536 [1:11:35<11:03:12,  1.49it/s]
 10%|▉         | 6399/65536 [1:11:35<10:51:38,  1.51it/s]
 10%|▉         | 6400/65536 [1:11:36<10:57:05,  1.50it/s]
                                                         
{'loss': 1.1206, 'learning_rate': 9.145953226398922e-07, 'epoch': 395.06}

 10%|▉         | 6400/65536 [1:11:36<10:57:05,  1.50it/s]
 10%|▉         | 6401/65536 [1:11:37<10:53:05,  1.51it/s]
 10%|▉         | 6402/65536 [1:11:37<10:49:17,  1.52it/s]
 10%|▉         | 6403/65536 [1:11:38<10:50:04,  1.52it/s]
 10%|▉         | 6404/65536 [1:11:39<10:59:12,  1.50it/s]
 10%|▉         | 6405/65536 [1:11:40<11:10:27,  1.47it/s]
 10%|▉         | 6406/65536 [1:11:40<11:18:20,  1.45it/s]
 10%|▉         | 6407/65536 [1:11:41<10:49:22,  1.52it/s]
 10%|▉         | 6408/65536 [1:11:42<11:05:52,  1.48it/s]
 10%|▉         | 6409/65536 [1:11:42<11:03:24,  1.49it/s]
 10%|▉         | 6410/65536 [1:11:43<10:56:23,  1.50it/s]
 10%|▉         | 6411/65536 [1:11:43<10:47:55,  1.52it/s]
 10%|▉         | 6412/65536 [1:11:44<10:51:02,  1.51it/s]
 10%|▉         | 6413/65536 [1:11:45<10:53:28,  1.51it/s]
 10%|▉         | 6414/65536 [1:11:46<11:05:45,  1.48it/s]
 10%|▉         | 6415/65536 [1:11:46<11:01:02,  1.49it/s]
 10%|▉         | 6416/65536 [1:11:47<11:33:56,  1.42it/s]
 10%|▉         | 6417/65536 [1:11:48<11:21:50,  1.45it/s]
 10%|▉         | 6418/65536 [1:11:48<10:59:29,  1.49it/s]
 10%|▉         | 6419/65536 [1:11:49<10:53:12,  1.51it/s]
 10%|▉         | 6420/65536 [1:11:50<11:02:27,  1.49it/s]
                                                         
{'loss': 1.1109, 'learning_rate': 9.14319823680666e-07, 'epoch': 396.3}

 10%|▉         | 6420/65536 [1:11:50<11:02:27,  1.49it/s]
 10%|▉         | 6421/65536 [1:11:50<11:10:32,  1.47it/s]
 10%|▉         | 6422/65536 [1:11:51<11:05:27,  1.48it/s]
 10%|▉         | 6423/65536 [1:11:52<11:08:15,  1.47it/s]
 10%|▉         | 6424/65536 [1:11:52<10:50:57,  1.51it/s]
 10%|▉         | 6425/65536 [1:11:53<10:47:52,  1.52it/s]
 10%|▉         | 6426/65536 [1:11:54<10:44:06,  1.53it/s]
 10%|▉         | 6427/65536 [1:11:54<10:57:20,  1.50it/s]
 10%|▉         | 6428/65536 [1:11:55<11:06:59,  1.48it/s]
 10%|▉         | 6429/65536 [1:11:56<11:06:23,  1.48it/s]
 10%|▉         | 6430/65536 [1:11:56<10:45:31,  1.53it/s]
 10%|▉         | 6431/65536 [1:11:57<10:45:50,  1.53it/s]
 10%|▉         | 6432/65536 [1:11:58<11:00:44,  1.49it/s]
 10%|▉         | 6433/65536 [1:11:58<11:02:08,  1.49it/s]
 10%|▉         | 6434/65536 [1:11:59<11:05:15,  1.48it/s]
 10%|▉         | 6435/65536 [1:12:00<10:50:20,  1.51it/s]
 10%|▉         | 6436/65536 [1:12:00<10:53:33,  1.51it/s]
 10%|▉         | 6437/65536 [1:12:01<10:58:16,  1.50it/s]
 10%|▉         | 6438/65536 [1:12:02<11:00:36,  1.49it/s]
 10%|▉         | 6439/65536 [1:12:02<11:00:52,  1.49it/s]
 10%|▉         | 6440/65536 [1:12:03<11:13:41,  1.46it/s]
                                                         
{'loss': 1.1012, 'learning_rate': 9.140443247214399e-07, 'epoch': 397.53}

 10%|▉         | 6440/65536 [1:12:03<11:13:41,  1.46it/s]
 10%|▉         | 6441/65536 [1:12:04<10:57:14,  1.50it/s]
 10%|▉         | 6442/65536 [1:12:04<10:55:14,  1.50it/s]
 10%|▉         | 6443/65536 [1:12:05<11:07:08,  1.48it/s]
 10%|▉         | 6444/65536 [1:12:06<10:54:52,  1.50it/s]
 10%|▉         | 6445/65536 [1:12:06<10:52:01,  1.51it/s]
 10%|▉         | 6446/65536 [1:12:07<11:01:20,  1.49it/s]
 10%|▉         | 6447/65536 [1:12:08<11:07:12,  1.48it/s]
 10%|▉         | 6448/65536 [1:12:08<11:24:16,  1.44it/s]
 10%|▉         | 6449/65536 [1:12:09<11:21:09,  1.45it/s]
 10%|▉         | 6450/65536 [1:12:10<11:06:57,  1.48it/s]
 10%|▉         | 6451/65536 [1:12:10<11:00:01,  1.49it/s]
 10%|▉         | 6452/65536 [1:12:11<11:04:00,  1.48it/s]
 10%|▉         | 6453/65536 [1:12:12<11:08:19,  1.47it/s]
 10%|▉         | 6454/65536 [1:12:12<11:00:02,  1.49it/s]
 10%|▉         | 6455/65536 [1:12:13<11:00:22,  1.49it/s]
 10%|▉         | 6456/65536 [1:12:14<10:57:59,  1.50it/s]
 10%|▉         | 6457/65536 [1:12:14<11:04:46,  1.48it/s]
 10%|▉         | 6458/65536 [1:12:15<11:02:23,  1.49it/s]
 10%|▉         | 6459/65536 [1:12:16<11:16:50,  1.45it/s]
 10%|▉         | 6460/65536 [1:12:17<11:16:53,  1.45it/s]
                                                         
{'loss': 1.0585, 'learning_rate': 9.137688257622137e-07, 'epoch': 398.77}

 10%|▉         | 6460/65536 [1:12:17<11:16:53,  1.45it/s]
 10%|▉         | 6461/65536 [1:12:17<11:04:10,  1.48it/s]
 10%|▉         | 6462/65536 [1:12:18<11:08:03,  1.47it/s]
 10%|▉         | 6463/65536 [1:12:19<11:06:45,  1.48it/s]
 10%|▉         | 6464/65536 [1:12:19<11:12:53,  1.46it/s]
 10%|▉         | 6465/65536 [1:12:20<11:01:46,  1.49it/s]
 10%|▉         | 6466/65536 [1:12:20<10:44:42,  1.53it/s]
 10%|▉         | 6467/65536 [1:12:21<10:47:44,  1.52it/s]
 10%|▉         | 6468/65536 [1:12:22<10:51:43,  1.51it/s]
 10%|▉         | 6469/65536 [1:12:22<10:58:51,  1.49it/s]
 10%|▉         | 6470/65536 [1:12:23<10:56:00,  1.50it/s]
 10%|▉         | 6471/65536 [1:12:24<11:02:36,  1.49it/s]
 10%|▉         | 6472/65536 [1:12:25<11:18:18,  1.45it/s]
 10%|▉         | 6473/65536 [1:12:25<11:26:49,  1.43it/s]
 10%|▉         | 6474/65536 [1:12:26<11:13:58,  1.46it/s]
 10%|▉         | 6475/65536 [1:12:27<11:30:38,  1.43it/s]
 10%|▉         | 6476/65536 [1:12:27<11:17:18,  1.45it/s]
 10%|▉         | 6477/65536 [1:12:28<10:52:31,  1.51it/s]
 10%|▉         | 6478/65536 [1:12:29<10:44:09,  1.53it/s]
 10%|▉         | 6479/65536 [1:12:29<11:01:16,  1.49it/s]
 10%|▉         | 6480/65536 [1:12:30<10:57:10,  1.50it/s]
                                                         
{'loss': 1.1017, 'learning_rate': 9.134933268029875e-07, 'epoch': 400.0}

 10%|▉         | 6480/65536 [1:12:30<10:57:10,  1.50it/s]
 10%|▉         | 6481/65536 [1:12:31<11:11:52,  1.46it/s]
 10%|▉         | 6482/65536 [1:12:31<11:02:56,  1.48it/s]
 10%|▉         | 6483/65536 [1:12:32<11:10:23,  1.47it/s]
 10%|▉         | 6484/65536 [1:12:33<11:10:54,  1.47it/s]
 10%|▉         | 6485/65536 [1:12:33<10:59:18,  1.49it/s]
 10%|▉         | 6486/65536 [1:12:34<10:57:55,  1.50it/s]
 10%|▉         | 6487/65536 [1:12:35<10:54:46,  1.50it/s]
 10%|▉         | 6488/65536 [1:12:35<10:54:34,  1.50it/s]
 10%|▉         | 6489/65536 [1:12:36<10:55:15,  1.50it/s]
 10%|▉         | 6490/65536 [1:12:37<10:52:13,  1.51it/s]
 10%|▉         | 6491/65536 [1:12:37<11:10:36,  1.47it/s]
 10%|▉         | 6492/65536 [1:12:38<11:10:46,  1.47it/s]
 10%|▉         | 6493/65536 [1:12:39<11:06:25,  1.48it/s]
 10%|▉         | 6494/65536 [1:12:39<10:55:16,  1.50it/s]
 10%|▉         | 6495/65536 [1:12:40<10:43:50,  1.53it/s]
 10%|▉         | 6496/65536 [1:12:41<10:40:50,  1.54it/s]
 10%|▉         | 6497/65536 [1:12:41<10:59:35,  1.49it/s]
 10%|▉         | 6498/65536 [1:12:42<10:45:26,  1.52it/s]
 10%|▉         | 6499/65536 [1:12:43<10:45:11,  1.53it/s]
 10%|▉         | 6500/65536 [1:12:43<11:23:19,  1.44it/s]
                                                         
{'loss': 1.0905, 'learning_rate': 9.132178278437614e-07, 'epoch': 401.23}

 10%|▉         | 6500/65536 [1:12:43<11:23:19,  1.44it/s]
 10%|▉         | 6501/65536 [1:12:44<11:00:47,  1.49it/s]
 10%|▉         | 6502/65536 [1:12:45<11:00:44,  1.49it/s]
 10%|▉         | 6503/65536 [1:12:45<11:10:52,  1.47it/s]
 10%|▉         | 6504/65536 [1:12:46<11:04:11,  1.48it/s]
 10%|▉         | 6505/65536 [1:12:47<10:45:43,  1.52it/s]
 10%|▉         | 6506/65536 [1:12:47<10:44:15,  1.53it/s]
 10%|▉         | 6507/65536 [1:12:48<10:54:57,  1.50it/s]
 10%|▉         | 6508/65536 [1:12:49<11:01:54,  1.49it/s]
 10%|▉         | 6509/65536 [1:12:49<11:00:24,  1.49it/s]
 10%|▉         | 6510/65536 [1:12:50<11:00:23,  1.49it/s]
 10%|▉         | 6511/65536 [1:12:51<11:01:16,  1.49it/s]
 10%|▉         | 6512/65536 [1:12:51<10:49:34,  1.51it/s]
 10%|▉         | 6513/65536 [1:12:52<10:57:09,  1.50it/s]
 10%|▉         | 6514/65536 [1:12:53<10:46:31,  1.52it/s]
 10%|▉         | 6515/65536 [1:12:53<10:42:10,  1.53it/s]
 10%|▉         | 6516/65536 [1:12:54<10:47:36,  1.52it/s]
 10%|▉         | 6517/65536 [1:12:55<10:37:37,  1.54it/s]
 10%|▉         | 6518/65536 [1:12:55<10:49:42,  1.51it/s]
 10%|▉         | 6519/65536 [1:12:56<11:10:59,  1.47it/s]
 10%|▉         | 6520/65536 [1:12:57<11:13:10,  1.46it/s]
                                                         
{'loss': 1.1007, 'learning_rate': 9.129423288845352e-07, 'epoch': 402.47}

 10%|▉         | 6520/65536 [1:12:57<11:13:10,  1.46it/s]
 10%|▉         | 6521/65536 [1:12:57<10:53:25,  1.51it/s]
 10%|▉         | 6522/65536 [1:12:58<10:59:58,  1.49it/s]
 10%|▉         | 6523/65536 [1:12:59<11:07:58,  1.47it/s]
 10%|▉         | 6524/65536 [1:12:59<10:50:38,  1.51it/s]
 10%|▉         | 6525/65536 [1:13:00<10:58:28,  1.49it/s]
 10%|▉         | 6526/65536 [1:13:01<10:55:30,  1.50it/s]
 10%|▉         | 6527/65536 [1:13:01<10:58:19,  1.49it/s]
 10%|▉         | 6528/65536 [1:13:02<11:01:01,  1.49it/s]
 10%|▉         | 6529/65536 [1:13:03<11:14:45,  1.46it/s]
 10%|▉         | 6530/65536 [1:13:03<10:59:57,  1.49it/s]
 10%|▉         | 6531/65536 [1:13:04<11:04:46,  1.48it/s]
 10%|▉         | 6532/65536 [1:13:05<10:55:59,  1.50it/s]
 10%|▉         | 6533/65536 [1:13:05<10:53:21,  1.51it/s]
 10%|▉         | 6534/65536 [1:13:06<10:59:45,  1.49it/s]
 10%|▉         | 6535/65536 [1:13:07<11:01:23,  1.49it/s]
 10%|▉         | 6536/65536 [1:13:07<11:21:23,  1.44it/s]
 10%|▉         | 6537/65536 [1:13:08<11:21:56,  1.44it/s]
 10%|▉         | 6538/65536 [1:13:09<11:15:39,  1.46it/s]
 10%|▉         | 6539/65536 [1:13:10<11:01:54,  1.49it/s]
 10%|▉         | 6540/65536 [1:13:10<11:02:25,  1.48it/s]
                                                         
{'loss': 1.1034, 'learning_rate': 9.126668299253092e-07, 'epoch': 403.7}

 10%|▉         | 6540/65536 [1:13:10<11:02:25,  1.48it/s]
 10%|▉         | 6541/65536 [1:13:11<11:01:35,  1.49it/s]
 10%|▉         | 6542/65536 [1:13:12<11:00:44,  1.49it/s]
 10%|▉         | 6543/65536 [1:13:12<11:11:56,  1.46it/s]
 10%|▉         | 6544/65536 [1:13:13<11:03:49,  1.48it/s]
 10%|▉         | 6545/65536 [1:13:14<11:20:55,  1.44it/s]
 10%|▉         | 6546/65536 [1:13:14<10:47:39,  1.52it/s]
 10%|▉         | 6547/65536 [1:13:15<10:40:06,  1.54it/s]
 10%|▉         | 6548/65536 [1:13:15<10:35:26,  1.55it/s]
 10%|▉         | 6549/65536 [1:13:16<11:01:19,  1.49it/s]
 10%|▉         | 6550/65536 [1:13:17<11:02:45,  1.48it/s]
 10%|▉         | 6551/65536 [1:13:18<10:53:25,  1.50it/s]
 10%|▉         | 6552/65536 [1:13:18<11:09:08,  1.47it/s]
 10%|▉         | 6553/65536 [1:13:19<11:04:33,  1.48it/s]
 10%|█         | 6554/65536 [1:13:20<10:59:12,  1.49it/s]
 10%|█         | 6555/65536 [1:13:20<10:49:49,  1.51it/s]
 10%|█         | 6556/65536 [1:13:21<10:48:55,  1.51it/s]
 10%|█         | 6557/65536 [1:13:22<10:49:30,  1.51it/s]
 10%|█         | 6558/65536 [1:13:22<10:46:50,  1.52it/s]
 10%|█         | 6559/65536 [1:13:23<11:02:02,  1.48it/s]
 10%|█         | 6560/65536 [1:13:24<11:11:29,  1.46it/s]
                                                         
{'loss': 1.081, 'learning_rate': 9.12391330966083e-07, 'epoch': 404.94}

 10%|█         | 6560/65536 [1:13:24<11:11:29,  1.46it/s]
 10%|█         | 6561/65536 [1:13:24<10:59:01,  1.49it/s]
 10%|█         | 6562/65536 [1:13:25<11:32:48,  1.42it/s]
 10%|█         | 6563/65536 [1:13:26<11:09:29,  1.47it/s]
 10%|█         | 6564/65536 [1:13:26<10:57:09,  1.50it/s]
 10%|█         | 6565/65536 [1:13:27<11:03:52,  1.48it/s]
 10%|█         | 6566/65536 [1:13:28<11:01:15,  1.49it/s]
 10%|█         | 6567/65536 [1:13:28<10:41:54,  1.53it/s]
 10%|█         | 6568/65536 [1:13:29<10:47:36,  1.52it/s]
 10%|█         | 6569/65536 [1:13:30<10:57:35,  1.49it/s]
 10%|█         | 6570/65536 [1:13:30<10:52:01,  1.51it/s]
 10%|█         | 6571/65536 [1:13:31<10:48:00,  1.52it/s]
 10%|█         | 6572/65536 [1:13:32<10:39:14,  1.54it/s]
 10%|█         | 6573/65536 [1:13:32<10:38:09,  1.54it/s]
 10%|█         | 6574/65536 [1:13:33<10:52:09,  1.51it/s]
 10%|█         | 6575/65536 [1:13:34<10:54:54,  1.50it/s]
 10%|█         | 6576/65536 [1:13:34<10:49:39,  1.51it/s]
 10%|█         | 6577/65536 [1:13:35<10:55:29,  1.50it/s]
 10%|█         | 6578/65536 [1:13:36<11:01:43,  1.48it/s]
 10%|█         | 6579/65536 [1:13:36<10:59:45,  1.49it/s]
 10%|█         | 6580/65536 [1:13:37<10:44:52,  1.52it/s]
                                                         
{'loss': 1.1096, 'learning_rate': 9.121158320068569e-07, 'epoch': 406.17}

 10%|█         | 6580/65536 [1:13:37<10:44:52,  1.52it/s]
 10%|█         | 6581/65536 [1:13:38<10:42:22,  1.53it/s]
 10%|█         | 6582/65536 [1:13:38<10:47:03,  1.52it/s]
 10%|█         | 6583/65536 [1:13:39<10:49:48,  1.51it/s]
 10%|█         | 6584/65536 [1:13:39<10:45:31,  1.52it/s]
 10%|█         | 6585/65536 [1:13:40<10:41:32,  1.53it/s]
 10%|█         | 6586/65536 [1:13:41<10:58:35,  1.49it/s]
 10%|█         | 6587/65536 [1:13:42<10:58:23,  1.49it/s]
 10%|█         | 6588/65536 [1:13:42<11:10:01,  1.47it/s]
 10%|█         | 6589/65536 [1:13:43<11:23:11,  1.44it/s]
 10%|█         | 6590/65536 [1:13:44<11:14:02,  1.46it/s]
 10%|█         | 6591/65536 [1:13:44<11:09:30,  1.47it/s]
 10%|█         | 6592/65536 [1:13:45<11:01:42,  1.48it/s]
 10%|█         | 6593/65536 [1:13:46<11:04:52,  1.48it/s]
 10%|█         | 6594/65536 [1:13:46<11:13:12,  1.46it/s]
 10%|█         | 6595/65536 [1:13:47<11:22:19,  1.44it/s]
 10%|█         | 6596/65536 [1:13:48<11:10:48,  1.46it/s]
 10%|█         | 6597/65536 [1:13:48<11:15:07,  1.45it/s]
 10%|█         | 6598/65536 [1:13:49<11:05:16,  1.48it/s]
 10%|█         | 6599/65536 [1:13:50<11:04:50,  1.48it/s]
 10%|█         | 6600/65536 [1:13:50<11:14:36,  1.46it/s]
                                                         
{'loss': 1.069, 'learning_rate': 9.118403330476307e-07, 'epoch': 407.41}

 10%|█         | 6600/65536 [1:13:50<11:14:36,  1.46it/s]
 10%|█         | 6601/65536 [1:13:51<11:21:13,  1.44it/s]
 10%|█         | 6602/65536 [1:13:52<11:20:28,  1.44it/s]
 10%|█         | 6603/65536 [1:13:52<11:06:58,  1.47it/s]
 10%|█         | 6604/65536 [1:13:53<11:10:34,  1.46it/s]
 10%|█         | 6605/65536 [1:13:54<11:06:32,  1.47it/s]
 10%|█         | 6606/65536 [1:13:54<10:51:31,  1.51it/s]
 10%|█         | 6607/65536 [1:13:55<10:54:43,  1.50it/s]
 10%|█         | 6608/65536 [1:13:56<10:57:49,  1.49it/s]
 10%|█         | 6609/65536 [1:13:56<10:49:18,  1.51it/s]
 10%|█         | 6610/65536 [1:13:57<11:08:08,  1.47it/s]
 10%|█         | 6611/65536 [1:13:58<11:06:14,  1.47it/s]
 10%|█         | 6612/65536 [1:13:59<10:52:35,  1.50it/s]
 10%|█         | 6613/65536 [1:13:59<11:03:22,  1.48it/s]
 10%|█         | 6614/65536 [1:14:00<11:08:01,  1.47it/s]
 10%|█         | 6615/65536 [1:14:01<11:13:44,  1.46it/s]
 10%|█         | 6616/65536 [1:14:01<11:03:57,  1.48it/s]
 10%|█         | 6617/65536 [1:14:02<10:57:22,  1.49it/s]
 10%|█         | 6618/65536 [1:14:03<10:46:45,  1.52it/s]
 10%|█         | 6619/65536 [1:14:03<10:39:23,  1.54it/s]
 10%|█         | 6620/65536 [1:14:04<10:44:14,  1.52it/s]
                                                         
{'loss': 1.0787, 'learning_rate': 9.115648340884045e-07, 'epoch': 408.64}

 10%|█         | 6620/65536 [1:14:04<10:44:14,  1.52it/s]
 10%|█         | 6621/65536 [1:14:04<10:37:07,  1.54it/s]
 10%|█         | 6622/65536 [1:14:05<10:56:20,  1.50it/s]
 10%|█         | 6623/65536 [1:14:06<10:56:56,  1.49it/s]
 10%|█         | 6624/65536 [1:14:07<10:54:07,  1.50it/s]
 10%|█         | 6625/65536 [1:14:07<10:57:20,  1.49it/s]
 10%|█         | 6626/65536 [1:14:08<11:14:50,  1.45it/s]
 10%|█         | 6627/65536 [1:14:09<10:58:45,  1.49it/s]
 10%|█         | 6628/65536 [1:14:09<10:50:18,  1.51it/s]
 10%|█         | 6629/65536 [1:14:10<10:49:17,  1.51it/s]
 10%|█         | 6630/65536 [1:14:11<11:02:20,  1.48it/s]
 10%|█         | 6631/65536 [1:14:11<11:03:53,  1.48it/s]
 10%|█         | 6632/65536 [1:14:12<10:54:18,  1.50it/s]
 10%|█         | 6633/65536 [1:14:13<11:00:57,  1.49it/s]
 10%|█         | 6634/65536 [1:14:13<11:01:53,  1.48it/s]
 10%|█         | 6635/65536 [1:14:14<10:45:16,  1.52it/s]
 10%|█         | 6636/65536 [1:14:15<10:48:55,  1.51it/s]
 10%|█         | 6637/65536 [1:14:15<10:49:41,  1.51it/s]
 10%|█         | 6638/65536 [1:14:16<11:03:54,  1.48it/s]
 10%|█         | 6639/65536 [1:14:17<10:58:18,  1.49it/s]
 10%|█         | 6640/65536 [1:14:17<10:54:11,  1.50it/s]
                                                         
{'loss': 1.0963, 'learning_rate': 9.112893351291784e-07, 'epoch': 409.88}

 10%|█         | 6640/65536 [1:14:17<10:54:11,  1.50it/s]
 10%|█         | 6641/65536 [1:14:18<10:42:56,  1.53it/s]
 10%|█         | 6642/65536 [1:14:18<10:36:27,  1.54it/s]
 10%|█         | 6643/65536 [1:14:19<11:06:15,  1.47it/s]
 10%|█         | 6644/65536 [1:14:20<11:08:54,  1.47it/s]
 10%|█         | 6645/65536 [1:14:21<11:00:21,  1.49it/s]
 10%|█         | 6646/65536 [1:14:21<10:48:21,  1.51it/s]
 10%|█         | 6647/65536 [1:14:22<10:54:57,  1.50it/s]
 10%|█         | 6648/65536 [1:14:23<11:03:37,  1.48it/s]
 10%|█         | 6649/65536 [1:14:23<11:04:30,  1.48it/s]
 10%|█         | 6650/65536 [1:14:24<11:17:14,  1.45it/s]
 10%|█         | 6651/65536 [1:14:25<11:01:44,  1.48it/s]
 10%|█         | 6652/65536 [1:14:25<10:50:32,  1.51it/s]
 10%|█         | 6653/65536 [1:14:26<10:59:31,  1.49it/s]
 10%|█         | 6654/65536 [1:14:27<10:53:31,  1.50it/s]
 10%|█         | 6655/65536 [1:14:27<10:36:44,  1.54it/s]
 10%|█         | 6656/65536 [1:14:28<10:43:14,  1.53it/s]
 10%|█         | 6657/65536 [1:14:29<10:42:20,  1.53it/s]
 10%|█         | 6658/65536 [1:14:29<10:46:43,  1.52it/s]
 10%|█         | 6659/65536 [1:14:30<11:05:02,  1.48it/s]
 10%|█         | 6660/65536 [1:14:31<10:59:42,  1.49it/s]
                                                         
{'loss': 1.1065, 'learning_rate': 9.110138361699522e-07, 'epoch': 411.11}

 10%|█         | 6660/65536 [1:14:31<10:59:42,  1.49it/s]
 10%|█         | 6661/65536 [1:14:31<11:10:32,  1.46it/s]
 10%|█         | 6662/65536 [1:14:32<11:11:17,  1.46it/s]
 10%|█         | 6663/65536 [1:14:33<10:48:15,  1.51it/s]
 10%|█         | 6664/65536 [1:14:33<10:45:40,  1.52it/s]
 10%|█         | 6665/65536 [1:14:34<10:43:40,  1.52it/s]
 10%|█         | 6666/65536 [1:14:35<10:42:34,  1.53it/s]
 10%|█         | 6667/65536 [1:14:35<10:48:10,  1.51it/s]
 10%|█         | 6668/65536 [1:14:36<10:48:46,  1.51it/s]
 10%|█         | 6669/65536 [1:14:37<10:44:12,  1.52it/s]
 10%|█         | 6670/65536 [1:14:37<10:51:52,  1.51it/s]
 10%|█         | 6671/65536 [1:14:38<10:52:22,  1.50it/s]
 10%|█         | 6672/65536 [1:14:39<10:57:35,  1.49it/s]
 10%|█         | 6673/65536 [1:14:39<11:07:31,  1.47it/s]
 10%|█         | 6674/65536 [1:14:40<11:09:38,  1.47it/s]
 10%|█         | 6675/65536 [1:14:41<11:13:45,  1.46it/s]
 10%|█         | 6676/65536 [1:14:41<11:06:52,  1.47it/s]
 10%|█         | 6677/65536 [1:14:42<11:08:38,  1.47it/s]
 10%|█         | 6678/65536 [1:14:43<10:55:05,  1.50it/s]
 10%|█         | 6679/65536 [1:14:43<10:57:03,  1.49it/s]
 10%|█         | 6680/65536 [1:14:44<10:59:39,  1.49it/s]
                                                         
{'loss': 1.1025, 'learning_rate': 9.107383372107261e-07, 'epoch': 412.35}

 10%|█         | 6680/65536 [1:14:44<10:59:39,  1.49it/s]
 10%|█         | 6681/65536 [1:14:45<10:45:13,  1.52it/s]
 10%|█         | 6682/65536 [1:14:45<11:07:25,  1.47it/s]
 10%|█         | 6683/65536 [1:14:46<11:00:11,  1.49it/s]
 10%|█         | 6684/65536 [1:14:47<11:09:19,  1.47it/s]
 10%|█         | 6685/65536 [1:14:47<11:07:35,  1.47it/s]
 10%|█         | 6686/65536 [1:14:48<11:01:54,  1.48it/s]
 10%|█         | 6687/65536 [1:14:49<10:57:16,  1.49it/s]
 10%|█         | 6688/65536 [1:14:49<10:57:48,  1.49it/s]
 10%|█         | 6689/65536 [1:14:50<10:43:26,  1.52it/s]
 10%|█         | 6690/65536 [1:14:51<10:42:40,  1.53it/s]
 10%|█         | 6691/65536 [1:14:51<11:10:23,  1.46it/s]
 10%|█         | 6692/65536 [1:14:52<11:21:05,  1.44it/s]
 10%|█         | 6693/65536 [1:14:53<11:33:33,  1.41it/s]
 10%|█         | 6694/65536 [1:14:54<11:16:03,  1.45it/s]
 10%|█         | 6695/65536 [1:14:54<10:58:05,  1.49it/s]
 10%|█         | 6696/65536 [1:14:55<10:51:19,  1.51it/s]
 10%|█         | 6697/65536 [1:14:55<10:41:46,  1.53it/s]
 10%|█         | 6698/65536 [1:14:56<10:38:33,  1.54it/s]
 10%|█         | 6699/65536 [1:14:57<10:44:34,  1.52it/s]
 10%|█         | 6700/65536 [1:14:57<10:52:46,  1.50it/s]
                                                         
{'loss': 1.0772, 'learning_rate': 9.104628382515e-07, 'epoch': 413.58}

 10%|█         | 6700/65536 [1:14:57<10:52:46,  1.50it/s]
 10%|█         | 6701/65536 [1:14:58<11:02:09,  1.48it/s]
 10%|█         | 6702/65536 [1:14:59<11:01:44,  1.48it/s]
 10%|█         | 6703/65536 [1:14:59<11:10:35,  1.46it/s]
 10%|█         | 6704/65536 [1:15:00<11:15:22,  1.45it/s]
 10%|█         | 6705/65536 [1:15:01<11:04:41,  1.48it/s]
 10%|█         | 6706/65536 [1:15:01<10:49:49,  1.51it/s]
 10%|█         | 6707/65536 [1:15:02<11:04:43,  1.48it/s]
 10%|█         | 6708/65536 [1:15:03<10:59:31,  1.49it/s]
 10%|█         | 6709/65536 [1:15:04<10:57:37,  1.49it/s]
 10%|█         | 6710/65536 [1:15:04<10:58:54,  1.49it/s]
 10%|█         | 6711/65536 [1:15:05<11:07:14,  1.47it/s]
 10%|█         | 6712/65536 [1:15:06<10:57:28,  1.49it/s]
 10%|█         | 6713/65536 [1:15:06<10:52:21,  1.50it/s]
 10%|█         | 6714/65536 [1:15:07<10:56:27,  1.49it/s]
 10%|█         | 6715/65536 [1:15:07<10:44:08,  1.52it/s]
 10%|█         | 6716/65536 [1:15:08<10:50:37,  1.51it/s]
 10%|█         | 6717/65536 [1:15:09<10:34:35,  1.54it/s]
 10%|█         | 6718/65536 [1:15:10<11:02:36,  1.48it/s]
 10%|█         | 6719/65536 [1:15:10<10:45:39,  1.52it/s]
 10%|█         | 6720/65536 [1:15:11<11:02:01,  1.48it/s]
                                                         
{'loss': 1.0654, 'learning_rate': 9.101873392922738e-07, 'epoch': 414.81}

 10%|█         | 6720/65536 [1:15:11<11:02:01,  1.48it/s]
 10%|█         | 6721/65536 [1:15:12<10:57:31,  1.49it/s]
 10%|█         | 6722/65536 [1:15:12<10:57:18,  1.49it/s]
 10%|█         | 6723/65536 [1:15:13<11:06:48,  1.47it/s]
 10%|█         | 6724/65536 [1:15:14<11:24:54,  1.43it/s]
 10%|█         | 6725/65536 [1:15:14<10:57:19,  1.49it/s]
 10%|█         | 6726/65536 [1:15:15<11:01:30,  1.48it/s]
 10%|█         | 6727/65536 [1:15:16<10:53:31,  1.50it/s]
 10%|█         | 6728/65536 [1:15:16<10:41:41,  1.53it/s]
 10%|█         | 6729/65536 [1:15:17<10:45:50,  1.52it/s]
 10%|█         | 6730/65536 [1:15:18<10:43:40,  1.52it/s]
 10%|█         | 6731/65536 [1:15:18<10:52:39,  1.50it/s]
 10%|█         | 6732/65536 [1:15:19<11:00:24,  1.48it/s]
 10%|█         | 6733/65536 [1:15:20<11:07:32,  1.47it/s]
 10%|█         | 6734/65536 [1:15:20<11:10:12,  1.46it/s]
 10%|█         | 6735/65536 [1:15:21<11:02:21,  1.48it/s]
 10%|█         | 6736/65536 [1:15:22<10:43:16,  1.52it/s]
 10%|█         | 6737/65536 [1:15:22<10:49:34,  1.51it/s]
 10%|█         | 6738/65536 [1:15:23<10:58:44,  1.49it/s]
 10%|█         | 6739/65536 [1:15:24<10:51:54,  1.50it/s]
 10%|█         | 6740/65536 [1:15:24<11:01:20,  1.48it/s]
                                                         
{'loss': 1.102, 'learning_rate': 9.099118403330477e-07, 'epoch': 416.05}

 10%|█         | 6740/65536 [1:15:24<11:01:20,  1.48it/s]
 10%|█         | 6741/65536 [1:15:25<10:57:49,  1.49it/s]
 10%|█         | 6742/65536 [1:15:26<11:22:47,  1.44it/s]
 10%|█         | 6743/65536 [1:15:26<10:57:16,  1.49it/s]
 10%|█         | 6744/65536 [1:15:27<10:53:26,  1.50it/s]
 10%|█         | 6745/65536 [1:15:28<11:02:14,  1.48it/s]
 10%|█         | 6746/65536 [1:15:28<10:57:14,  1.49it/s]
 10%|█         | 6747/65536 [1:15:29<10:59:53,  1.48it/s]
 10%|█         | 6748/65536 [1:15:30<11:03:40,  1.48it/s]
 10%|█         | 6749/65536 [1:15:30<11:08:03,  1.47it/s]
 10%|█         | 6750/65536 [1:15:31<10:41:03,  1.53it/s]
 10%|█         | 6751/65536 [1:15:32<10:27:56,  1.56it/s]
 10%|█         | 6752/65536 [1:15:32<10:23:51,  1.57it/s]
 10%|█         | 6753/65536 [1:15:33<10:36:47,  1.54it/s]
 10%|█         | 6754/65536 [1:15:34<10:45:45,  1.52it/s]
 10%|█         | 6755/65536 [1:15:34<10:36:25,  1.54it/s]
 10%|█         | 6756/65536 [1:15:35<10:56:37,  1.49it/s]
 10%|█         | 6757/65536 [1:15:36<11:11:44,  1.46it/s]
 10%|█         | 6758/65536 [1:15:36<11:10:58,  1.46it/s]
 10%|█         | 6759/65536 [1:15:37<10:38:33,  1.53it/s]
 10%|█         | 6760/65536 [1:15:38<10:37:28,  1.54it/s]
                                                         
{'loss': 1.1023, 'learning_rate': 9.096363413738214e-07, 'epoch': 417.28}

 10%|█         | 6760/65536 [1:15:38<10:37:28,  1.54it/s]
 10%|█         | 6761/65536 [1:15:38<10:32:37,  1.55it/s]
 10%|█         | 6762/65536 [1:15:39<10:28:41,  1.56it/s]
 10%|█         | 6763/65536 [1:15:39<10:41:13,  1.53it/s]
 10%|█         | 6764/65536 [1:15:40<10:48:20,  1.51it/s]
 10%|█         | 6765/65536 [1:15:41<11:02:19,  1.48it/s]
 10%|█         | 6766/65536 [1:15:42<10:52:54,  1.50it/s]
 10%|█         | 6767/65536 [1:15:42<10:54:49,  1.50it/s]
 10%|█         | 6768/65536 [1:15:43<11:09:32,  1.46it/s]
 10%|█         | 6769/65536 [1:15:44<11:21:06,  1.44it/s]
 10%|█         | 6770/65536 [1:15:44<11:16:32,  1.45it/s]
 10%|█         | 6771/65536 [1:15:45<11:10:00,  1.46it/s]
 10%|█         | 6772/65536 [1:15:46<11:02:12,  1.48it/s]
 10%|█         | 6773/65536 [1:15:46<10:54:17,  1.50it/s]
 10%|█         | 6774/65536 [1:15:47<10:50:29,  1.51it/s]
 10%|█         | 6775/65536 [1:15:48<10:47:09,  1.51it/s]
 10%|█         | 6776/65536 [1:15:48<11:05:51,  1.47it/s]
 10%|█         | 6777/65536 [1:15:49<11:24:47,  1.43it/s]
 10%|█         | 6778/65536 [1:15:50<11:21:07,  1.44it/s]
 10%|█         | 6779/65536 [1:15:50<11:03:19,  1.48it/s]
 10%|█         | 6780/65536 [1:15:51<11:04:39,  1.47it/s]
                                                         
{'loss': 1.0714, 'learning_rate': 9.093608424145953e-07, 'epoch': 418.52}

 10%|█         | 6780/65536 [1:15:51<11:04:39,  1.47it/s]
 10%|█         | 6781/65536 [1:15:52<10:44:40,  1.52it/s]
 10%|█         | 6782/65536 [1:15:52<11:08:28,  1.46it/s]
 10%|█         | 6783/65536 [1:15:53<11:02:22,  1.48it/s]
 10%|█         | 6784/65536 [1:15:54<11:00:42,  1.48it/s]
 10%|█         | 6785/65536 [1:15:54<11:05:20,  1.47it/s]
 10%|█         | 6786/65536 [1:15:55<10:44:41,  1.52it/s]
 10%|█         | 6787/65536 [1:15:56<10:55:01,  1.49it/s]
 10%|█         | 6788/65536 [1:15:56<11:10:32,  1.46it/s]
 10%|█         | 6789/65536 [1:15:57<11:13:58,  1.45it/s]
 10%|█         | 6790/65536 [1:15:58<10:53:44,  1.50it/s]
 10%|█         | 6791/65536 [1:15:58<10:53:21,  1.50it/s]
 10%|█         | 6792/65536 [1:15:59<10:48:52,  1.51it/s]
 10%|█         | 6793/65536 [1:16:00<10:40:26,  1.53it/s]
 10%|█         | 6794/65536 [1:16:00<10:43:20,  1.52it/s]
 10%|█         | 6795/65536 [1:16:01<10:50:29,  1.51it/s]
 10%|█         | 6796/65536 [1:16:02<10:57:38,  1.49it/s]
 10%|█         | 6797/65536 [1:16:02<10:47:14,  1.51it/s]
 10%|█         | 6798/65536 [1:16:03<10:48:57,  1.51it/s]
 10%|█         | 6799/65536 [1:16:04<10:36:23,  1.54it/s]
 10%|█         | 6800/65536 [1:16:04<10:35:59,  1.54it/s]
                                                         
{'loss': 1.0971, 'learning_rate': 9.090853434553691e-07, 'epoch': 419.75}

 10%|█         | 6800/65536 [1:16:04<10:35:59,  1.54it/s]
 10%|█         | 6801/65536 [1:16:05<10:54:43,  1.50it/s]
 10%|█         | 6802/65536 [1:16:06<10:54:39,  1.50it/s]
 10%|█         | 6803/65536 [1:16:06<10:36:21,  1.54it/s]
 10%|█         | 6804/65536 [1:16:07<10:53:18,  1.50it/s]
 10%|█         | 6805/65536 [1:16:08<11:01:01,  1.48it/s]
 10%|█         | 6806/65536 [1:16:08<11:07:01,  1.47it/s]
 10%|█         | 6807/65536 [1:16:09<11:04:31,  1.47it/s]
 10%|█         | 6808/65536 [1:16:10<10:44:35,  1.52it/s]
 10%|█         | 6809/65536 [1:16:10<10:36:54,  1.54it/s]
 10%|█         | 6810/65536 [1:16:11<10:27:10,  1.56it/s]
 10%|█         | 6811/65536 [1:16:12<10:37:12,  1.54it/s]
 10%|█         | 6812/65536 [1:16:12<10:48:55,  1.51it/s]
 10%|█         | 6813/65536 [1:16:13<10:53:02,  1.50it/s]
 10%|█         | 6814/65536 [1:16:14<10:41:05,  1.53it/s]
 10%|█         | 6815/65536 [1:16:14<10:53:10,  1.50it/s]
 10%|█         | 6816/65536 [1:16:15<11:08:35,  1.46it/s]
 10%|█         | 6817/65536 [1:16:16<10:56:55,  1.49it/s]
 10%|█         | 6818/65536 [1:16:16<11:01:00,  1.48it/s]
 10%|█         | 6819/65536 [1:16:17<11:04:45,  1.47it/s]
 10%|█         | 6820/65536 [1:16:18<11:18:30,  1.44it/s]
                                                         
{'loss': 1.0819, 'learning_rate': 9.08809844496143e-07, 'epoch': 420.99}

 10%|█         | 6820/65536 [1:16:18<11:18:30,  1.44it/s]
 10%|█         | 6821/65536 [1:16:18<11:03:11,  1.48it/s]
 10%|█         | 6822/65536 [1:16:19<10:49:32,  1.51it/s]
 10%|█         | 6823/65536 [1:16:20<11:00:40,  1.48it/s]
 10%|█         | 6824/65536 [1:16:20<10:54:30,  1.50it/s]
 10%|█         | 6825/65536 [1:16:21<11:05:01,  1.47it/s]
 10%|█         | 6826/65536 [1:16:22<11:01:19,  1.48it/s]
 10%|█         | 6827/65536 [1:16:22<10:55:01,  1.49it/s]
 10%|█         | 6828/65536 [1:16:23<10:50:22,  1.50it/s]
 10%|█         | 6829/65536 [1:16:24<11:00:05,  1.48it/s]
 10%|█         | 6830/65536 [1:16:24<10:47:25,  1.51it/s]
 10%|█         | 6831/65536 [1:16:25<11:16:37,  1.45it/s]
 10%|█         | 6832/65536 [1:16:26<11:08:11,  1.46it/s]
 10%|█         | 6833/65536 [1:16:27<11:18:35,  1.44it/s]
 10%|█         | 6834/65536 [1:16:27<10:48:53,  1.51it/s]
 10%|█         | 6835/65536 [1:16:28<10:49:09,  1.51it/s]
 10%|█         | 6836/65536 [1:16:28<10:46:27,  1.51it/s]
 10%|█         | 6837/65536 [1:16:29<10:38:27,  1.53it/s]
 10%|█         | 6838/65536 [1:16:30<10:48:41,  1.51it/s]
 10%|█         | 6839/65536 [1:16:31<11:01:55,  1.48it/s]
 10%|█         | 6840/65536 [1:16:31<11:05:08,  1.47it/s]
                                                         
{'loss': 1.0948, 'learning_rate': 9.085343455369169e-07, 'epoch': 422.22}

 10%|█         | 6840/65536 [1:16:31<11:05:08,  1.47it/s]
 10%|█         | 6841/65536 [1:16:32<10:50:56,  1.50it/s]
 10%|█         | 6842/65536 [1:16:32<10:44:01,  1.52it/s]
 10%|█         | 6843/65536 [1:16:33<10:35:31,  1.54it/s]
 10%|█         | 6844/65536 [1:16:34<10:46:51,  1.51it/s]
 10%|█         | 6845/65536 [1:16:34<10:38:32,  1.53it/s]
 10%|█         | 6846/65536 [1:16:35<10:56:15,  1.49it/s]
 10%|█         | 6847/65536 [1:16:36<11:07:10,  1.47it/s]
 10%|█         | 6848/65536 [1:16:37<11:07:31,  1.47it/s]
 10%|█         | 6849/65536 [1:16:37<11:15:24,  1.45it/s]
 10%|█         | 6850/65536 [1:16:38<11:01:48,  1.48it/s]
 10%|█         | 6851/65536 [1:16:39<10:59:59,  1.48it/s]
 10%|█         | 6852/65536 [1:16:39<10:46:12,  1.51it/s]
 10%|█         | 6853/65536 [1:16:40<10:52:31,  1.50it/s]
 10%|█         | 6854/65536 [1:16:40<10:44:52,  1.52it/s]
 10%|█         | 6855/65536 [1:16:41<10:40:43,  1.53it/s]
 10%|█         | 6856/65536 [1:16:42<10:33:03,  1.54it/s]
 10%|█         | 6857/65536 [1:16:42<10:34:47,  1.54it/s]
 10%|█         | 6858/65536 [1:16:43<10:38:59,  1.53it/s]
 10%|█         | 6859/65536 [1:16:44<10:38:41,  1.53it/s]
 10%|█         | 6860/65536 [1:16:44<10:45:16,  1.52it/s]
                                                         
{'loss': 1.1018, 'learning_rate': 9.082588465776907e-07, 'epoch': 423.46}

 10%|█         | 6860/65536 [1:16:44<10:45:16,  1.52it/s]
 10%|█         | 6861/65536 [1:16:45<10:48:47,  1.51it/s]
 10%|█         | 6862/65536 [1:16:46<10:41:41,  1.52it/s]
 10%|█         | 6863/65536 [1:16:46<10:50:59,  1.50it/s]
 10%|█         | 6864/65536 [1:16:47<11:09:14,  1.46it/s]
 10%|█         | 6865/65536 [1:16:48<11:04:04,  1.47it/s]
 10%|█         | 6866/65536 [1:16:49<11:13:43,  1.45it/s]
 10%|█         | 6867/65536 [1:16:49<11:16:38,  1.45it/s]
 10%|█         | 6868/65536 [1:16:50<11:12:01,  1.45it/s]
 10%|█         | 6869/65536 [1:16:51<11:07:19,  1.47it/s]
 10%|█         | 6870/65536 [1:16:51<10:54:14,  1.49it/s]
 10%|█         | 6871/65536 [1:16:52<11:00:37,  1.48it/s]
 10%|█         | 6872/65536 [1:16:52<10:34:48,  1.54it/s]
 10%|█         | 6873/65536 [1:16:53<10:53:47,  1.50it/s]
 10%|█         | 6874/65536 [1:16:54<10:45:13,  1.52it/s]
 10%|█         | 6875/65536 [1:16:55<10:48:38,  1.51it/s]
 10%|█         | 6876/65536 [1:16:55<10:53:58,  1.49it/s]
 10%|█         | 6877/65536 [1:16:56<10:58:53,  1.48it/s]
 10%|█         | 6878/65536 [1:16:57<10:53:38,  1.50it/s]
 10%|█         | 6879/65536 [1:16:57<10:45:18,  1.51it/s]
 10%|█         | 6880/65536 [1:16:58<10:27:08,  1.56it/s]
                                                         
{'loss': 1.0724, 'learning_rate': 9.079833476184645e-07, 'epoch': 424.69}

 10%|█         | 6880/65536 [1:16:58<10:27:08,  1.56it/s]
 10%|█         | 6881/65536 [1:16:58<10:39:03,  1.53it/s]
 11%|█         | 6882/65536 [1:16:59<10:36:58,  1.53it/s]
 11%|█         | 6883/65536 [1:17:00<10:56:38,  1.49it/s]
 11%|█         | 6884/65536 [1:17:00<10:55:47,  1.49it/s]
 11%|█         | 6885/65536 [1:17:01<11:02:02,  1.48it/s]
 11%|█         | 6886/65536 [1:17:02<11:11:09,  1.46it/s]
 11%|█         | 6887/65536 [1:17:03<11:07:28,  1.46it/s]
 11%|█         | 6888/65536 [1:17:03<10:57:57,  1.49it/s]
 11%|█         | 6889/65536 [1:17:04<10:51:03,  1.50it/s]
 11%|█         | 6890/65536 [1:17:05<11:12:23,  1.45it/s]
 11%|█         | 6891/65536 [1:17:05<11:09:07,  1.46it/s]
 11%|█         | 6892/65536 [1:17:06<11:15:44,  1.45it/s]
 11%|█         | 6893/65536 [1:17:07<11:15:31,  1.45it/s]
 11%|█         | 6894/65536 [1:17:07<11:07:22,  1.46it/s]
 11%|█         | 6895/65536 [1:17:08<11:00:43,  1.48it/s]
 11%|█         | 6896/65536 [1:17:09<11:01:16,  1.48it/s]
 11%|█         | 6897/65536 [1:17:09<10:56:22,  1.49it/s]
 11%|█         | 6898/65536 [1:17:10<10:44:10,  1.52it/s]
 11%|█         | 6899/65536 [1:17:11<11:05:49,  1.47it/s]
 11%|█         | 6900/65536 [1:17:11<10:52:17,  1.50it/s]
                                                         
{'loss': 1.0587, 'learning_rate': 9.077078486592383e-07, 'epoch': 425.93}

 11%|█         | 6900/65536 [1:17:11<10:52:17,  1.50it/s]
 11%|█         | 6901/65536 [1:17:12<10:53:49,  1.49it/s]
 11%|█         | 6902/65536 [1:17:13<11:07:52,  1.46it/s]
 11%|█         | 6903/65536 [1:17:13<11:02:48,  1.47it/s]
 11%|█         | 6904/65536 [1:17:14<10:54:24,  1.49it/s]
 11%|█         | 6905/65536 [1:17:15<11:14:29,  1.45it/s]
 11%|█         | 6906/65536 [1:17:15<11:19:36,  1.44it/s]
 11%|█         | 6907/65536 [1:17:16<11:16:50,  1.44it/s]
 11%|█         | 6908/65536 [1:17:17<11:05:52,  1.47it/s]
 11%|█         | 6909/65536 [1:17:17<10:58:28,  1.48it/s]
 11%|█         | 6910/65536 [1:17:18<10:46:07,  1.51it/s]
 11%|█         | 6911/65536 [1:17:19<11:05:46,  1.47it/s]
 11%|█         | 6912/65536 [1:17:19<10:54:12,  1.49it/s]
 11%|█         | 6913/65536 [1:17:20<10:33:30,  1.54it/s]
 11%|█         | 6914/65536 [1:17:21<10:38:42,  1.53it/s]
 11%|█         | 6915/65536 [1:17:21<10:57:56,  1.48it/s]
 11%|█         | 6916/65536 [1:17:22<10:48:07,  1.51it/s]
 11%|█         | 6917/65536 [1:17:23<10:59:27,  1.48it/s]
 11%|█         | 6918/65536 [1:17:24<11:13:25,  1.45it/s]
 11%|█         | 6919/65536 [1:17:24<11:07:10,  1.46it/s]
 11%|█         | 6920/65536 [1:17:25<11:17:55,  1.44it/s]
                                                         
{'loss': 1.0842, 'learning_rate': 9.074323497000122e-07, 'epoch': 427.16}

 11%|█         | 6920/65536 [1:17:25<11:17:55,  1.44it/s]
 11%|█         | 6921/65536 [1:17:26<11:05:08,  1.47it/s]
 11%|█         | 6922/65536 [1:17:26<11:04:03,  1.47it/s]
 11%|█         | 6923/65536 [1:17:27<11:09:11,  1.46it/s]
 11%|█         | 6924/65536 [1:17:28<11:08:06,  1.46it/s]
 11%|█         | 6925/65536 [1:17:28<11:07:12,  1.46it/s]
 11%|█         | 6926/65536 [1:17:29<10:54:40,  1.49it/s]
 11%|█         | 6927/65536 [1:17:30<10:46:10,  1.51it/s]
 11%|█         | 6928/65536 [1:17:30<10:50:41,  1.50it/s]
 11%|█         | 6929/65536 [1:17:31<10:47:53,  1.51it/s]
 11%|█         | 6930/65536 [1:17:32<11:03:34,  1.47it/s]
 11%|█         | 6931/65536 [1:17:32<10:52:18,  1.50it/s]
 11%|█         | 6932/65536 [1:17:33<10:52:41,  1.50it/s]
 11%|█         | 6933/65536 [1:17:34<10:42:12,  1.52it/s]
 11%|█         | 6934/65536 [1:17:34<11:00:14,  1.48it/s]
 11%|█         | 6935/65536 [1:17:35<10:59:16,  1.48it/s]
 11%|█         | 6936/65536 [1:17:36<10:47:29,  1.51it/s]
 11%|█         | 6937/65536 [1:17:36<10:43:57,  1.52it/s]
 11%|█         | 6938/65536 [1:17:37<10:49:27,  1.50it/s]
 11%|█         | 6939/65536 [1:17:38<10:33:49,  1.54it/s]
 11%|█         | 6940/65536 [1:17:38<10:30:59,  1.55it/s]
                                                         
{'loss': 1.0859, 'learning_rate': 9.07156850740786e-07, 'epoch': 428.4}

 11%|█         | 6940/65536 [1:17:38<10:30:59,  1.55it/s]
 11%|█         | 6941/65536 [1:17:39<10:50:32,  1.50it/s]
 11%|█         | 6942/65536 [1:17:40<10:39:02,  1.53it/s]
 11%|█         | 6943/65536 [1:17:40<10:42:59,  1.52it/s]
 11%|█         | 6944/65536 [1:17:41<10:51:21,  1.50it/s]
 11%|█         | 6945/65536 [1:17:42<10:58:02,  1.48it/s]
 11%|█         | 6946/65536 [1:17:42<10:55:33,  1.49it/s]
 11%|█         | 6947/65536 [1:17:43<10:59:16,  1.48it/s]
 11%|█         | 6948/65536 [1:17:44<11:16:28,  1.44it/s]
 11%|█         | 6949/65536 [1:17:44<11:14:01,  1.45it/s]
 11%|█         | 6950/65536 [1:17:45<11:31:39,  1.41it/s]
 11%|█         | 6951/65536 [1:17:46<11:18:56,  1.44it/s]
 11%|█         | 6952/65536 [1:17:46<11:10:52,  1.46it/s]
 11%|█         | 6953/65536 [1:17:47<11:04:02,  1.47it/s]
 11%|█         | 6954/65536 [1:17:48<11:16:57,  1.44it/s]
 11%|█         | 6955/65536 [1:17:49<11:15:12,  1.45it/s]
 11%|█         | 6956/65536 [1:17:49<10:59:04,  1.48it/s]
 11%|█         | 6957/65536 [1:17:50<10:49:13,  1.50it/s]
 11%|█         | 6958/65536 [1:17:50<10:40:59,  1.52it/s]
 11%|█         | 6959/65536 [1:17:51<10:52:33,  1.50it/s]
 11%|█         | 6960/65536 [1:17:52<10:57:38,  1.48it/s]
                                                         
{'loss': 1.0615, 'learning_rate': 9.068813517815599e-07, 'epoch': 429.63}

 11%|█         | 6960/65536 [1:17:52<10:57:38,  1.48it/s]
 11%|█         | 6961/65536 [1:17:52<10:44:28,  1.51it/s]
 11%|█         | 6962/65536 [1:17:53<11:01:37,  1.48it/s]
 11%|█         | 6963/65536 [1:17:54<11:05:34,  1.47it/s]
 11%|█         | 6964/65536 [1:17:54<10:39:17,  1.53it/s]
 11%|█         | 6965/65536 [1:17:55<10:39:01,  1.53it/s]
 11%|█         | 6966/65536 [1:17:56<10:42:24,  1.52it/s]
 11%|█         | 6967/65536 [1:17:56<10:57:00,  1.49it/s]
 11%|█         | 6968/65536 [1:17:57<11:11:10,  1.45it/s]
 11%|█         | 6969/65536 [1:17:58<11:02:59,  1.47it/s]
 11%|█         | 6970/65536 [1:17:58<10:37:03,  1.53it/s]
 11%|█         | 6971/65536 [1:17:59<10:34:59,  1.54it/s]
 11%|█         | 6972/65536 [1:18:00<10:55:42,  1.49it/s]
 11%|█         | 6973/65536 [1:18:00<10:53:42,  1.49it/s]
 11%|█         | 6974/65536 [1:18:01<10:48:30,  1.51it/s]
 11%|█         | 6975/65536 [1:18:02<10:44:37,  1.51it/s]
 11%|█         | 6976/65536 [1:18:02<10:46:08,  1.51it/s]
 11%|█         | 6977/65536 [1:18:03<10:39:16,  1.53it/s]
 11%|█         | 6978/65536 [1:18:04<10:48:30,  1.50it/s]
 11%|█         | 6979/65536 [1:18:04<10:41:24,  1.52it/s]
 11%|█         | 6980/65536 [1:18:05<10:55:07,  1.49it/s]
                                                         
{'loss': 1.0749, 'learning_rate': 9.066058528223339e-07, 'epoch': 430.86}

 11%|█         | 6980/65536 [1:18:05<10:55:07,  1.49it/s]
 11%|█         | 6981/65536 [1:18:06<11:01:04,  1.48it/s]
 11%|█         | 6982/65536 [1:18:06<10:52:33,  1.50it/s]
 11%|█         | 6983/65536 [1:18:07<11:10:24,  1.46it/s]
 11%|█         | 6984/65536 [1:18:08<10:51:13,  1.50it/s]
 11%|█         | 6985/65536 [1:18:09<11:02:09,  1.47it/s]
 11%|█         | 6986/65536 [1:18:09<11:27:21,  1.42it/s]
 11%|█         | 6987/65536 [1:18:10<11:11:31,  1.45it/s]
 11%|█         | 6988/65536 [1:18:11<11:12:06,  1.45it/s]
 11%|█         | 6989/65536 [1:18:11<10:59:08,  1.48it/s]
 11%|█         | 6990/65536 [1:18:12<11:06:42,  1.46it/s]
 11%|█         | 6991/65536 [1:18:13<10:53:22,  1.49it/s]
 11%|█         | 6992/65536 [1:18:13<10:56:07,  1.49it/s]
 11%|█         | 6993/65536 [1:18:14<10:54:28,  1.49it/s]
 11%|█         | 6994/65536 [1:18:15<10:43:52,  1.52it/s]
 11%|█         | 6995/65536 [1:18:15<10:40:26,  1.52it/s]
 11%|█         | 6996/65536 [1:18:16<10:44:44,  1.51it/s]
 11%|█         | 6997/65536 [1:18:17<10:48:23,  1.50it/s]
 11%|█         | 6998/65536 [1:18:17<10:40:23,  1.52it/s]
 11%|█         | 6999/65536 [1:18:18<11:02:43,  1.47it/s]
 11%|█         | 7000/65536 [1:18:19<10:54:22,  1.49it/s]
                                                         
{'loss': 1.0865, 'learning_rate': 9.063303538631076e-07, 'epoch': 432.1}

 11%|█         | 7000/65536 [1:18:19<10:54:22,  1.49it/s]
 11%|█         | 7001/65536 [1:18:19<10:54:35,  1.49it/s]
 11%|█         | 7002/65536 [1:18:20<10:50:56,  1.50it/s]
 11%|█         | 7003/65536 [1:18:21<10:48:23,  1.50it/s]
 11%|█         | 7004/65536 [1:18:21<10:39:42,  1.52it/s]
 11%|█         | 7005/65536 [1:18:22<10:42:27,  1.52it/s]
 11%|█         | 7006/65536 [1:18:23<11:00:41,  1.48it/s]
 11%|█         | 7007/65536 [1:18:23<11:00:28,  1.48it/s]
 11%|█         | 7008/65536 [1:18:24<11:05:34,  1.47it/s]
 11%|█         | 7009/65536 [1:18:25<10:49:41,  1.50it/s]
 11%|█         | 7010/65536 [1:18:25<10:56:31,  1.49it/s]
 11%|█         | 7011/65536 [1:18:26<11:01:48,  1.47it/s]
 11%|█         | 7012/65536 [1:18:27<10:47:02,  1.51it/s]
 11%|█         | 7013/65536 [1:18:27<10:49:52,  1.50it/s]
 11%|█         | 7014/65536 [1:18:28<11:20:01,  1.43it/s]
 11%|█         | 7015/65536 [1:18:29<11:30:13,  1.41it/s]
 11%|█         | 7016/65536 [1:18:29<11:10:23,  1.45it/s]
 11%|█         | 7017/65536 [1:18:30<10:55:51,  1.49it/s]
 11%|█         | 7018/65536 [1:18:31<10:50:03,  1.50it/s]
 11%|█         | 7019/65536 [1:18:31<10:50:41,  1.50it/s]
 11%|█         | 7020/65536 [1:18:32<11:00:46,  1.48it/s]
                                                         
{'loss': 1.0621, 'learning_rate': 9.060548549038814e-07, 'epoch': 433.33}

 11%|█         | 7020/65536 [1:18:32<11:00:46,  1.48it/s]
 11%|█         | 7021/65536 [1:18:33<10:49:14,  1.50it/s]
 11%|█         | 7022/65536 [1:18:33<10:50:41,  1.50it/s]
 11%|█         | 7023/65536 [1:18:34<10:55:04,  1.49it/s]
 11%|█         | 7024/65536 [1:18:35<10:41:22,  1.52it/s]
 11%|█         | 7025/65536 [1:18:35<10:49:36,  1.50it/s]
 11%|█         | 7026/65536 [1:18:36<10:53:45,  1.49it/s]
 11%|█         | 7027/65536 [1:18:37<11:11:09,  1.45it/s]
 11%|█         | 7028/65536 [1:18:37<10:56:29,  1.49it/s]
 11%|█         | 7029/65536 [1:18:38<10:56:15,  1.49it/s]
 11%|█         | 7030/65536 [1:18:39<10:48:21,  1.50it/s]
 11%|█         | 7031/65536 [1:18:39<11:00:33,  1.48it/s]
 11%|█         | 7032/65536 [1:18:40<11:00:00,  1.48it/s]
 11%|█         | 7033/65536 [1:18:41<10:58:16,  1.48it/s]
 11%|█         | 7034/65536 [1:18:41<10:48:02,  1.50it/s]
 11%|█         | 7035/65536 [1:18:42<10:46:01,  1.51it/s]
 11%|█         | 7036/65536 [1:18:43<10:45:12,  1.51it/s]
 11%|█         | 7037/65536 [1:18:43<10:45:26,  1.51it/s]
 11%|█         | 7038/65536 [1:18:44<10:50:52,  1.50it/s]
 11%|█         | 7039/65536 [1:18:45<11:09:09,  1.46it/s]
 11%|█         | 7040/65536 [1:18:45<10:50:32,  1.50it/s]
                                                         
{'loss': 1.0725, 'learning_rate': 9.057793559446552e-07, 'epoch': 434.57}

 11%|█         | 7040/65536 [1:18:45<10:50:32,  1.50it/s]
 11%|█         | 7041/65536 [1:18:46<10:40:37,  1.52it/s]
 11%|█         | 7042/65536 [1:18:47<10:41:10,  1.52it/s]
 11%|█         | 7043/65536 [1:18:47<10:48:37,  1.50it/s]
 11%|█         | 7044/65536 [1:18:48<10:53:01,  1.49it/s]
 11%|█         | 7045/65536 [1:18:49<11:05:48,  1.46it/s]
 11%|█         | 7046/65536 [1:18:49<11:03:54,  1.47it/s]
 11%|█         | 7047/65536 [1:18:50<10:59:00,  1.48it/s]
 11%|█         | 7048/65536 [1:18:51<11:21:31,  1.43it/s]
 11%|█         | 7049/65536 [1:18:52<11:04:09,  1.47it/s]
 11%|█         | 7050/65536 [1:18:52<10:42:17,  1.52it/s]
 11%|█         | 7051/65536 [1:18:53<10:39:37,  1.52it/s]
 11%|█         | 7052/65536 [1:18:54<11:06:44,  1.46it/s]
 11%|█         | 7053/65536 [1:18:54<10:55:40,  1.49it/s]
 11%|█         | 7054/65536 [1:18:55<10:53:42,  1.49it/s]
 11%|█         | 7055/65536 [1:18:56<11:00:44,  1.48it/s]
 11%|█         | 7056/65536 [1:18:56<10:54:21,  1.49it/s]
 11%|█         | 7057/65536 [1:18:57<10:46:33,  1.51it/s]
 11%|█         | 7058/65536 [1:18:58<10:56:02,  1.49it/s]
 11%|█         | 7059/65536 [1:18:58<10:53:29,  1.49it/s]
 11%|█         | 7060/65536 [1:18:59<10:35:49,  1.53it/s]
                                                         
{'loss': 1.0697, 'learning_rate': 9.055038569854291e-07, 'epoch': 435.8}

 11%|█         | 7060/65536 [1:18:59<10:35:49,  1.53it/s]
 11%|█         | 7061/65536 [1:19:00<10:45:27,  1.51it/s]
 11%|█         | 7062/65536 [1:19:00<10:56:41,  1.48it/s]
 11%|█         | 7063/65536 [1:19:01<10:51:54,  1.49it/s]
 11%|█         | 7064/65536 [1:19:02<11:08:36,  1.46it/s]
 11%|█         | 7065/65536 [1:19:02<11:26:39,  1.42it/s]
 11%|█         | 7066/65536 [1:19:03<11:07:24,  1.46it/s]
 11%|█         | 7067/65536 [1:19:04<11:02:19,  1.47it/s]
 11%|█         | 7068/65536 [1:19:04<11:20:29,  1.43it/s]
 11%|█         | 7069/65536 [1:19:05<11:06:08,  1.46it/s]
 11%|█         | 7070/65536 [1:19:06<10:49:11,  1.50it/s]
 11%|█         | 7071/65536 [1:19:06<10:53:04,  1.49it/s]
 11%|█         | 7072/65536 [1:19:07<10:41:32,  1.52it/s]
 11%|█         | 7073/65536 [1:19:08<10:45:10,  1.51it/s]
 11%|█         | 7074/65536 [1:19:08<10:34:42,  1.54it/s]
 11%|█         | 7075/65536 [1:19:09<10:39:43,  1.52it/s]
 11%|█         | 7076/65536 [1:19:10<10:33:02,  1.54it/s]
 11%|█         | 7077/65536 [1:19:10<10:47:10,  1.51it/s]
 11%|█         | 7078/65536 [1:19:11<10:42:46,  1.52it/s]
 11%|█         | 7079/65536 [1:19:12<10:40:17,  1.52it/s]
 11%|█         | 7080/65536 [1:19:12<10:54:50,  1.49it/s]
                                                         
{'loss': 1.0846, 'learning_rate': 9.05228358026203e-07, 'epoch': 437.04}

 11%|█         | 7080/65536 [1:19:12<10:54:50,  1.49it/s]
 11%|█         | 7081/65536 [1:19:13<10:48:41,  1.50it/s]
 11%|█         | 7082/65536 [1:19:14<10:42:26,  1.52it/s]
 11%|█         | 7083/65536 [1:19:14<10:33:25,  1.54it/s]
 11%|█         | 7084/65536 [1:19:15<10:34:06,  1.54it/s]
 11%|█         | 7085/65536 [1:19:16<11:03:32,  1.47it/s]
 11%|█         | 7086/65536 [1:19:16<11:17:08,  1.44it/s]
 11%|█         | 7087/65536 [1:19:17<11:17:04,  1.44it/s]
 11%|█         | 7088/65536 [1:19:18<11:11:28,  1.45it/s]
 11%|█         | 7089/65536 [1:19:18<11:16:30,  1.44it/s]
 11%|█         | 7090/65536 [1:19:19<10:58:21,  1.48it/s]
 11%|█         | 7091/65536 [1:19:20<10:44:27,  1.51it/s]
 11%|█         | 7092/65536 [1:19:20<10:46:07,  1.51it/s]
 11%|█         | 7093/65536 [1:19:21<10:42:11,  1.52it/s]
 11%|█         | 7094/65536 [1:19:22<10:30:52,  1.54it/s]
 11%|█         | 7095/65536 [1:19:22<10:39:36,  1.52it/s]
 11%|█         | 7096/65536 [1:19:23<11:21:47,  1.43it/s]
 11%|█         | 7097/65536 [1:19:24<11:04:34,  1.47it/s]
 11%|█         | 7098/65536 [1:19:24<10:57:57,  1.48it/s]
 11%|█         | 7099/65536 [1:19:25<11:17:54,  1.44it/s]
 11%|█         | 7100/65536 [1:19:26<11:14:01,  1.44it/s]
                                                         
{'loss': 1.0432, 'learning_rate': 9.049528590669768e-07, 'epoch': 438.27}

 11%|█         | 7100/65536 [1:19:26<11:14:01,  1.44it/s]
 11%|█         | 7101/65536 [1:19:26<11:03:55,  1.47it/s]
 11%|█         | 7102/65536 [1:19:27<10:56:40,  1.48it/s]
 11%|█         | 7103/65536 [1:19:28<11:03:17,  1.47it/s]
 11%|█         | 7104/65536 [1:19:29<10:58:08,  1.48it/s]
 11%|█         | 7105/65536 [1:19:29<10:34:45,  1.53it/s]
 11%|█         | 7106/65536 [1:19:30<10:36:14,  1.53it/s]
 11%|█         | 7107/65536 [1:19:30<10:52:18,  1.49it/s]
 11%|█         | 7108/65536 [1:19:31<10:37:58,  1.53it/s]
 11%|█         | 7109/65536 [1:19:32<10:31:37,  1.54it/s]
 11%|█         | 7110/65536 [1:19:32<10:44:09,  1.51it/s]
 11%|█         | 7111/65536 [1:19:33<11:00:23,  1.47it/s]
 11%|█         | 7112/65536 [1:19:34<11:00:55,  1.47it/s]
 11%|█         | 7113/65536 [1:19:34<10:52:49,  1.49it/s]
 11%|█         | 7114/65536 [1:19:35<10:44:15,  1.51it/s]
 11%|█         | 7115/65536 [1:19:36<10:24:51,  1.56it/s]
 11%|█         | 7116/65536 [1:19:36<10:59:12,  1.48it/s]
 11%|█         | 7117/65536 [1:19:37<10:45:03,  1.51it/s]
 11%|█         | 7118/65536 [1:19:38<10:36:19,  1.53it/s]
 11%|█         | 7119/65536 [1:19:38<10:46:21,  1.51it/s]
 11%|█         | 7120/65536 [1:19:39<11:07:16,  1.46it/s]
                                                         
{'loss': 1.0864, 'learning_rate': 9.046773601077507e-07, 'epoch': 439.51}

 11%|█         | 7120/65536 [1:19:39<11:07:16,  1.46it/s]
 11%|█         | 7121/65536 [1:19:40<10:59:15,  1.48it/s]
 11%|█         | 7122/65536 [1:19:40<11:03:53,  1.47it/s]
 11%|█         | 7123/65536 [1:19:41<10:42:54,  1.51it/s]
 11%|█         | 7124/65536 [1:19:42<10:32:20,  1.54it/s]
 11%|█         | 7125/65536 [1:19:42<10:49:29,  1.50it/s]
 11%|█         | 7126/65536 [1:19:43<10:47:36,  1.50it/s]
 11%|█         | 7127/65536 [1:19:44<10:30:27,  1.54it/s]
 11%|█         | 7128/65536 [1:19:44<10:20:40,  1.57it/s]
 11%|█         | 7129/65536 [1:19:45<10:34:14,  1.53it/s]
 11%|█         | 7130/65536 [1:19:46<10:47:13,  1.50it/s]
 11%|█         | 7131/65536 [1:19:46<11:04:58,  1.46it/s]
 11%|█         | 7132/65536 [1:19:47<10:51:34,  1.49it/s]
 11%|█         | 7133/65536 [1:19:48<10:51:17,  1.49it/s]
 11%|█         | 7134/65536 [1:19:48<11:07:45,  1.46it/s]
 11%|█         | 7135/65536 [1:19:49<10:56:40,  1.48it/s]
 11%|█         | 7136/65536 [1:19:50<10:50:47,  1.50it/s]
 11%|█         | 7137/65536 [1:19:50<10:53:38,  1.49it/s]
 11%|█         | 7138/65536 [1:19:51<10:57:34,  1.48it/s]
 11%|█         | 7139/65536 [1:19:52<10:56:21,  1.48it/s]
 11%|█         | 7140/65536 [1:19:52<10:46:47,  1.50it/s]
                                                         
{'loss': 1.0973, 'learning_rate': 9.044018611485244e-07, 'epoch': 440.74}

 11%|█         | 7140/65536 [1:19:52<10:46:47,  1.50it/s]
 11%|█         | 7141/65536 [1:19:53<10:46:14,  1.51it/s]
 11%|█         | 7142/65536 [1:19:54<10:43:18,  1.51it/s]
 11%|█         | 7143/65536 [1:19:54<10:39:01,  1.52it/s]
 11%|█         | 7144/65536 [1:19:55<10:40:14,  1.52it/s]
 11%|█         | 7145/65536 [1:19:56<10:55:17,  1.49it/s]
 11%|█         | 7146/65536 [1:19:56<10:52:36,  1.49it/s]
 11%|█         | 7147/65536 [1:19:57<10:47:56,  1.50it/s]
 11%|█         | 7148/65536 [1:19:58<10:33:45,  1.54it/s]
 11%|█         | 7149/65536 [1:19:58<10:39:56,  1.52it/s]
 11%|█         | 7150/65536 [1:19:59<10:24:55,  1.56it/s]
 11%|█         | 7151/65536 [1:20:00<10:51:42,  1.49it/s]
 11%|█         | 7152/65536 [1:20:00<10:45:19,  1.51it/s]
 11%|█         | 7153/65536 [1:20:01<10:39:59,  1.52it/s]
 11%|█         | 7154/65536 [1:20:02<10:46:42,  1.50it/s]
 11%|█         | 7155/65536 [1:20:02<10:46:59,  1.50it/s]
 11%|█         | 7156/65536 [1:20:03<10:53:19,  1.49it/s]
 11%|█         | 7157/65536 [1:20:04<10:36:02,  1.53it/s]
 11%|█         | 7158/65536 [1:20:04<11:00:18,  1.47it/s]
 11%|█         | 7159/65536 [1:20:05<11:04:14,  1.46it/s]
 11%|█         | 7160/65536 [1:20:06<11:00:26,  1.47it/s]
                                                         
{'loss': 1.0651, 'learning_rate': 9.041263621892983e-07, 'epoch': 441.98}

 11%|█         | 7160/65536 [1:20:06<11:00:26,  1.47it/s]
 11%|█         | 7161/65536 [1:20:06<11:08:19,  1.46it/s]
 11%|█         | 7162/65536 [1:20:07<11:07:07,  1.46it/s]
 11%|█         | 7163/65536 [1:20:08<10:48:44,  1.50it/s]
 11%|█         | 7164/65536 [1:20:08<10:46:33,  1.50it/s]
 11%|█         | 7165/65536 [1:20:09<10:32:58,  1.54it/s]
 11%|█         | 7166/65536 [1:20:10<10:58:19,  1.48it/s]
 11%|█         | 7167/65536 [1:20:10<10:47:04,  1.50it/s]
 11%|█         | 7168/65536 [1:20:11<11:04:29,  1.46it/s]
 11%|█         | 7169/65536 [1:20:12<11:04:29,  1.46it/s]
 11%|█         | 7170/65536 [1:20:13<11:10:36,  1.45it/s]
 11%|█         | 7171/65536 [1:20:13<10:55:28,  1.48it/s]
 11%|█         | 7172/65536 [1:20:14<10:44:08,  1.51it/s]
 11%|█         | 7173/65536 [1:20:14<10:47:43,  1.50it/s]
 11%|█         | 7174/65536 [1:20:15<10:40:40,  1.52it/s]
 11%|█         | 7175/65536 [1:20:16<10:54:14,  1.49it/s]
 11%|█         | 7176/65536 [1:20:16<10:38:30,  1.52it/s]
 11%|█         | 7177/65536 [1:20:17<10:42:26,  1.51it/s]
 11%|█         | 7178/65536 [1:20:18<10:41:57,  1.52it/s]
 11%|█         | 7179/65536 [1:20:18<10:28:04,  1.55it/s]
 11%|█         | 7180/65536 [1:20:19<10:37:21,  1.53it/s]
                                                         
{'loss': 1.0885, 'learning_rate': 9.038508632300721e-07, 'epoch': 443.21}

 11%|█         | 7180/65536 [1:20:19<10:37:21,  1.53it/s]
 11%|█         | 7181/65536 [1:20:20<10:46:59,  1.50it/s]
 11%|█         | 7182/65536 [1:20:20<11:01:08,  1.47it/s]
 11%|█         | 7183/65536 [1:20:21<11:06:43,  1.46it/s]
 11%|█         | 7184/65536 [1:20:22<10:58:01,  1.48it/s]
 11%|█         | 7185/65536 [1:20:22<10:57:42,  1.48it/s]
 11%|█         | 7186/65536 [1:20:23<11:08:09,  1.46it/s]
 11%|█         | 7187/65536 [1:20:24<11:27:42,  1.41it/s]
 11%|█         | 7188/65536 [1:20:25<11:03:28,  1.47it/s]
 11%|█         | 7189/65536 [1:20:25<10:51:10,  1.49it/s]
 11%|█         | 7190/65536 [1:20:26<10:55:18,  1.48it/s]
 11%|█         | 7191/65536 [1:20:27<11:01:38,  1.47it/s]
 11%|█         | 7192/65536 [1:20:27<11:03:33,  1.47it/s]
 11%|█         | 7193/65536 [1:20:28<11:03:16,  1.47it/s]
 11%|█         | 7194/65536 [1:20:29<10:50:52,  1.49it/s]
 11%|█         | 7195/65536 [1:20:29<10:48:04,  1.50it/s]
 11%|█         | 7196/65536 [1:20:30<10:58:14,  1.48it/s]
 11%|█         | 7197/65536 [1:20:31<11:12:51,  1.45it/s]
 11%|█         | 7198/65536 [1:20:31<10:56:45,  1.48it/s]
 11%|█         | 7199/65536 [1:20:32<11:02:42,  1.47it/s]
 11%|█         | 7200/65536 [1:20:33<10:53:07,  1.49it/s]
                                                         
{'loss': 1.054, 'learning_rate': 9.03575364270846e-07, 'epoch': 444.44}

 11%|█         | 7200/65536 [1:20:33<10:53:07,  1.49it/s]
 11%|█         | 7201/65536 [1:20:33<10:57:29,  1.48it/s]
 11%|█         | 7202/65536 [1:20:34<10:59:19,  1.47it/s]
 11%|█         | 7203/65536 [1:20:35<11:16:31,  1.44it/s]
 11%|█         | 7204/65536 [1:20:35<10:55:14,  1.48it/s]
 11%|█         | 7205/65536 [1:20:36<10:40:36,  1.52it/s]
 11%|█         | 7206/65536 [1:20:37<10:52:38,  1.49it/s]
 11%|█         | 7207/65536 [1:20:37<10:31:33,  1.54it/s]
 11%|█         | 7208/65536 [1:20:38<10:33:23,  1.53it/s]
 11%|█         | 7209/65536 [1:20:39<10:28:03,  1.55it/s]
 11%|█         | 7210/65536 [1:20:39<10:43:14,  1.51it/s]
 11%|█         | 7211/65536 [1:20:40<10:43:36,  1.51it/s]
 11%|█         | 7212/65536 [1:20:41<10:44:24,  1.51it/s]
 11%|█         | 7213/65536 [1:20:41<11:00:38,  1.47it/s]
 11%|█         | 7214/65536 [1:20:42<11:00:38,  1.47it/s]
 11%|█         | 7215/65536 [1:20:43<11:16:33,  1.44it/s]
 11%|█         | 7216/65536 [1:20:43<11:03:38,  1.46it/s]
 11%|█         | 7217/65536 [1:20:44<10:42:42,  1.51it/s]
 11%|█         | 7218/65536 [1:20:45<10:48:44,  1.50it/s]
 11%|█         | 7219/65536 [1:20:45<10:48:06,  1.50it/s]
 11%|█         | 7220/65536 [1:20:46<10:53:31,  1.49it/s]
                                                         
{'loss': 1.0526, 'learning_rate': 9.032998653116199e-07, 'epoch': 445.68}

 11%|█         | 7220/65536 [1:20:46<10:53:31,  1.49it/s]
 11%|█         | 7221/65536 [1:20:47<10:50:45,  1.49it/s]
 11%|█         | 7222/65536 [1:20:47<10:47:17,  1.50it/s]
 11%|█         | 7223/65536 [1:20:48<10:41:57,  1.51it/s]
 11%|█         | 7224/65536 [1:20:49<10:47:17,  1.50it/s]
 11%|█         | 7225/65536 [1:20:49<10:40:17,  1.52it/s]
 11%|█         | 7226/65536 [1:20:50<10:50:29,  1.49it/s]
 11%|█         | 7227/65536 [1:20:51<10:43:47,  1.51it/s]
 11%|█         | 7228/65536 [1:20:51<10:59:51,  1.47it/s]
 11%|█         | 7229/65536 [1:20:52<10:47:06,  1.50it/s]
 11%|█         | 7230/65536 [1:20:53<10:57:31,  1.48it/s]
 11%|█         | 7231/65536 [1:20:53<10:52:33,  1.49it/s]
 11%|█         | 7232/65536 [1:20:54<11:07:39,  1.46it/s]
 11%|█         | 7233/65536 [1:20:55<11:10:34,  1.45it/s]
 11%|█         | 7234/65536 [1:20:56<11:12:26,  1.45it/s]
 11%|█         | 7235/65536 [1:20:56<11:08:06,  1.45it/s]
 11%|█         | 7236/65536 [1:20:57<10:50:38,  1.49it/s]
 11%|█         | 7237/65536 [1:20:57<10:38:38,  1.52it/s]
 11%|█         | 7238/65536 [1:20:58<10:30:22,  1.54it/s]
 11%|█         | 7239/65536 [1:20:59<10:41:01,  1.52it/s]
 11%|█         | 7240/65536 [1:20:59<10:41:59,  1.51it/s]
                                                         
{'loss': 1.0659, 'learning_rate': 9.030243663523937e-07, 'epoch': 446.91}

 11%|█         | 7240/65536 [1:20:59<10:41:59,  1.51it/s]
 11%|█         | 7241/65536 [1:21:00<10:40:40,  1.52it/s]
 11%|█         | 7242/65536 [1:21:01<11:02:26,  1.47it/s]
 11%|█         | 7243/65536 [1:21:01<10:48:44,  1.50it/s]
 11%|█         | 7244/65536 [1:21:02<10:59:00,  1.47it/s]
 11%|█         | 7245/65536 [1:21:03<11:12:06,  1.45it/s]
 11%|█         | 7246/65536 [1:21:04<10:51:48,  1.49it/s]
 11%|█         | 7247/65536 [1:21:04<10:49:52,  1.49it/s]
 11%|█         | 7248/65536 [1:21:05<10:47:45,  1.50it/s]
 11%|█         | 7249/65536 [1:21:05<10:35:04,  1.53it/s]
 11%|█         | 7250/65536 [1:21:06<10:46:10,  1.50it/s]
 11%|█         | 7251/65536 [1:21:07<10:31:52,  1.54it/s]
 11%|█         | 7252/65536 [1:21:07<10:36:56,  1.53it/s]
 11%|█         | 7253/65536 [1:21:08<10:33:48,  1.53it/s]
 11%|█         | 7254/65536 [1:21:09<10:38:07,  1.52it/s]
 11%|█         | 7255/65536 [1:21:09<10:44:07,  1.51it/s]
 11%|█         | 7256/65536 [1:21:10<11:04:29,  1.46it/s]
 11%|█         | 7257/65536 [1:21:11<10:57:29,  1.48it/s]
 11%|█         | 7258/65536 [1:21:12<10:56:23,  1.48it/s]
 11%|█         | 7259/65536 [1:21:12<10:55:42,  1.48it/s]
 11%|█         | 7260/65536 [1:21:13<10:51:19,  1.49it/s]
                                                         
{'loss': 1.0801, 'learning_rate': 9.027488673931676e-07, 'epoch': 448.15}

 11%|█         | 7260/65536 [1:21:13<10:51:19,  1.49it/s]
 11%|█         | 7261/65536 [1:21:13<10:38:56,  1.52it/s]
 11%|█         | 7262/65536 [1:21:14<10:25:57,  1.55it/s]
 11%|█         | 7263/65536 [1:21:15<10:44:29,  1.51it/s]
 11%|█         | 7264/65536 [1:21:15<10:56:56,  1.48it/s]
 11%|█         | 7265/65536 [1:21:16<10:55:48,  1.48it/s]
 11%|█         | 7266/65536 [1:21:17<10:52:24,  1.49it/s]
 11%|█         | 7267/65536 [1:21:17<10:49:37,  1.49it/s]
 11%|█         | 7268/65536 [1:21:18<10:56:20,  1.48it/s]
 11%|█         | 7269/65536 [1:21:19<10:35:52,  1.53it/s]
 11%|█         | 7270/65536 [1:21:19<10:28:48,  1.54it/s]
 11%|█         | 7271/65536 [1:21:20<10:46:34,  1.50it/s]
 11%|█         | 7272/65536 [1:21:21<10:34:01,  1.53it/s]
 11%|█         | 7273/65536 [1:21:21<10:41:59,  1.51it/s]
 11%|█         | 7274/65536 [1:21:22<10:47:01,  1.50it/s]
 11%|█         | 7275/65536 [1:21:23<10:34:06,  1.53it/s]
 11%|█         | 7276/65536 [1:21:23<10:29:22,  1.54it/s]
 11%|█         | 7277/65536 [1:21:24<10:18:55,  1.57it/s]
 11%|█         | 7278/65536 [1:21:25<10:31:25,  1.54it/s]
 11%|█         | 7279/65536 [1:21:25<10:42:07,  1.51it/s]
 11%|█         | 7280/65536 [1:21:26<10:43:32,  1.51it/s]
                                                         
{'loss': 1.0869, 'learning_rate': 9.024733684339414e-07, 'epoch': 449.38}

 11%|█         | 7280/65536 [1:21:26<10:43:32,  1.51it/s]
 11%|█         | 7281/65536 [1:21:27<10:44:22,  1.51it/s]
 11%|█         | 7282/65536 [1:21:27<10:46:22,  1.50it/s]
 11%|█         | 7283/65536 [1:21:28<10:44:26,  1.51it/s]
 11%|█         | 7284/65536 [1:21:29<10:47:47,  1.50it/s]
 11%|█         | 7285/65536 [1:21:29<11:13:26,  1.44it/s]
 11%|█         | 7286/65536 [1:21:30<11:05:37,  1.46it/s]
 11%|█         | 7287/65536 [1:21:31<11:00:35,  1.47it/s]
 11%|█         | 7288/65536 [1:21:31<10:43:35,  1.51it/s]
 11%|█         | 7289/65536 [1:21:32<10:42:42,  1.51it/s]
 11%|█         | 7290/65536 [1:21:33<11:00:19,  1.47it/s]
 11%|█         | 7291/65536 [1:21:33<10:57:52,  1.48it/s]
 11%|█         | 7292/65536 [1:21:34<10:51:10,  1.49it/s]
 11%|█         | 7293/65536 [1:21:35<10:51:06,  1.49it/s]
 11%|█         | 7294/65536 [1:21:35<10:43:13,  1.51it/s]
 11%|█         | 7295/65536 [1:21:36<10:24:52,  1.55it/s]
 11%|█         | 7296/65536 [1:21:37<10:44:49,  1.51it/s]
 11%|█         | 7297/65536 [1:21:37<10:42:24,  1.51it/s]
 11%|█         | 7298/65536 [1:21:38<10:42:56,  1.51it/s]
 11%|█         | 7299/65536 [1:21:39<10:44:06,  1.51it/s]
 11%|█         | 7300/65536 [1:21:39<10:46:56,  1.50it/s]
                                                         
{'loss': 1.0798, 'learning_rate': 9.021978694747153e-07, 'epoch': 450.62}

 11%|█         | 7300/65536 [1:21:39<10:46:56,  1.50it/s]
 11%|█         | 7301/65536 [1:21:40<10:35:03,  1.53it/s]
 11%|█         | 7302/65536 [1:21:41<10:38:25,  1.52it/s]
 11%|█         | 7303/65536 [1:21:41<11:02:10,  1.47it/s]
 11%|█         | 7304/65536 [1:21:42<11:10:28,  1.45it/s]
 11%|█         | 7305/65536 [1:21:43<11:12:03,  1.44it/s]
 11%|█         | 7306/65536 [1:21:44<11:04:03,  1.46it/s]
 11%|█         | 7307/65536 [1:21:44<10:57:17,  1.48it/s]
 11%|█         | 7308/65536 [1:21:45<10:51:34,  1.49it/s]
 11%|█         | 7309/65536 [1:21:45<10:53:04,  1.49it/s]
 11%|█         | 7310/65536 [1:21:46<10:55:33,  1.48it/s]
 11%|█         | 7311/65536 [1:21:47<10:48:28,  1.50it/s]
 11%|█         | 7312/65536 [1:21:47<10:48:10,  1.50it/s]
 11%|█         | 7313/65536 [1:21:48<10:45:47,  1.50it/s]
 11%|█         | 7314/65536 [1:21:49<10:42:07,  1.51it/s]
 11%|█         | 7315/65536 [1:21:49<10:35:01,  1.53it/s]
 11%|█         | 7316/65536 [1:21:50<10:46:54,  1.50it/s]
 11%|█         | 7317/65536 [1:21:51<10:45:39,  1.50it/s]
 11%|█         | 7318/65536 [1:21:51<10:49:49,  1.49it/s]
 11%|█         | 7319/65536 [1:21:52<11:12:08,  1.44it/s]
 11%|█         | 7320/65536 [1:21:53<10:54:57,  1.48it/s]
                                                         
{'loss': 1.0546, 'learning_rate': 9.019223705154892e-07, 'epoch': 451.85}

 11%|█         | 7320/65536 [1:21:53<10:54:57,  1.48it/s]
 11%|█         | 7321/65536 [1:21:53<10:37:16,  1.52it/s]
 11%|█         | 7322/65536 [1:21:54<10:37:28,  1.52it/s]
 11%|█         | 7323/65536 [1:21:55<10:52:06,  1.49it/s]
 11%|█         | 7324/65536 [1:21:55<10:44:17,  1.51it/s]
 11%|█         | 7325/65536 [1:21:56<10:52:02,  1.49it/s]
 11%|█         | 7326/65536 [1:21:57<10:55:48,  1.48it/s]
 11%|█         | 7327/65536 [1:21:58<10:51:48,  1.49it/s]
 11%|█         | 7328/65536 [1:21:58<10:36:57,  1.52it/s]
 11%|█         | 7329/65536 [1:21:59<10:36:54,  1.52it/s]
 11%|█         | 7330/65536 [1:21:59<10:48:07,  1.50it/s]
 11%|█         | 7331/65536 [1:22:00<10:55:03,  1.48it/s]
 11%|█         | 7332/65536 [1:22:01<10:58:03,  1.47it/s]
 11%|█         | 7333/65536 [1:22:01<10:37:17,  1.52it/s]
 11%|█         | 7334/65536 [1:22:02<10:37:43,  1.52it/s]
 11%|█         | 7335/65536 [1:22:03<10:59:02,  1.47it/s]
 11%|█         | 7336/65536 [1:22:04<11:11:11,  1.45it/s]
 11%|█         | 7337/65536 [1:22:04<11:08:03,  1.45it/s]
 11%|█         | 7338/65536 [1:22:05<11:08:25,  1.45it/s]
 11%|█         | 7339/65536 [1:22:06<10:55:18,  1.48it/s]
 11%|█         | 7340/65536 [1:22:06<11:11:41,  1.44it/s]
                                                         
{'loss': 1.0522, 'learning_rate': 9.016468715562629e-07, 'epoch': 453.09}

 11%|█         | 7340/65536 [1:22:06<11:11:41,  1.44it/s]
 11%|█         | 7341/65536 [1:22:07<11:19:13,  1.43it/s]
 11%|█         | 7342/65536 [1:22:08<11:01:36,  1.47it/s]
 11%|█         | 7343/65536 [1:22:08<10:52:48,  1.49it/s]
 11%|█         | 7344/65536 [1:22:09<10:44:45,  1.50it/s]
 11%|█         | 7345/65536 [1:22:10<10:43:16,  1.51it/s]
 11%|█         | 7346/65536 [1:22:10<11:02:43,  1.46it/s]
 11%|█         | 7347/65536 [1:22:11<10:59:04,  1.47it/s]
 11%|█         | 7348/65536 [1:22:12<10:36:50,  1.52it/s]
 11%|█         | 7349/65536 [1:22:12<10:31:28,  1.54it/s]
 11%|█         | 7350/65536 [1:22:13<10:25:52,  1.55it/s]
 11%|█         | 7351/65536 [1:22:14<10:41:42,  1.51it/s]
 11%|█         | 7352/65536 [1:22:14<10:51:39,  1.49it/s]
 11%|█         | 7353/65536 [1:22:15<10:54:07,  1.48it/s]
 11%|█         | 7354/65536 [1:22:16<10:51:59,  1.49it/s]
 11%|█         | 7355/65536 [1:22:16<10:47:19,  1.50it/s]
 11%|█         | 7356/65536 [1:22:17<10:59:13,  1.47it/s]
 11%|█         | 7357/65536 [1:22:18<10:56:30,  1.48it/s]
 11%|█         | 7358/65536 [1:22:18<11:06:51,  1.45it/s]
 11%|█         | 7359/65536 [1:22:19<10:51:44,  1.49it/s]
 11%|█         | 7360/65536 [1:22:20<10:35:08,  1.53it/s]
                                                         
{'loss': 1.0718, 'learning_rate': 9.013713725970369e-07, 'epoch': 454.32}

 11%|█         | 7360/65536 [1:22:20<10:35:08,  1.53it/s]
 11%|█         | 7361/65536 [1:22:20<10:52:02,  1.49it/s]
 11%|█         | 7362/65536 [1:22:21<10:40:28,  1.51it/s]
 11%|█         | 7363/65536 [1:22:22<10:40:24,  1.51it/s]
 11%|█         | 7364/65536 [1:22:22<10:28:47,  1.54it/s]
 11%|█         | 7365/65536 [1:22:23<10:34:40,  1.53it/s]
 11%|█         | 7366/65536 [1:22:24<10:36:06,  1.52it/s]
 11%|█         | 7367/65536 [1:22:24<10:52:27,  1.49it/s]
 11%|█         | 7368/65536 [1:22:25<10:44:10,  1.50it/s]
 11%|█         | 7369/65536 [1:22:26<10:36:48,  1.52it/s]
 11%|█         | 7370/65536 [1:22:26<10:44:53,  1.50it/s]
 11%|█         | 7371/65536 [1:22:27<10:33:10,  1.53it/s]
 11%|█         | 7372/65536 [1:22:28<10:41:30,  1.51it/s]
 11%|█▏        | 7373/65536 [1:22:28<11:01:25,  1.47it/s]
 11%|█▏        | 7374/65536 [1:22:29<11:03:06,  1.46it/s]
 11%|█▏        | 7375/65536 [1:22:30<10:59:31,  1.47it/s]
 11%|█▏        | 7376/65536 [1:22:30<10:40:44,  1.51it/s]
 11%|█▏        | 7377/65536 [1:22:31<10:34:13,  1.53it/s]
 11%|█▏        | 7378/65536 [1:22:32<10:26:17,  1.55it/s]
 11%|█▏        | 7379/65536 [1:22:32<10:35:58,  1.52it/s]
 11%|█▏        | 7380/65536 [1:22:33<10:36:07,  1.52it/s]
                                                         
{'loss': 1.0769, 'learning_rate': 9.010958736378107e-07, 'epoch': 455.56}

 11%|█▏        | 7380/65536 [1:22:33<10:36:07,  1.52it/s]
 11%|█▏        | 7381/65536 [1:22:34<10:41:58,  1.51it/s]
 11%|█▏        | 7382/65536 [1:22:34<10:50:26,  1.49it/s]
 11%|█▏        | 7383/65536 [1:22:35<10:53:23,  1.48it/s]
 11%|█▏        | 7384/65536 [1:22:36<11:10:51,  1.44it/s]
 11%|█▏        | 7385/65536 [1:22:36<11:03:07,  1.46it/s]
 11%|█▏        | 7386/65536 [1:22:37<10:57:10,  1.47it/s]
 11%|█▏        | 7387/65536 [1:22:38<10:55:56,  1.48it/s]
 11%|█▏        | 7388/65536 [1:22:38<11:24:04,  1.42it/s]
 11%|█▏        | 7389/65536 [1:22:39<11:13:19,  1.44it/s]
 11%|█▏        | 7390/65536 [1:22:40<11:11:09,  1.44it/s]
 11%|█▏        | 7391/65536 [1:22:41<11:10:16,  1.45it/s]
 11%|█▏        | 7392/65536 [1:22:41<11:16:23,  1.43it/s]
 11%|█▏        | 7393/65536 [1:22:42<11:16:51,  1.43it/s]
 11%|█▏        | 7394/65536 [1:22:43<11:08:02,  1.45it/s]
 11%|█▏        | 7395/65536 [1:22:43<11:00:34,  1.47it/s]
 11%|█▏        | 7396/65536 [1:22:44<10:41:36,  1.51it/s]
 11%|█▏        | 7397/65536 [1:22:45<10:32:13,  1.53it/s]
 11%|█▏        | 7398/65536 [1:22:45<10:30:15,  1.54it/s]
 11%|█▏        | 7399/65536 [1:22:46<10:33:35,  1.53it/s]
 11%|█▏        | 7400/65536 [1:22:47<10:38:52,  1.52it/s]
                                                         
{'loss': 1.0482, 'learning_rate': 9.008203746785846e-07, 'epoch': 456.79}

 11%|█▏        | 7400/65536 [1:22:47<10:38:52,  1.52it/s]
 11%|█▏        | 7401/65536 [1:22:47<10:33:54,  1.53it/s]
 11%|█▏        | 7402/65536 [1:22:48<10:33:22,  1.53it/s]
 11%|█▏        | 7403/65536 [1:22:48<10:24:57,  1.55it/s]
 11%|█▏        | 7404/65536 [1:22:49<10:48:14,  1.49it/s]
 11%|█▏        | 7405/65536 [1:22:50<10:59:42,  1.47it/s]
 11%|█▏        | 7406/65536 [1:22:50<10:48:44,  1.49it/s]
 11%|█▏        | 7407/65536 [1:22:51<10:53:43,  1.48it/s]
 11%|█▏        | 7408/65536 [1:22:52<10:32:39,  1.53it/s]
 11%|█▏        | 7409/65536 [1:22:52<10:39:57,  1.51it/s]
 11%|█▏        | 7410/65536 [1:22:53<10:59:03,  1.47it/s]
 11%|█▏        | 7411/65536 [1:22:54<10:47:19,  1.50it/s]
 11%|█▏        | 7412/65536 [1:22:54<10:44:02,  1.50it/s]
 11%|█▏        | 7413/65536 [1:22:55<10:43:37,  1.51it/s]
 11%|█▏        | 7414/65536 [1:22:56<11:02:58,  1.46it/s]
 11%|█▏        | 7415/65536 [1:22:57<11:02:49,  1.46it/s]
 11%|█▏        | 7416/65536 [1:22:57<11:08:17,  1.45it/s]
 11%|█▏        | 7417/65536 [1:22:58<10:46:05,  1.50it/s]
 11%|█▏        | 7418/65536 [1:22:59<10:46:10,  1.50it/s]
 11%|█▏        | 7419/65536 [1:22:59<10:52:14,  1.49it/s]
 11%|█▏        | 7420/65536 [1:23:00<11:08:15,  1.45it/s]
                                                         
{'loss': 1.0555, 'learning_rate': 9.005448757193583e-07, 'epoch': 458.02}

 11%|█▏        | 7420/65536 [1:23:00<11:08:15,  1.45it/s]
 11%|█▏        | 7421/65536 [1:23:01<11:05:00,  1.46it/s]
 11%|█▏        | 7422/65536 [1:23:01<10:38:28,  1.52it/s]
 11%|█▏        | 7423/65536 [1:23:02<10:44:37,  1.50it/s]
 11%|█▏        | 7424/65536 [1:23:03<10:43:31,  1.51it/s]
 11%|█▏        | 7425/65536 [1:23:03<10:48:20,  1.49it/s]
 11%|█▏        | 7426/65536 [1:23:04<10:35:02,  1.53it/s]
 11%|█▏        | 7427/65536 [1:23:05<10:44:45,  1.50it/s]
 11%|█▏        | 7428/65536 [1:23:05<10:44:49,  1.50it/s]
 11%|█▏        | 7429/65536 [1:23:06<10:56:15,  1.48it/s]
 11%|█▏        | 7430/65536 [1:23:07<11:01:21,  1.46it/s]
 11%|█▏        | 7431/65536 [1:23:07<10:58:27,  1.47it/s]
 11%|█▏        | 7432/65536 [1:23:08<10:57:21,  1.47it/s]
 11%|█▏        | 7433/65536 [1:23:09<10:36:19,  1.52it/s]
 11%|█▏        | 7434/65536 [1:23:09<10:29:58,  1.54it/s]
 11%|█▏        | 7435/65536 [1:23:10<10:31:18,  1.53it/s]
 11%|█▏        | 7436/65536 [1:23:11<11:02:10,  1.46it/s]
 11%|█▏        | 7437/65536 [1:23:11<11:05:41,  1.45it/s]
 11%|█▏        | 7438/65536 [1:23:12<10:51:21,  1.49it/s]
 11%|█▏        | 7439/65536 [1:23:13<11:09:49,  1.45it/s]
 11%|█▏        | 7440/65536 [1:23:13<10:48:43,  1.49it/s]
                                                         
{'loss': 1.0623, 'learning_rate': 9.002693767601322e-07, 'epoch': 459.26}

 11%|█▏        | 7440/65536 [1:23:13<10:48:43,  1.49it/s]
 11%|█▏        | 7441/65536 [1:23:14<10:52:13,  1.48it/s]
 11%|█▏        | 7442/65536 [1:23:15<10:36:06,  1.52it/s]
 11%|█▏        | 7443/65536 [1:23:15<10:31:08,  1.53it/s]
 11%|█▏        | 7444/65536 [1:23:16<10:23:54,  1.55it/s]
 11%|█▏        | 7445/65536 [1:23:17<10:34:42,  1.53it/s]
 11%|█▏        | 7446/65536 [1:23:17<10:37:43,  1.52it/s]
 11%|█▏        | 7447/65536 [1:23:18<10:40:34,  1.51it/s]
 11%|█▏        | 7448/65536 [1:23:19<10:34:03,  1.53it/s]
 11%|█▏        | 7449/65536 [1:23:19<10:48:08,  1.49it/s]
 11%|█▏        | 7450/65536 [1:23:20<10:53:07,  1.48it/s]
 11%|█▏        | 7451/65536 [1:23:21<10:53:36,  1.48it/s]
 11%|█▏        | 7452/65536 [1:23:21<10:55:27,  1.48it/s]
 11%|█▏        | 7453/65536 [1:23:22<11:23:08,  1.42it/s]
 11%|█▏        | 7454/65536 [1:23:23<11:14:18,  1.44it/s]
 11%|█▏        | 7455/65536 [1:23:23<10:56:23,  1.47it/s]
 11%|█▏        | 7456/65536 [1:23:24<10:37:58,  1.52it/s]
 11%|█▏        | 7457/65536 [1:23:25<10:23:17,  1.55it/s]
 11%|█▏        | 7458/65536 [1:23:25<10:29:43,  1.54it/s]
 11%|█▏        | 7459/65536 [1:23:26<10:33:58,  1.53it/s]
 11%|█▏        | 7460/65536 [1:23:27<10:29:52,  1.54it/s]
                                                         
{'loss': 1.0694, 'learning_rate': 8.999938778009061e-07, 'epoch': 460.49}

 11%|█▏        | 7460/65536 [1:23:27<10:29:52,  1.54it/s]
 11%|█▏        | 7461/65536 [1:23:27<10:43:41,  1.50it/s]
 11%|█▏        | 7462/65536 [1:23:28<10:35:20,  1.52it/s]
 11%|█▏        | 7463/65536 [1:23:29<10:39:04,  1.51it/s]
 11%|█▏        | 7464/65536 [1:23:29<10:59:25,  1.47it/s]
 11%|█▏        | 7465/65536 [1:23:30<11:01:14,  1.46it/s]
 11%|█▏        | 7466/65536 [1:23:31<10:52:19,  1.48it/s]
 11%|█▏        | 7467/65536 [1:23:31<10:58:07,  1.47it/s]
 11%|█▏        | 7468/65536 [1:23:32<10:51:56,  1.48it/s]
 11%|█▏        | 7469/65536 [1:23:33<10:57:49,  1.47it/s]
 11%|█▏        | 7470/65536 [1:23:33<11:14:28,  1.43it/s]
 11%|█▏        | 7471/65536 [1:23:34<11:02:30,  1.46it/s]
 11%|█▏        | 7472/65536 [1:23:35<10:54:53,  1.48it/s]
 11%|█▏        | 7473/65536 [1:23:35<10:42:19,  1.51it/s]
 11%|█▏        | 7474/65536 [1:23:36<10:39:45,  1.51it/s]
 11%|█▏        | 7475/65536 [1:23:37<10:43:02,  1.50it/s]
 11%|█▏        | 7476/65536 [1:23:37<10:32:20,  1.53it/s]
 11%|█▏        | 7477/65536 [1:23:38<10:52:18,  1.48it/s]
 11%|█▏        | 7478/65536 [1:23:39<10:58:57,  1.47it/s]
 11%|█▏        | 7479/65536 [1:23:39<10:44:05,  1.50it/s]
 11%|█▏        | 7480/65536 [1:23:40<10:45:13,  1.50it/s]
                                                         
{'loss': 1.0656, 'learning_rate': 8.997183788416799e-07, 'epoch': 461.73}

 11%|█▏        | 7480/65536 [1:23:40<10:45:13,  1.50it/s]
 11%|█▏        | 7481/65536 [1:23:41<10:34:13,  1.53it/s]
 11%|█▏        | 7482/65536 [1:23:41<10:30:53,  1.53it/s]
 11%|█▏        | 7483/65536 [1:23:42<10:27:45,  1.54it/s]
 11%|█▏        | 7484/65536 [1:23:43<10:35:18,  1.52it/s]
 11%|█▏        | 7485/65536 [1:23:43<11:00:33,  1.46it/s]
 11%|█▏        | 7486/65536 [1:23:44<11:08:19,  1.45it/s]
 11%|█▏        | 7487/65536 [1:23:45<11:06:49,  1.45it/s]
 11%|█▏        | 7488/65536 [1:23:45<10:47:15,  1.49it/s]
 11%|█▏        | 7489/65536 [1:23:46<10:51:27,  1.49it/s]
 11%|█▏        | 7490/65536 [1:23:47<10:53:48,  1.48it/s]
 11%|█▏        | 7491/65536 [1:23:47<10:47:36,  1.49it/s]
 11%|█▏        | 7492/65536 [1:23:48<10:38:08,  1.52it/s]
 11%|█▏        | 7493/65536 [1:23:49<10:35:41,  1.52it/s]
 11%|█▏        | 7494/65536 [1:23:49<10:40:36,  1.51it/s]
 11%|█▏        | 7495/65536 [1:23:50<10:41:57,  1.51it/s]
 11%|█▏        | 7496/65536 [1:23:51<10:46:10,  1.50it/s]
 11%|█▏        | 7497/65536 [1:23:51<10:53:50,  1.48it/s]
 11%|█▏        | 7498/65536 [1:23:52<10:47:53,  1.49it/s]
 11%|█▏        | 7499/65536 [1:23:53<10:53:37,  1.48it/s]
 11%|█▏        | 7500/65536 [1:23:53<11:02:23,  1.46it/s]
                                                         
{'loss': 1.0436, 'learning_rate': 8.994428798824538e-07, 'epoch': 462.96}

 11%|█▏        | 7500/65536 [1:23:53<11:02:23,  1.46it/s]
 11%|█▏        | 7501/65536 [1:23:54<10:58:25,  1.47it/s]
 11%|█▏        | 7502/65536 [1:23:55<11:01:43,  1.46it/s]
 11%|█▏        | 7503/65536 [1:23:56<11:02:10,  1.46it/s]
 11%|█▏        | 7504/65536 [1:23:56<11:01:06,  1.46it/s]
 11%|█▏        | 7505/65536 [1:23:57<10:56:08,  1.47it/s]
 11%|█▏        | 7506/65536 [1:23:58<10:51:54,  1.48it/s]
 11%|█▏        | 7507/65536 [1:23:58<10:58:01,  1.47it/s]
 11%|█▏        | 7508/65536 [1:23:59<10:51:27,  1.48it/s]
 11%|█▏        | 7509/65536 [1:24:00<10:48:01,  1.49it/s]
 11%|█▏        | 7510/65536 [1:24:00<10:57:21,  1.47it/s]
 11%|█▏        | 7511/65536 [1:24:01<11:10:39,  1.44it/s]
 11%|█▏        | 7512/65536 [1:24:02<10:56:22,  1.47it/s]
 11%|█▏        | 7513/65536 [1:24:02<10:45:25,  1.50it/s]
 11%|█▏        | 7514/65536 [1:24:03<10:44:30,  1.50it/s]
 11%|█▏        | 7515/65536 [1:24:04<10:41:45,  1.51it/s]
 11%|█▏        | 7516/65536 [1:24:04<10:58:19,  1.47it/s]
 11%|█▏        | 7517/65536 [1:24:05<11:05:20,  1.45it/s]
 11%|█▏        | 7518/65536 [1:24:06<11:04:41,  1.45it/s]
 11%|█▏        | 7519/65536 [1:24:06<10:54:26,  1.48it/s]
 11%|█▏        | 7520/65536 [1:24:07<10:56:01,  1.47it/s]
                                                         
{'loss': 1.0384, 'learning_rate': 8.991673809232276e-07, 'epoch': 464.2}

 11%|█▏        | 7520/65536 [1:24:07<10:56:01,  1.47it/s]
 11%|█▏        | 7521/65536 [1:24:08<11:02:36,  1.46it/s]
 11%|█▏        | 7522/65536 [1:24:08<10:49:42,  1.49it/s]
 11%|█▏        | 7523/65536 [1:24:09<10:54:38,  1.48it/s]
 11%|█▏        | 7524/65536 [1:24:10<10:33:20,  1.53it/s]
 11%|█▏        | 7525/65536 [1:24:10<10:30:17,  1.53it/s]
 11%|█▏        | 7526/65536 [1:24:11<10:37:23,  1.52it/s]
 11%|█▏        | 7527/65536 [1:24:12<10:25:29,  1.55it/s]
 11%|█▏        | 7528/65536 [1:24:12<10:36:58,  1.52it/s]
 11%|█▏        | 7529/65536 [1:24:13<10:42:59,  1.50it/s]
 11%|█▏        | 7530/65536 [1:24:14<10:44:49,  1.50it/s]
 11%|█▏        | 7531/65536 [1:24:14<10:52:10,  1.48it/s]
 11%|█▏        | 7532/65536 [1:24:15<11:00:04,  1.46it/s]
 11%|█▏        | 7533/65536 [1:24:16<10:57:09,  1.47it/s]
 11%|█▏        | 7534/65536 [1:24:17<11:32:29,  1.40it/s]
 11%|█▏        | 7535/65536 [1:24:17<11:24:33,  1.41it/s]
 11%|█▏        | 7536/65536 [1:24:18<11:17:41,  1.43it/s]
 12%|█▏        | 7537/65536 [1:24:18<10:45:49,  1.50it/s]
 12%|█▏        | 7538/65536 [1:24:19<10:43:28,  1.50it/s]
 12%|█▏        | 7539/65536 [1:24:20<10:40:42,  1.51it/s]
 12%|█▏        | 7540/65536 [1:24:20<10:44:30,  1.50it/s]
                                                         
{'loss': 1.0503, 'learning_rate': 8.988918819640015e-07, 'epoch': 465.43}

 12%|█▏        | 7540/65536 [1:24:20<10:44:30,  1.50it/s]
 12%|█▏        | 7541/65536 [1:24:21<11:01:47,  1.46it/s]
 12%|█▏        | 7542/65536 [1:24:22<10:57:21,  1.47it/s]
 12%|█▏        | 7543/65536 [1:24:23<11:02:59,  1.46it/s]
 12%|█▏        | 7544/65536 [1:24:23<10:57:58,  1.47it/s]
 12%|█▏        | 7545/65536 [1:24:24<10:42:31,  1.50it/s]
 12%|█▏        | 7546/65536 [1:24:25<10:38:57,  1.51it/s]
 12%|█▏        | 7547/65536 [1:24:25<10:44:57,  1.50it/s]
 12%|█▏        | 7548/65536 [1:24:26<10:41:21,  1.51it/s]
 12%|█▏        | 7549/65536 [1:24:27<10:33:44,  1.53it/s]
 12%|█▏        | 7550/65536 [1:24:27<10:58:02,  1.47it/s]
 12%|█▏        | 7551/65536 [1:24:28<10:58:11,  1.47it/s]
 12%|█▏        | 7552/65536 [1:24:29<10:57:04,  1.47it/s]
 12%|█▏        | 7553/65536 [1:24:29<10:47:51,  1.49it/s]
 12%|█▏        | 7554/65536 [1:24:30<10:47:27,  1.49it/s]
 12%|█▏        | 7555/65536 [1:24:31<10:46:51,  1.49it/s]
 12%|█▏        | 7556/65536 [1:24:31<10:52:21,  1.48it/s]
 12%|█▏        | 7557/65536 [1:24:32<10:46:03,  1.50it/s]
 12%|█▏        | 7558/65536 [1:24:33<10:34:17,  1.52it/s]
 12%|█▏        | 7559/65536 [1:24:33<10:23:18,  1.55it/s]
 12%|█▏        | 7560/65536 [1:24:34<10:44:12,  1.50it/s]
                                                         
{'loss': 1.0388, 'learning_rate': 8.986163830047752e-07, 'epoch': 466.67}

 12%|█▏        | 7560/65536 [1:24:34<10:44:12,  1.50it/s]
 12%|█▏        | 7561/65536 [1:24:35<10:37:49,  1.51it/s]
 12%|█▏        | 7562/65536 [1:24:35<10:46:24,  1.49it/s]
 12%|█▏        | 7563/65536 [1:24:36<11:01:44,  1.46it/s]
 12%|█▏        | 7564/65536 [1:24:37<10:51:49,  1.48it/s]
 12%|█▏        | 7565/65536 [1:24:37<10:49:08,  1.49it/s]
 12%|█▏        | 7566/65536 [1:24:38<10:59:28,  1.47it/s]
 12%|█▏        | 7567/65536 [1:24:39<10:54:06,  1.48it/s]
 12%|█▏        | 7568/65536 [1:24:39<10:44:03,  1.50it/s]
 12%|█▏        | 7569/65536 [1:24:40<10:39:13,  1.51it/s]
 12%|█▏        | 7570/65536 [1:24:41<10:44:25,  1.50it/s]
 12%|█▏        | 7571/65536 [1:24:41<10:43:37,  1.50it/s]
 12%|█▏        | 7572/65536 [1:24:42<10:49:59,  1.49it/s]
 12%|█▏        | 7573/65536 [1:24:43<10:32:12,  1.53it/s]
 12%|█▏        | 7574/65536 [1:24:43<10:44:10,  1.50it/s]
 12%|█▏        | 7575/65536 [1:24:44<10:45:04,  1.50it/s]
 12%|█▏        | 7576/65536 [1:24:45<10:46:59,  1.49it/s]
 12%|█▏        | 7577/65536 [1:24:45<10:58:41,  1.47it/s]
 12%|█▏        | 7578/65536 [1:24:46<11:16:42,  1.43it/s]
 12%|█▏        | 7579/65536 [1:24:47<10:57:35,  1.47it/s]
 12%|█▏        | 7580/65536 [1:24:47<10:35:57,  1.52it/s]
                                                         
{'loss': 1.0438, 'learning_rate': 8.983408840455491e-07, 'epoch': 467.9}

 12%|█▏        | 7580/65536 [1:24:47<10:35:57,  1.52it/s]
 12%|█▏        | 7581/65536 [1:24:48<10:53:13,  1.48it/s]
 12%|█▏        | 7582/65536 [1:24:49<10:53:11,  1.48it/s]
 12%|█▏        | 7583/65536 [1:24:49<11:10:14,  1.44it/s]
 12%|█▏        | 7584/65536 [1:24:50<10:50:24,  1.49it/s]
 12%|█▏        | 7585/65536 [1:24:51<10:42:56,  1.50it/s]
 12%|█▏        | 7586/65536 [1:24:51<10:35:35,  1.52it/s]
 12%|█▏        | 7587/65536 [1:24:52<10:37:42,  1.51it/s]
 12%|█▏        | 7588/65536 [1:24:53<10:36:10,  1.52it/s]
 12%|█▏        | 7589/65536 [1:24:53<10:43:12,  1.50it/s]
 12%|█▏        | 7590/65536 [1:24:54<10:50:43,  1.48it/s]
 12%|█▏        | 7591/65536 [1:24:55<10:54:34,  1.48it/s]
 12%|█▏        | 7592/65536 [1:24:55<10:49:03,  1.49it/s]
 12%|█▏        | 7593/65536 [1:24:56<10:53:50,  1.48it/s]
 12%|█▏        | 7594/65536 [1:24:57<10:45:50,  1.50it/s]
 12%|█▏        | 7595/65536 [1:24:57<10:54:52,  1.47it/s]
 12%|█▏        | 7596/65536 [1:24:58<10:49:13,  1.49it/s]
 12%|█▏        | 7597/65536 [1:24:59<10:59:13,  1.46it/s]
 12%|█▏        | 7598/65536 [1:25:00<11:10:37,  1.44it/s]
 12%|█▏        | 7599/65536 [1:25:00<10:55:56,  1.47it/s]
 12%|█▏        | 7600/65536 [1:25:01<11:05:17,  1.45it/s]
                                                         
{'loss': 1.045, 'learning_rate': 8.98065385086323e-07, 'epoch': 469.14}

 12%|█▏        | 7600/65536 [1:25:01<11:05:17,  1.45it/s]
 12%|█▏        | 7601/65536 [1:25:02<11:07:24,  1.45it/s]
 12%|█▏        | 7602/65536 [1:25:02<11:11:08,  1.44it/s]
 12%|█▏        | 7603/65536 [1:25:03<10:56:04,  1.47it/s]
 12%|█▏        | 7604/65536 [1:25:04<10:43:48,  1.50it/s]
 12%|█▏        | 7605/65536 [1:25:04<10:47:06,  1.49it/s]
 12%|█▏        | 7606/65536 [1:25:05<10:57:45,  1.47it/s]
 12%|█▏        | 7607/65536 [1:25:06<11:09:38,  1.44it/s]
 12%|█▏        | 7608/65536 [1:25:06<10:49:43,  1.49it/s]
 12%|█▏        | 7609/65536 [1:25:07<10:40:18,  1.51it/s]
 12%|█▏        | 7610/65536 [1:25:08<10:36:56,  1.52it/s]
 12%|█▏        | 7611/65536 [1:25:08<10:58:14,  1.47it/s]
 12%|█▏        | 7612/65536 [1:25:09<10:47:49,  1.49it/s]
 12%|█▏        | 7613/65536 [1:25:10<10:34:11,  1.52it/s]
 12%|█▏        | 7614/65536 [1:25:10<10:34:03,  1.52it/s]
 12%|█▏        | 7615/65536 [1:25:11<11:07:45,  1.45it/s]
 12%|█▏        | 7616/65536 [1:25:12<11:11:36,  1.44it/s]
 12%|█▏        | 7617/65536 [1:25:12<10:55:22,  1.47it/s]
 12%|█▏        | 7618/65536 [1:25:13<10:46:38,  1.49it/s]
 12%|█▏        | 7619/65536 [1:25:14<10:45:41,  1.49it/s]
 12%|█▏        | 7620/65536 [1:25:14<10:27:59,  1.54it/s]
                                                         
{'loss': 1.0275, 'learning_rate': 8.977898861270968e-07, 'epoch': 470.37}

 12%|█▏        | 7620/65536 [1:25:14<10:27:59,  1.54it/s]
 12%|█▏        | 7621/65536 [1:25:15<10:35:53,  1.52it/s]
 12%|█▏        | 7622/65536 [1:25:16<10:32:22,  1.53it/s]
 12%|█▏        | 7623/65536 [1:25:16<10:28:42,  1.54it/s]
 12%|█▏        | 7624/65536 [1:25:17<10:35:56,  1.52it/s]
 12%|█▏        | 7625/65536 [1:25:18<10:30:08,  1.53it/s]
 12%|█▏        | 7626/65536 [1:25:18<10:56:26,  1.47it/s]
 12%|█▏        | 7627/65536 [1:25:19<10:56:13,  1.47it/s]
 12%|█▏        | 7628/65536 [1:25:20<10:56:44,  1.47it/s]
 12%|█▏        | 7629/65536 [1:25:20<10:35:43,  1.52it/s]
 12%|█▏        | 7630/65536 [1:25:21<10:44:33,  1.50it/s]
 12%|█▏        | 7631/65536 [1:25:22<10:55:30,  1.47it/s]
 12%|█▏        | 7632/65536 [1:25:22<10:48:57,  1.49it/s]
 12%|█▏        | 7633/65536 [1:25:23<10:49:59,  1.48it/s]
 12%|█▏        | 7634/65536 [1:25:24<10:32:15,  1.53it/s]
 12%|█▏        | 7635/65536 [1:25:24<10:23:43,  1.55it/s]
 12%|█▏        | 7636/65536 [1:25:25<10:31:41,  1.53it/s]
 12%|█▏        | 7637/65536 [1:25:26<10:25:27,  1.54it/s]
 12%|█▏        | 7638/65536 [1:25:26<10:52:09,  1.48it/s]
 12%|█▏        | 7639/65536 [1:25:27<10:46:16,  1.49it/s]
 12%|█▏        | 7640/65536 [1:25:28<10:53:06,  1.48it/s]
                                                         
{'loss': 1.0583, 'learning_rate': 8.975143871678707e-07, 'epoch': 471.6}

 12%|█▏        | 7640/65536 [1:25:28<10:53:06,  1.48it/s]
 12%|█▏        | 7641/65536 [1:25:28<10:39:30,  1.51it/s]
 12%|█▏        | 7642/65536 [1:25:29<10:30:45,  1.53it/s]
 12%|█▏        | 7643/65536 [1:25:30<10:52:26,  1.48it/s]
 12%|█▏        | 7644/65536 [1:25:30<11:01:15,  1.46it/s]
 12%|█▏        | 7645/65536 [1:25:31<10:52:15,  1.48it/s]
 12%|█▏        | 7646/65536 [1:25:32<10:46:55,  1.49it/s]
 12%|█▏        | 7647/65536 [1:25:32<10:48:59,  1.49it/s]
 12%|█▏        | 7648/65536 [1:25:33<10:43:10,  1.50it/s]
 12%|█▏        | 7649/65536 [1:25:34<10:31:49,  1.53it/s]
 12%|█▏        | 7650/65536 [1:25:34<10:39:29,  1.51it/s]
 12%|█▏        | 7651/65536 [1:25:35<10:41:11,  1.50it/s]
 12%|█▏        | 7652/65536 [1:25:36<10:37:52,  1.51it/s]
 12%|█▏        | 7653/65536 [1:25:36<10:40:09,  1.51it/s]
 12%|█▏        | 7654/65536 [1:25:37<10:50:49,  1.48it/s]
 12%|█▏        | 7655/65536 [1:25:38<10:41:03,  1.50it/s]
 12%|█▏        | 7656/65536 [1:25:38<10:41:15,  1.50it/s]
 12%|█▏        | 7657/65536 [1:25:39<10:15:26,  1.57it/s]
 12%|█▏        | 7658/65536 [1:25:40<10:17:33,  1.56it/s]
 12%|█▏        | 7659/65536 [1:25:40<10:45:14,  1.49it/s]
 12%|█▏        | 7660/65536 [1:25:41<11:03:22,  1.45it/s]
                                                         
{'loss': 1.0415, 'learning_rate': 8.972388882086445e-07, 'epoch': 472.84}

 12%|█▏        | 7660/65536 [1:25:41<11:03:22,  1.45it/s]
 12%|█▏        | 7661/65536 [1:25:42<11:09:48,  1.44it/s]
 12%|█▏        | 7662/65536 [1:25:42<11:07:30,  1.45it/s]
 12%|█▏        | 7663/65536 [1:25:43<10:57:18,  1.47it/s]
 12%|█▏        | 7664/65536 [1:25:44<10:55:09,  1.47it/s]
 12%|█▏        | 7665/65536 [1:25:44<10:57:59,  1.47it/s]
 12%|█▏        | 7666/65536 [1:25:45<10:43:06,  1.50it/s]
 12%|█▏        | 7667/65536 [1:25:46<10:40:22,  1.51it/s]
 12%|█▏        | 7668/65536 [1:25:46<10:44:19,  1.50it/s]
 12%|█▏        | 7669/65536 [1:25:47<10:40:23,  1.51it/s]
 12%|█▏        | 7670/65536 [1:25:48<10:37:31,  1.51it/s]
 12%|█▏        | 7671/65536 [1:25:48<10:41:00,  1.50it/s]
 12%|█▏        | 7672/65536 [1:25:49<10:32:09,  1.53it/s]
 12%|█▏        | 7673/65536 [1:25:50<10:42:16,  1.50it/s]
 12%|█▏        | 7674/65536 [1:25:50<10:46:45,  1.49it/s]
 12%|█▏        | 7675/65536 [1:25:51<10:36:36,  1.51it/s]
 12%|█▏        | 7676/65536 [1:25:52<10:34:13,  1.52it/s]
 12%|█▏        | 7677/65536 [1:25:52<10:50:17,  1.48it/s]
 12%|█▏        | 7678/65536 [1:25:53<10:43:42,  1.50it/s]
 12%|█▏        | 7679/65536 [1:25:54<11:05:05,  1.45it/s]
 12%|█▏        | 7680/65536 [1:25:54<10:59:23,  1.46it/s]
                                                         
{'loss': 1.058, 'learning_rate': 8.969633892494183e-07, 'epoch': 474.07}

 12%|█▏        | 7680/65536 [1:25:54<10:59:23,  1.46it/s]
 12%|█▏        | 7681/65536 [1:25:55<10:44:52,  1.50it/s]
 12%|█▏        | 7682/65536 [1:25:56<10:24:51,  1.54it/s]
 12%|█▏        | 7683/65536 [1:25:56<10:35:31,  1.52it/s]
 12%|█▏        | 7684/65536 [1:25:57<10:32:49,  1.52it/s]
 12%|█▏        | 7685/65536 [1:25:58<10:41:48,  1.50it/s]
 12%|█▏        | 7686/65536 [1:25:58<10:40:16,  1.51it/s]
 12%|█▏        | 7687/65536 [1:25:59<10:34:28,  1.52it/s]
 12%|█▏        | 7688/65536 [1:26:00<10:41:15,  1.50it/s]
 12%|█▏        | 7689/65536 [1:26:00<10:59:13,  1.46it/s]
 12%|█▏        | 7690/65536 [1:26:01<10:36:51,  1.51it/s]
 12%|█▏        | 7691/65536 [1:26:02<10:42:59,  1.50it/s]
 12%|█▏        | 7692/65536 [1:26:02<10:51:52,  1.48it/s]
 12%|█▏        | 7693/65536 [1:26:03<10:46:38,  1.49it/s]
 12%|█▏        | 7694/65536 [1:26:04<10:59:35,  1.46it/s]
 12%|█▏        | 7695/65536 [1:26:04<10:40:33,  1.50it/s]
 12%|█▏        | 7696/65536 [1:26:05<11:03:56,  1.45it/s]
 12%|█▏        | 7697/65536 [1:26:06<10:55:01,  1.47it/s]
 12%|█▏        | 7698/65536 [1:26:06<10:57:38,  1.47it/s]
 12%|█▏        | 7699/65536 [1:26:07<10:47:41,  1.49it/s]
 12%|█▏        | 7700/65536 [1:26:08<10:41:11,  1.50it/s]
                                                         
{'loss': 1.0512, 'learning_rate': 8.966878902901923e-07, 'epoch': 475.31}

 12%|█▏        | 7700/65536 [1:26:08<10:41:11,  1.50it/s]
 12%|█▏        | 7701/65536 [1:26:08<10:39:49,  1.51it/s]
 12%|█▏        | 7702/65536 [1:26:09<10:53:56,  1.47it/s]
 12%|█▏        | 7703/65536 [1:26:10<10:43:58,  1.50it/s]
 12%|█▏        | 7704/65536 [1:26:10<10:42:06,  1.50it/s]
 12%|█▏        | 7705/65536 [1:26:11<10:44:15,  1.50it/s]
 12%|█▏        | 7706/65536 [1:26:12<11:07:31,  1.44it/s]
 12%|█▏        | 7707/65536 [1:26:12<10:51:40,  1.48it/s]
 12%|█▏        | 7708/65536 [1:26:13<10:52:44,  1.48it/s]
 12%|█▏        | 7709/65536 [1:26:14<10:42:25,  1.50it/s]
 12%|█▏        | 7710/65536 [1:26:14<10:39:55,  1.51it/s]
 12%|█▏        | 7711/65536 [1:26:15<10:38:44,  1.51it/s]
 12%|█▏        | 7712/65536 [1:26:16<11:02:51,  1.45it/s]
 12%|█▏        | 7713/65536 [1:26:17<10:50:56,  1.48it/s]
 12%|█▏        | 7714/65536 [1:26:17<10:50:52,  1.48it/s]
 12%|█▏        | 7715/65536 [1:26:18<10:59:32,  1.46it/s]
 12%|█▏        | 7716/65536 [1:26:19<11:19:39,  1.42it/s]
 12%|█▏        | 7717/65536 [1:26:19<10:56:08,  1.47it/s]
 12%|█▏        | 7718/65536 [1:26:20<10:49:55,  1.48it/s]
 12%|█▏        | 7719/65536 [1:26:21<11:10:10,  1.44it/s]
 12%|█▏        | 7720/65536 [1:26:21<11:11:22,  1.44it/s]
                                                         
{'loss': 1.0358, 'learning_rate': 8.96412391330966e-07, 'epoch': 476.54}

 12%|█▏        | 7720/65536 [1:26:21<11:11:22,  1.44it/s]
 12%|█▏        | 7721/65536 [1:26:22<11:07:13,  1.44it/s]
 12%|█▏        | 7722/65536 [1:26:23<10:46:41,  1.49it/s]
 12%|█▏        | 7723/65536 [1:26:23<10:41:37,  1.50it/s]
 12%|█▏        | 7724/65536 [1:26:24<10:49:09,  1.48it/s]
 12%|█▏        | 7725/65536 [1:26:25<10:42:04,  1.50it/s]
 12%|█▏        | 7726/65536 [1:26:25<10:28:54,  1.53it/s]
 12%|█▏        | 7727/65536 [1:26:26<10:32:19,  1.52it/s]
 12%|█▏        | 7728/65536 [1:26:27<10:48:30,  1.49it/s]
 12%|█▏        | 7729/65536 [1:26:27<10:45:44,  1.49it/s]
 12%|█▏        | 7730/65536 [1:26:28<10:34:21,  1.52it/s]
 12%|█▏        | 7731/65536 [1:26:29<10:46:24,  1.49it/s]
 12%|█▏        | 7732/65536 [1:26:29<10:36:44,  1.51it/s]
 12%|█▏        | 7733/65536 [1:26:30<10:26:54,  1.54it/s]
 12%|█▏        | 7734/65536 [1:26:31<10:34:41,  1.52it/s]
 12%|█▏        | 7735/65536 [1:26:31<10:32:04,  1.52it/s]
 12%|█▏        | 7736/65536 [1:26:32<10:27:20,  1.54it/s]
 12%|█▏        | 7737/65536 [1:26:33<10:29:29,  1.53it/s]
 12%|█▏        | 7738/65536 [1:26:33<10:29:12,  1.53it/s]
 12%|█▏        | 7739/65536 [1:26:34<11:00:52,  1.46it/s]
 12%|█▏        | 7740/65536 [1:26:35<10:55:38,  1.47it/s]
                                                         
{'loss': 1.0444, 'learning_rate': 8.961368923717399e-07, 'epoch': 477.78}

 12%|█▏        | 7740/65536 [1:26:35<10:55:38,  1.47it/s]
 12%|█▏        | 7741/65536 [1:26:35<11:06:54,  1.44it/s]
 12%|█▏        | 7742/65536 [1:26:36<10:52:48,  1.48it/s]
 12%|█▏        | 7743/65536 [1:26:37<10:56:46,  1.47it/s]
 12%|█▏        | 7744/65536 [1:26:37<11:05:07,  1.45it/s]
 12%|█▏        | 7745/65536 [1:26:38<11:20:59,  1.41it/s]
 12%|█▏        | 7746/65536 [1:26:39<11:07:18,  1.44it/s]
 12%|█▏        | 7747/65536 [1:26:40<11:07:48,  1.44it/s]
 12%|█▏        | 7748/65536 [1:26:40<10:49:01,  1.48it/s]
 12%|█▏        | 7749/65536 [1:26:41<10:34:50,  1.52it/s]
 12%|█▏        | 7750/65536 [1:26:41<10:30:20,  1.53it/s]
 12%|█▏        | 7751/65536 [1:26:42<10:36:14,  1.51it/s]
 12%|█▏        | 7752/65536 [1:26:43<10:38:29,  1.51it/s]
 12%|█▏        | 7753/65536 [1:26:43<10:37:25,  1.51it/s]
 12%|█▏        | 7754/65536 [1:26:44<10:53:25,  1.47it/s]
 12%|█▏        | 7755/65536 [1:26:45<10:44:29,  1.49it/s]
 12%|█▏        | 7756/65536 [1:26:45<10:45:52,  1.49it/s]
 12%|█▏        | 7757/65536 [1:26:46<10:38:16,  1.51it/s]
 12%|█▏        | 7758/65536 [1:26:47<10:33:33,  1.52it/s]
 12%|█▏        | 7759/65536 [1:26:47<10:49:14,  1.48it/s]
 12%|█▏        | 7760/65536 [1:26:48<10:45:16,  1.49it/s]
                                                         
{'loss': 1.0639, 'learning_rate': 8.958613934125137e-07, 'epoch': 479.01}

 12%|█▏        | 7760/65536 [1:26:48<10:45:16,  1.49it/s]
 12%|█▏        | 7761/65536 [1:26:49<10:36:22,  1.51it/s]
 12%|█▏        | 7762/65536 [1:26:49<10:28:15,  1.53it/s]
 12%|█▏        | 7763/65536 [1:26:50<10:58:59,  1.46it/s]
 12%|█▏        | 7764/65536 [1:26:51<10:51:27,  1.48it/s]
 12%|█▏        | 7765/65536 [1:26:51<10:48:08,  1.49it/s]
 12%|█▏        | 7766/65536 [1:26:52<10:39:16,  1.51it/s]
 12%|█▏        | 7767/65536 [1:26:53<10:33:47,  1.52it/s]
 12%|█▏        | 7768/65536 [1:26:53<10:35:06,  1.52it/s]
 12%|█▏        | 7769/65536 [1:26:54<10:30:34,  1.53it/s]
 12%|█▏        | 7770/65536 [1:26:55<10:09:39,  1.58it/s]
 12%|█▏        | 7771/65536 [1:26:55<10:13:32,  1.57it/s]
 12%|█▏        | 7772/65536 [1:26:56<10:34:07,  1.52it/s]
 12%|█▏        | 7773/65536 [1:26:57<10:39:08,  1.51it/s]
 12%|█▏        | 7774/65536 [1:26:57<10:39:00,  1.51it/s]
 12%|█▏        | 7775/65536 [1:26:58<10:50:20,  1.48it/s]
 12%|█▏        | 7776/65536 [1:26:59<10:35:30,  1.51it/s]
 12%|█▏        | 7777/65536 [1:26:59<11:01:34,  1.46it/s]
 12%|█▏        | 7778/65536 [1:27:00<10:49:18,  1.48it/s]
 12%|█▏        | 7779/65536 [1:27:01<10:54:23,  1.47it/s]
 12%|█▏        | 7780/65536 [1:27:01<10:45:11,  1.49it/s]
                                                         
{'loss': 1.0615, 'learning_rate': 8.955858944532876e-07, 'epoch': 480.25}

 12%|█▏        | 7780/65536 [1:27:01<10:45:11,  1.49it/s]
 12%|█▏        | 7781/65536 [1:27:02<10:33:21,  1.52it/s]
 12%|█▏        | 7782/65536 [1:27:03<10:41:12,  1.50it/s]
 12%|█▏        | 7783/65536 [1:27:03<10:42:50,  1.50it/s]
 12%|█▏        | 7784/65536 [1:27:04<10:39:02,  1.51it/s]
 12%|█▏        | 7785/65536 [1:27:05<10:53:51,  1.47it/s]
 12%|█▏        | 7786/65536 [1:27:05<11:00:27,  1.46it/s]
 12%|█▏        | 7787/65536 [1:27:06<11:03:57,  1.45it/s]
 12%|█▏        | 7788/65536 [1:27:07<10:47:20,  1.49it/s]
 12%|█▏        | 7789/65536 [1:27:07<10:21:31,  1.55it/s]
 12%|█▏        | 7790/65536 [1:27:08<10:22:02,  1.55it/s]
 12%|█▏        | 7791/65536 [1:27:09<10:22:52,  1.55it/s]
 12%|█▏        | 7792/65536 [1:27:09<10:17:41,  1.56it/s]
 12%|█▏        | 7793/65536 [1:27:10<10:40:34,  1.50it/s]
 12%|█▏        | 7794/65536 [1:27:11<10:42:15,  1.50it/s]
 12%|█▏        | 7795/65536 [1:27:11<10:33:47,  1.52it/s]
 12%|█▏        | 7796/65536 [1:27:12<10:45:38,  1.49it/s]
 12%|█▏        | 7797/65536 [1:27:13<10:36:38,  1.51it/s]
 12%|█▏        | 7798/65536 [1:27:13<10:46:44,  1.49it/s]
 12%|█▏        | 7799/65536 [1:27:14<10:42:21,  1.50it/s]
 12%|█▏        | 7800/65536 [1:27:15<10:42:31,  1.50it/s]
                                                         
{'loss': 1.0438, 'learning_rate': 8.953103954940614e-07, 'epoch': 481.48}

 12%|█▏        | 7800/65536 [1:27:15<10:42:31,  1.50it/s]
 12%|█▏        | 7801/65536 [1:27:15<10:54:53,  1.47it/s]
 12%|█▏        | 7802/65536 [1:27:16<10:46:13,  1.49it/s]
 12%|█▏        | 7803/65536 [1:27:17<10:44:58,  1.49it/s]
 12%|█▏        | 7804/65536 [1:27:17<10:53:21,  1.47it/s]
 12%|█▏        | 7805/65536 [1:27:18<10:43:16,  1.50it/s]
 12%|█▏        | 7806/65536 [1:27:19<10:56:19,  1.47it/s]
 12%|█▏        | 7807/65536 [1:27:19<10:40:11,  1.50it/s]
 12%|█▏        | 7808/65536 [1:27:20<10:32:23,  1.52it/s]
 12%|█▏        | 7809/65536 [1:27:21<10:56:49,  1.46it/s]
 12%|█▏        | 7810/65536 [1:27:21<10:52:25,  1.47it/s]
 12%|█▏        | 7811/65536 [1:27:22<10:43:16,  1.50it/s]
 12%|█▏        | 7812/65536 [1:27:23<10:46:44,  1.49it/s]
 12%|█▏        | 7813/65536 [1:27:23<10:28:51,  1.53it/s]
 12%|█▏        | 7814/65536 [1:27:24<10:47:31,  1.49it/s]
 12%|█▏        | 7815/65536 [1:27:25<10:34:50,  1.52it/s]
 12%|█▏        | 7816/65536 [1:27:25<10:35:15,  1.51it/s]
 12%|█▏        | 7817/65536 [1:27:26<10:27:30,  1.53it/s]
 12%|█▏        | 7818/65536 [1:27:27<10:37:31,  1.51it/s]
 12%|█▏        | 7819/65536 [1:27:27<10:38:55,  1.51it/s]
 12%|█▏        | 7820/65536 [1:27:28<10:57:04,  1.46it/s]
                                                         
{'loss': 1.0483, 'learning_rate': 8.950348965348353e-07, 'epoch': 482.72}

 12%|█▏        | 7820/65536 [1:27:28<10:57:04,  1.46it/s]
 12%|█▏        | 7821/65536 [1:27:29<11:06:25,  1.44it/s]
 12%|█▏        | 7822/65536 [1:27:29<11:01:08,  1.45it/s]
 12%|█▏        | 7823/65536 [1:27:30<10:44:16,  1.49it/s]
 12%|█▏        | 7824/65536 [1:27:31<10:48:46,  1.48it/s]
 12%|█▏        | 7825/65536 [1:27:32<11:04:59,  1.45it/s]
 12%|█▏        | 7826/65536 [1:27:32<10:42:05,  1.50it/s]
 12%|█▏        | 7827/65536 [1:27:33<10:35:32,  1.51it/s]
 12%|█▏        | 7828/65536 [1:27:33<10:36:53,  1.51it/s]
 12%|█▏        | 7829/65536 [1:27:34<10:46:59,  1.49it/s]
 12%|█▏        | 7830/65536 [1:27:35<10:39:00,  1.51it/s]
 12%|█▏        | 7831/65536 [1:27:35<10:28:42,  1.53it/s]
 12%|█▏        | 7832/65536 [1:27:36<10:52:48,  1.47it/s]
 12%|█▏        | 7833/65536 [1:27:37<10:33:43,  1.52it/s]
 12%|█▏        | 7834/65536 [1:27:37<10:48:31,  1.48it/s]
 12%|█▏        | 7835/65536 [1:27:38<10:53:41,  1.47it/s]
 12%|█▏        | 7836/65536 [1:27:39<10:49:27,  1.48it/s]
 12%|█▏        | 7837/65536 [1:27:39<10:35:30,  1.51it/s]
 12%|█▏        | 7838/65536 [1:27:40<10:42:16,  1.50it/s]
 12%|█▏        | 7839/65536 [1:27:41<10:40:53,  1.50it/s]
 12%|█▏        | 7840/65536 [1:27:42<10:48:33,  1.48it/s]
                                                         
{'loss': 1.0467, 'learning_rate': 8.947593975756091e-07, 'epoch': 483.95}

 12%|█▏        | 7840/65536 [1:27:42<10:48:33,  1.48it/s]
 12%|█▏        | 7841/65536 [1:27:42<10:48:16,  1.48it/s]
 12%|█▏        | 7842/65536 [1:27:43<10:53:22,  1.47it/s]
 12%|█▏        | 7843/65536 [1:27:44<11:05:03,  1.45it/s]
 12%|█▏        | 7844/65536 [1:27:44<10:45:54,  1.49it/s]
 12%|█▏        | 7845/65536 [1:27:45<10:29:54,  1.53it/s]
 12%|█▏        | 7846/65536 [1:27:45<10:16:33,  1.56it/s]
 12%|█▏        | 7847/65536 [1:27:46<10:11:05,  1.57it/s]
 12%|█▏        | 7848/65536 [1:27:47<10:17:31,  1.56it/s]
 12%|█▏        | 7849/65536 [1:27:47<10:20:34,  1.55it/s]
 12%|█▏        | 7850/65536 [1:27:48<10:36:19,  1.51it/s]
 12%|█▏        | 7851/65536 [1:27:49<10:30:13,  1.53it/s]
 12%|█▏        | 7852/65536 [1:27:49<10:25:38,  1.54it/s]
 12%|█▏        | 7853/65536 [1:27:50<10:38:14,  1.51it/s]
 12%|█▏        | 7854/65536 [1:27:51<10:48:48,  1.48it/s]
 12%|█▏        | 7855/65536 [1:27:51<10:40:21,  1.50it/s]
 12%|█▏        | 7856/65536 [1:27:52<11:07:44,  1.44it/s]
 12%|█▏        | 7857/65536 [1:27:53<10:47:22,  1.48it/s]
 12%|█▏        | 7858/65536 [1:27:54<10:58:28,  1.46it/s]
 12%|█▏        | 7859/65536 [1:27:54<11:01:06,  1.45it/s]
 12%|█▏        | 7860/65536 [1:27:55<11:07:20,  1.44it/s]
                                                         
{'loss': 1.057, 'learning_rate': 8.944838986163829e-07, 'epoch': 485.19}

 12%|█▏        | 7860/65536 [1:27:55<11:07:20,  1.44it/s]
 12%|█▏        | 7861/65536 [1:27:56<10:49:37,  1.48it/s]
 12%|█▏        | 7862/65536 [1:27:56<10:42:12,  1.50it/s]
 12%|█▏        | 7863/65536 [1:27:57<11:00:56,  1.45it/s]
 12%|█▏        | 7864/65536 [1:27:58<10:35:31,  1.51it/s]
 12%|█▏        | 7865/65536 [1:27:58<10:37:16,  1.51it/s]
 12%|█▏        | 7866/65536 [1:27:59<10:47:56,  1.48it/s]
 12%|█▏        | 7867/65536 [1:28:00<10:46:45,  1.49it/s]
 12%|█▏        | 7868/65536 [1:28:00<11:06:11,  1.44it/s]
 12%|█▏        | 7869/65536 [1:28:01<10:39:05,  1.50it/s]
 12%|█▏        | 7870/65536 [1:28:02<10:56:51,  1.46it/s]
 12%|█▏        | 7871/65536 [1:28:02<10:45:44,  1.49it/s]
 12%|█▏        | 7872/65536 [1:28:03<10:37:25,  1.51it/s]
 12%|█▏        | 7873/65536 [1:28:04<10:30:23,  1.52it/s]
 12%|█▏        | 7874/65536 [1:28:04<10:51:59,  1.47it/s]
 12%|█▏        | 7875/65536 [1:28:05<10:53:50,  1.47it/s]
 12%|█▏        | 7876/65536 [1:28:06<11:04:43,  1.45it/s]
 12%|█▏        | 7877/65536 [1:28:06<10:53:58,  1.47it/s]
 12%|█▏        | 7878/65536 [1:28:07<10:41:42,  1.50it/s]
 12%|█▏        | 7879/65536 [1:28:08<10:41:38,  1.50it/s]
 12%|█▏        | 7880/65536 [1:28:08<10:55:31,  1.47it/s]
                                                         
{'loss': 1.0428, 'learning_rate': 8.942083996571568e-07, 'epoch': 486.42}

 12%|█▏        | 7880/65536 [1:28:08<10:55:31,  1.47it/s]
 12%|█▏        | 7881/65536 [1:28:09<10:50:05,  1.48it/s]
 12%|█▏        | 7882/65536 [1:28:10<10:38:43,  1.50it/s]
 12%|█▏        | 7883/65536 [1:28:10<10:46:57,  1.49it/s]
 12%|█▏        | 7884/65536 [1:28:11<10:41:33,  1.50it/s]
 12%|█▏        | 7885/65536 [1:28:12<10:36:23,  1.51it/s]
 12%|█▏        | 7886/65536 [1:28:12<10:30:35,  1.52it/s]
 12%|█▏        | 7887/65536 [1:28:13<10:32:37,  1.52it/s]
 12%|█▏        | 7888/65536 [1:28:14<10:35:27,  1.51it/s]
 12%|█▏        | 7889/65536 [1:28:14<10:41:29,  1.50it/s]
 12%|█▏        | 7890/65536 [1:28:15<11:02:42,  1.45it/s]
 12%|█▏        | 7891/65536 [1:28:16<11:02:40,  1.45it/s]
 12%|█▏        | 7892/65536 [1:28:16<10:50:05,  1.48it/s]
 12%|█▏        | 7893/65536 [1:28:17<11:03:53,  1.45it/s]
 12%|█▏        | 7894/65536 [1:28:18<11:00:41,  1.45it/s]
 12%|█▏        | 7895/65536 [1:28:18<10:41:44,  1.50it/s]
 12%|█▏        | 7896/65536 [1:28:19<10:50:02,  1.48it/s]
 12%|█▏        | 7897/65536 [1:28:20<10:45:43,  1.49it/s]
 12%|█▏        | 7898/65536 [1:28:21<11:01:01,  1.45it/s]
 12%|█▏        | 7899/65536 [1:28:21<10:41:47,  1.50it/s]
 12%|█▏        | 7900/65536 [1:28:22<10:33:31,  1.52it/s]
                                                         
{'loss': 1.0304, 'learning_rate': 8.939329006979306e-07, 'epoch': 487.65}

 12%|█▏        | 7900/65536 [1:28:22<10:33:31,  1.52it/s]
 12%|█▏        | 7901/65536 [1:28:22<10:39:25,  1.50it/s]
 12%|█▏        | 7902/65536 [1:28:23<10:38:30,  1.50it/s]
 12%|█▏        | 7903/65536 [1:28:24<10:33:58,  1.52it/s]
 12%|█▏        | 7904/65536 [1:28:24<10:41:50,  1.50it/s]
 12%|█▏        | 7905/65536 [1:28:25<10:39:19,  1.50it/s]
 12%|█▏        | 7906/65536 [1:28:26<10:55:56,  1.46it/s]
 12%|█▏        | 7907/65536 [1:28:27<10:58:40,  1.46it/s]
 12%|█▏        | 7908/65536 [1:28:27<11:01:12,  1.45it/s]
 12%|█▏        | 7909/65536 [1:28:28<10:43:33,  1.49it/s]
 12%|█▏        | 7910/65536 [1:28:29<10:40:30,  1.50it/s]
 12%|█▏        | 7911/65536 [1:28:29<10:59:13,  1.46it/s]
 12%|█▏        | 7912/65536 [1:28:30<10:54:50,  1.47it/s]
 12%|█▏        | 7913/65536 [1:28:31<10:47:39,  1.48it/s]
 12%|█▏        | 7914/65536 [1:28:31<10:39:38,  1.50it/s]
 12%|█▏        | 7915/65536 [1:28:32<10:39:03,  1.50it/s]
 12%|█▏        | 7916/65536 [1:28:33<10:49:29,  1.48it/s]
 12%|█▏        | 7917/65536 [1:28:33<10:45:43,  1.49it/s]
 12%|█▏        | 7918/65536 [1:28:34<10:52:46,  1.47it/s]
 12%|█▏        | 7919/65536 [1:28:35<10:47:20,  1.48it/s]
 12%|█▏        | 7920/65536 [1:28:35<10:50:29,  1.48it/s]
                                                         
{'loss': 1.0308, 'learning_rate': 8.936574017387045e-07, 'epoch': 488.89}

 12%|█▏        | 7920/65536 [1:28:35<10:50:29,  1.48it/s]
 12%|█▏        | 7921/65536 [1:28:36<10:33:05,  1.52it/s]
 12%|█▏        | 7922/65536 [1:28:37<10:52:16,  1.47it/s]
 12%|█▏        | 7923/65536 [1:28:37<10:49:13,  1.48it/s]
 12%|█▏        | 7924/65536 [1:28:38<10:42:35,  1.49it/s]
 12%|█▏        | 7925/65536 [1:28:39<10:42:49,  1.49it/s]
 12%|█▏        | 7926/65536 [1:28:39<10:28:56,  1.53it/s]
 12%|█▏        | 7927/65536 [1:28:40<10:44:49,  1.49it/s]
 12%|█▏        | 7928/65536 [1:28:41<11:04:35,  1.44it/s]
 12%|█▏        | 7929/65536 [1:28:41<11:13:57,  1.42it/s]
 12%|█▏        | 7930/65536 [1:28:42<10:54:28,  1.47it/s]
 12%|█▏        | 7931/65536 [1:28:43<10:45:57,  1.49it/s]
 12%|█▏        | 7932/65536 [1:28:43<10:41:05,  1.50it/s]
 12%|█▏        | 7933/65536 [1:28:44<10:23:35,  1.54it/s]
 12%|█▏        | 7934/65536 [1:28:45<10:32:13,  1.52it/s]
 12%|█▏        | 7935/65536 [1:28:45<10:38:58,  1.50it/s]
 12%|█▏        | 7936/65536 [1:28:46<10:47:09,  1.48it/s]
 12%|█▏        | 7937/65536 [1:28:47<10:42:40,  1.49it/s]
 12%|█▏        | 7938/65536 [1:28:47<10:23:56,  1.54it/s]
 12%|█▏        | 7939/65536 [1:28:48<10:50:50,  1.47it/s]
 12%|█▏        | 7940/65536 [1:28:49<10:45:55,  1.49it/s]
                                                         
{'loss': 1.0542, 'learning_rate': 8.933819027794784e-07, 'epoch': 490.12}

 12%|█▏        | 7940/65536 [1:28:49<10:45:55,  1.49it/s]
 12%|█▏        | 7941/65536 [1:28:49<10:59:34,  1.46it/s]
 12%|█▏        | 7942/65536 [1:28:50<10:34:14,  1.51it/s]
 12%|█▏        | 7943/65536 [1:28:51<10:12:30,  1.57it/s]
 12%|█▏        | 7944/65536 [1:28:51<10:16:29,  1.56it/s]
 12%|█▏        | 7945/65536 [1:28:52<10:30:03,  1.52it/s]
 12%|█▏        | 7946/65536 [1:28:53<10:18:19,  1.55it/s]
 12%|█▏        | 7947/65536 [1:28:53<10:36:25,  1.51it/s]
 12%|█▏        | 7948/65536 [1:28:54<10:32:19,  1.52it/s]
 12%|█▏        | 7949/65536 [1:28:55<10:43:22,  1.49it/s]
 12%|█▏        | 7950/65536 [1:28:55<10:35:39,  1.51it/s]
 12%|█▏        | 7951/65536 [1:28:56<10:35:52,  1.51it/s]
 12%|█▏        | 7952/65536 [1:28:57<10:43:33,  1.49it/s]
 12%|█▏        | 7953/65536 [1:28:57<10:33:55,  1.51it/s]
 12%|█▏        | 7954/65536 [1:28:58<10:31:09,  1.52it/s]
 12%|█▏        | 7955/65536 [1:28:59<10:47:39,  1.48it/s]
 12%|█▏        | 7956/65536 [1:28:59<11:01:40,  1.45it/s]
 12%|█▏        | 7957/65536 [1:29:00<11:00:56,  1.45it/s]
 12%|█▏        | 7958/65536 [1:29:01<10:57:59,  1.46it/s]
 12%|█▏        | 7959/65536 [1:29:01<10:44:58,  1.49it/s]
 12%|█▏        | 7960/65536 [1:29:02<10:47:49,  1.48it/s]
                                                         
{'loss': 1.0554, 'learning_rate': 8.931064038202521e-07, 'epoch': 491.36}

 12%|█▏        | 7960/65536 [1:29:02<10:47:49,  1.48it/s]
 12%|█▏        | 7961/65536 [1:29:03<10:42:56,  1.49it/s]
 12%|█▏        | 7962/65536 [1:29:03<10:42:36,  1.49it/s]
 12%|█▏        | 7963/65536 [1:29:04<10:47:44,  1.48it/s]
 12%|█▏        | 7964/65536 [1:29:05<10:57:11,  1.46it/s]
 12%|█▏        | 7965/65536 [1:29:05<10:55:29,  1.46it/s]
 12%|█▏        | 7966/65536 [1:29:06<10:47:08,  1.48it/s]
 12%|█▏        | 7967/65536 [1:29:07<10:30:38,  1.52it/s]
 12%|█▏        | 7968/65536 [1:29:07<10:41:05,  1.50it/s]
 12%|█▏        | 7969/65536 [1:29:08<10:41:24,  1.50it/s]
 12%|█▏        | 7970/65536 [1:29:09<10:30:28,  1.52it/s]
 12%|█▏        | 7971/65536 [1:29:09<10:56:08,  1.46it/s]
 12%|█▏        | 7972/65536 [1:29:10<10:53:58,  1.47it/s]
 12%|█▏        | 7973/65536 [1:29:11<10:52:16,  1.47it/s]
 12%|█▏        | 7974/65536 [1:29:11<10:48:06,  1.48it/s]
 12%|█▏        | 7975/65536 [1:29:12<10:42:01,  1.49it/s]
 12%|█▏        | 7976/65536 [1:29:13<10:22:45,  1.54it/s]
 12%|█▏        | 7977/65536 [1:29:13<10:27:28,  1.53it/s]
 12%|█▏        | 7978/65536 [1:29:14<10:32:56,  1.52it/s]
 12%|█▏        | 7979/65536 [1:29:15<10:48:12,  1.48it/s]
 12%|█▏        | 7980/65536 [1:29:15<10:56:58,  1.46it/s]
                                                         
{'loss': 1.0416, 'learning_rate': 8.92830904861026e-07, 'epoch': 492.59}

 12%|█▏        | 7980/65536 [1:29:15<10:56:58,  1.46it/s]
 12%|█▏        | 7981/65536 [1:29:16<10:59:22,  1.45it/s]
 12%|█▏        | 7982/65536 [1:29:17<10:50:05,  1.48it/s]
 12%|█▏        | 7983/65536 [1:29:17<10:46:46,  1.48it/s]
 12%|█▏        | 7984/65536 [1:29:18<10:40:01,  1.50it/s]
 12%|█▏        | 7985/65536 [1:29:19<10:43:03,  1.49it/s]
 12%|█▏        | 7986/65536 [1:29:20<10:52:07,  1.47it/s]
 12%|█▏        | 7987/65536 [1:29:20<10:48:10,  1.48it/s]
 12%|█▏        | 7988/65536 [1:29:21<10:57:25,  1.46it/s]
 12%|█▏        | 7989/65536 [1:29:22<10:57:32,  1.46it/s]
 12%|█▏        | 7990/65536 [1:29:22<10:56:12,  1.46it/s]
 12%|█▏        | 7991/65536 [1:29:23<11:16:30,  1.42it/s]
 12%|█▏        | 7992/65536 [1:29:24<10:52:56,  1.47it/s]
 12%|█▏        | 7993/65536 [1:29:24<10:52:39,  1.47it/s]
 12%|█▏        | 7994/65536 [1:29:25<10:52:22,  1.47it/s]
 12%|█▏        | 7995/65536 [1:29:26<10:46:27,  1.48it/s]
 12%|█▏        | 7996/65536 [1:29:26<10:39:32,  1.50it/s]
 12%|█▏        | 7997/65536 [1:29:27<10:39:14,  1.50it/s]
 12%|█▏        | 7998/65536 [1:29:28<10:30:42,  1.52it/s]
 12%|█▏        | 7999/65536 [1:29:28<10:20:04,  1.55it/s]
 12%|█▏        | 8000/65536 [1:29:29<10:36:59,  1.51it/s]
                                                         
{'loss': 1.0212, 'learning_rate': 8.925554059017998e-07, 'epoch': 493.83}

 12%|█▏        | 8000/65536 [1:29:29<10:36:59,  1.51it/s]
 12%|█▏        | 8001/65536 [1:29:30<10:37:18,  1.50it/s]
 12%|█▏        | 8002/65536 [1:29:30<10:41:27,  1.49it/s]
 12%|█▏        | 8003/65536 [1:29:31<11:06:10,  1.44it/s]
 12%|█▏        | 8004/65536 [1:29:32<11:00:16,  1.45it/s]
 12%|█▏        | 8005/65536 [1:29:32<10:52:05,  1.47it/s]
 12%|█▏        | 8006/65536 [1:29:33<10:57:31,  1.46it/s]
 12%|█▏        | 8007/65536 [1:29:34<10:51:43,  1.47it/s]
 12%|█▏        | 8008/65536 [1:29:34<10:31:55,  1.52it/s]
 12%|█▏        | 8009/65536 [1:29:35<10:28:40,  1.53it/s]
 12%|█▏        | 8010/65536 [1:29:36<10:26:33,  1.53it/s]
 12%|█▏        | 8011/65536 [1:29:36<10:33:00,  1.51it/s]
 12%|█▏        | 8012/65536 [1:29:37<10:43:54,  1.49it/s]
 12%|█▏        | 8013/65536 [1:29:38<10:55:26,  1.46it/s]
 12%|█▏        | 8014/65536 [1:29:38<10:36:48,  1.51it/s]
 12%|█▏        | 8015/65536 [1:29:39<10:44:42,  1.49it/s]
 12%|█▏        | 8016/65536 [1:29:40<10:47:05,  1.48it/s]
 12%|█▏        | 8017/65536 [1:29:40<10:51:28,  1.47it/s]
 12%|█▏        | 8018/65536 [1:29:41<10:39:29,  1.50it/s]
 12%|█▏        | 8019/65536 [1:29:42<10:23:40,  1.54it/s]
 12%|█▏        | 8020/65536 [1:29:42<10:29:07,  1.52it/s]
                                                         
{'loss': 1.0474, 'learning_rate': 8.922799069425738e-07, 'epoch': 495.06}

 12%|█▏        | 8020/65536 [1:29:42<10:29:07,  1.52it/s]
 12%|█▏        | 8021/65536 [1:29:43<10:30:41,  1.52it/s]
 12%|█▏        | 8022/65536 [1:29:44<10:44:38,  1.49it/s]
 12%|█▏        | 8023/65536 [1:29:44<10:49:57,  1.47it/s]
 12%|█▏        | 8024/65536 [1:29:45<10:52:26,  1.47it/s]
 12%|█▏        | 8025/65536 [1:29:46<10:43:39,  1.49it/s]
 12%|█▏        | 8026/65536 [1:29:46<10:40:11,  1.50it/s]
 12%|█▏        | 8027/65536 [1:29:47<10:54:05,  1.47it/s]
 12%|█▏        | 8028/65536 [1:29:48<10:36:07,  1.51it/s]
 12%|█▏        | 8029/65536 [1:29:48<10:35:09,  1.51it/s]
 12%|█▏        | 8030/65536 [1:29:49<10:35:09,  1.51it/s]
 12%|█▏        | 8031/65536 [1:29:50<10:50:52,  1.47it/s]
 12%|█▏        | 8032/65536 [1:29:50<10:44:05,  1.49it/s]
 12%|█▏        | 8033/65536 [1:29:51<10:46:10,  1.48it/s]
 12%|█▏        | 8034/65536 [1:29:52<10:58:00,  1.46it/s]
 12%|█▏        | 8035/65536 [1:29:52<10:44:55,  1.49it/s]
 12%|█▏        | 8036/65536 [1:29:53<10:52:22,  1.47it/s]
 12%|█▏        | 8037/65536 [1:29:54<11:06:17,  1.44it/s]
 12%|█▏        | 8038/65536 [1:29:55<10:50:17,  1.47it/s]
 12%|█▏        | 8039/65536 [1:29:55<11:02:23,  1.45it/s]
 12%|█▏        | 8040/65536 [1:29:56<10:52:25,  1.47it/s]
                                                         
{'loss': 1.0319, 'learning_rate': 8.920044079833476e-07, 'epoch': 496.3}

 12%|█▏        | 8040/65536 [1:29:56<10:52:25,  1.47it/s]
 12%|█▏        | 8041/65536 [1:29:57<10:49:41,  1.47it/s]
 12%|█▏        | 8042/65536 [1:29:57<10:34:12,  1.51it/s]
 12%|█▏        | 8043/65536 [1:29:58<10:37:05,  1.50it/s]
 12%|█▏        | 8044/65536 [1:29:58<10:25:59,  1.53it/s]
 12%|█▏        | 8045/65536 [1:29:59<10:29:56,  1.52it/s]
 12%|█▏        | 8046/65536 [1:30:00<10:35:44,  1.51it/s]
 12%|█▏        | 8047/65536 [1:30:01<10:57:42,  1.46it/s]
 12%|█▏        | 8048/65536 [1:30:01<10:40:21,  1.50it/s]
 12%|█▏        | 8049/65536 [1:30:02<10:37:32,  1.50it/s]
 12%|█▏        | 8050/65536 [1:30:02<10:22:43,  1.54it/s]
 12%|█▏        | 8051/65536 [1:30:03<10:28:40,  1.52it/s]
 12%|█▏        | 8052/65536 [1:30:04<10:56:09,  1.46it/s]
 12%|█▏        | 8053/65536 [1:30:05<11:04:44,  1.44it/s]
 12%|█▏        | 8054/65536 [1:30:05<10:54:55,  1.46it/s]
 12%|█▏        | 8055/65536 [1:30:06<10:33:21,  1.51it/s]
 12%|█▏        | 8056/65536 [1:30:07<10:41:07,  1.49it/s]
 12%|█▏        | 8057/65536 [1:30:07<10:39:42,  1.50it/s]
 12%|█▏        | 8058/65536 [1:30:08<10:40:23,  1.50it/s]
 12%|█▏        | 8059/65536 [1:30:09<10:49:57,  1.47it/s]
 12%|█▏        | 8060/65536 [1:30:09<10:55:55,  1.46it/s]
                                                         
{'loss': 1.0237, 'learning_rate': 8.917289090241215e-07, 'epoch': 497.53}

 12%|█▏        | 8060/65536 [1:30:09<10:55:55,  1.46it/s]
 12%|█▏        | 8061/65536 [1:30:10<10:39:48,  1.50it/s]
 12%|█▏        | 8062/65536 [1:30:11<10:41:12,  1.49it/s]
 12%|█▏        | 8063/65536 [1:30:11<10:53:47,  1.47it/s]
 12%|█▏        | 8064/65536 [1:30:12<10:33:58,  1.51it/s]
 12%|█▏        | 8065/65536 [1:30:13<10:25:03,  1.53it/s]
 12%|█▏        | 8066/65536 [1:30:13<10:45:09,  1.48it/s]
 12%|█▏        | 8067/65536 [1:30:14<10:25:15,  1.53it/s]
 12%|█▏        | 8068/65536 [1:30:15<10:54:11,  1.46it/s]
 12%|█▏        | 8069/65536 [1:30:15<10:57:55,  1.46it/s]
 12%|█▏        | 8070/65536 [1:30:16<10:52:59,  1.47it/s]
 12%|█▏        | 8071/65536 [1:30:17<10:56:06,  1.46it/s]
 12%|█▏        | 8072/65536 [1:30:17<10:49:29,  1.47it/s]
 12%|█▏        | 8073/65536 [1:30:18<10:34:16,  1.51it/s]
 12%|█▏        | 8074/65536 [1:30:19<10:49:04,  1.48it/s]
 12%|█▏        | 8075/65536 [1:30:19<10:45:38,  1.48it/s]
 12%|█▏        | 8076/65536 [1:30:20<10:48:16,  1.48it/s]
 12%|█▏        | 8077/65536 [1:30:21<10:43:27,  1.49it/s]
 12%|█▏        | 8078/65536 [1:30:21<10:31:54,  1.52it/s]
 12%|█▏        | 8079/65536 [1:30:22<10:34:51,  1.51it/s]
 12%|█▏        | 8080/65536 [1:30:23<10:46:28,  1.48it/s]
                                                         
{'loss': 1.0206, 'learning_rate': 8.914534100648954e-07, 'epoch': 498.77}

 12%|█▏        | 8080/65536 [1:30:23<10:46:28,  1.48it/s]
 12%|█▏        | 8081/65536 [1:30:23<10:35:14,  1.51it/s]
 12%|█▏        | 8082/65536 [1:30:24<10:53:20,  1.47it/s]
 12%|█▏        | 8083/65536 [1:30:25<10:45:31,  1.48it/s]
 12%|█▏        | 8084/65536 [1:30:25<10:55:12,  1.46it/s]
 12%|█▏        | 8085/65536 [1:30:26<10:50:04,  1.47it/s]
 12%|█▏        | 8086/65536 [1:30:27<10:52:14,  1.47it/s]
 12%|█▏        | 8087/65536 [1:30:27<10:54:47,  1.46it/s]
 12%|█▏        | 8088/65536 [1:30:28<10:43:06,  1.49it/s]
 12%|█▏        | 8089/65536 [1:30:29<10:35:33,  1.51it/s]
 12%|█▏        | 8090/65536 [1:30:29<10:27:45,  1.53it/s]
 12%|█▏        | 8091/65536 [1:30:30<10:19:38,  1.55it/s]
 12%|█▏        | 8092/65536 [1:30:31<10:31:50,  1.52it/s]
 12%|█▏        | 8093/65536 [1:30:31<10:24:47,  1.53it/s]
 12%|█▏        | 8094/65536 [1:30:32<10:38:46,  1.50it/s]
 12%|█▏        | 8095/65536 [1:30:33<10:48:01,  1.48it/s]
 12%|█▏        | 8096/65536 [1:30:33<10:36:02,  1.51it/s]
 12%|█▏        | 8097/65536 [1:30:34<10:28:54,  1.52it/s]
 12%|█▏        | 8098/65536 [1:30:35<10:45:29,  1.48it/s]
 12%|█▏        | 8099/65536 [1:30:35<10:54:43,  1.46it/s]
 12%|█▏        | 8100/65536 [1:30:36<10:59:30,  1.45it/s]
                                                         
{'loss': 1.035, 'learning_rate': 8.911779111056691e-07, 'epoch': 500.0}

 12%|█▏        | 8100/65536 [1:30:36<10:59:30,  1.45it/s]
 12%|█▏        | 8101/65536 [1:30:37<11:20:46,  1.41it/s]
 12%|█▏        | 8102/65536 [1:30:38<11:03:55,  1.44it/s]
 12%|█▏        | 8103/65536 [1:30:38<11:05:50,  1.44it/s]
 12%|█▏        | 8104/65536 [1:30:39<10:49:06,  1.47it/s]
 12%|█▏        | 8105/65536 [1:30:40<10:47:43,  1.48it/s]
 12%|█▏        | 8106/65536 [1:30:40<10:43:29,  1.49it/s]
 12%|█▏        | 8107/65536 [1:30:41<10:39:28,  1.50it/s]
 12%|█▏        | 8108/65536 [1:30:42<10:28:00,  1.52it/s]
 12%|█▏        | 8109/65536 [1:30:42<10:57:40,  1.46it/s]
 12%|█▏        | 8110/65536 [1:30:43<10:44:41,  1.48it/s]
 12%|█▏        | 8111/65536 [1:30:44<10:57:19,  1.46it/s]
 12%|█▏        | 8112/65536 [1:30:44<10:52:52,  1.47it/s]
 12%|█▏        | 8113/65536 [1:30:45<10:44:40,  1.48it/s]
 12%|█▏        | 8114/65536 [1:30:46<10:47:31,  1.48it/s]
 12%|█▏        | 8115/65536 [1:30:46<10:31:43,  1.51it/s]
 12%|█▏        | 8116/65536 [1:30:47<10:33:19,  1.51it/s]
 12%|█▏        | 8117/65536 [1:30:48<10:48:40,  1.48it/s]
 12%|█▏        | 8118/65536 [1:30:48<10:38:19,  1.50it/s]
 12%|█▏        | 8119/65536 [1:30:49<10:34:08,  1.51it/s]
 12%|█▏        | 8120/65536 [1:30:50<10:31:40,  1.51it/s]
                                                         
{'loss': 1.0304, 'learning_rate': 8.90902412146443e-07, 'epoch': 501.23}

 12%|█▏        | 8120/65536 [1:30:50<10:31:40,  1.51it/s]
 12%|█▏        | 8121/65536 [1:30:50<10:31:15,  1.52it/s]
 12%|█▏        | 8122/65536 [1:30:51<10:46:07,  1.48it/s]
 12%|█▏        | 8123/65536 [1:30:52<10:59:29,  1.45it/s]
 12%|█▏        | 8124/65536 [1:30:52<10:45:19,  1.48it/s]
 12%|█▏        | 8125/65536 [1:30:53<10:31:37,  1.51it/s]
 12%|█▏        | 8126/65536 [1:30:54<10:21:21,  1.54it/s]
 12%|█▏        | 8127/65536 [1:30:54<10:38:19,  1.50it/s]
 12%|█▏        | 8128/65536 [1:30:55<10:42:01,  1.49it/s]
 12%|█▏        | 8129/65536 [1:30:56<10:26:46,  1.53it/s]
 12%|█▏        | 8130/65536 [1:30:56<10:43:49,  1.49it/s]
 12%|█▏        | 8131/65536 [1:30:57<10:52:36,  1.47it/s]
 12%|█▏        | 8132/65536 [1:30:58<10:39:02,  1.50it/s]
 12%|█▏        | 8133/65536 [1:30:58<11:07:39,  1.43it/s]
 12%|█▏        | 8134/65536 [1:30:59<10:48:43,  1.47it/s]
 12%|█▏        | 8135/65536 [1:31:00<10:29:50,  1.52it/s]
 12%|█▏        | 8136/65536 [1:31:00<10:34:33,  1.51it/s]
 12%|█▏        | 8137/65536 [1:31:01<10:33:45,  1.51it/s]
 12%|█▏        | 8138/65536 [1:31:02<10:28:33,  1.52it/s]
 12%|█▏        | 8139/65536 [1:31:02<10:37:01,  1.50it/s]
 12%|█▏        | 8140/65536 [1:31:03<10:34:25,  1.51it/s]
                                                         
{'loss': 1.0363, 'learning_rate': 8.906269131872168e-07, 'epoch': 502.47}

 12%|█▏        | 8140/65536 [1:31:03<10:34:25,  1.51it/s]
 12%|█▏        | 8141/65536 [1:31:04<10:26:14,  1.53it/s]
 12%|█▏        | 8142/65536 [1:31:04<10:29:59,  1.52it/s]
 12%|█▏        | 8143/65536 [1:31:05<10:33:39,  1.51it/s]
 12%|█▏        | 8144/65536 [1:31:06<10:46:38,  1.48it/s]
 12%|█▏        | 8145/65536 [1:31:06<10:54:16,  1.46it/s]
 12%|█▏        | 8146/65536 [1:31:07<10:43:53,  1.49it/s]
 12%|█▏        | 8147/65536 [1:31:08<10:46:46,  1.48it/s]
 12%|█▏        | 8148/65536 [1:31:08<10:41:38,  1.49it/s]
 12%|█▏        | 8149/65536 [1:31:09<10:53:02,  1.46it/s]
 12%|█▏        | 8150/65536 [1:31:10<10:53:18,  1.46it/s]
 12%|█▏        | 8151/65536 [1:31:10<10:48:10,  1.48it/s]
 12%|█▏        | 8152/65536 [1:31:11<10:57:42,  1.45it/s]
 12%|█▏        | 8153/65536 [1:31:12<10:54:41,  1.46it/s]
 12%|█▏        | 8154/65536 [1:31:12<10:47:11,  1.48it/s]
 12%|█▏        | 8155/65536 [1:31:13<10:30:29,  1.52it/s]
 12%|█▏        | 8156/65536 [1:31:14<10:34:08,  1.51it/s]
 12%|█▏        | 8157/65536 [1:31:14<10:27:43,  1.52it/s]
 12%|█▏        | 8158/65536 [1:31:15<10:25:22,  1.53it/s]
 12%|█▏        | 8159/65536 [1:31:16<10:37:01,  1.50it/s]
 12%|█▏        | 8160/65536 [1:31:16<10:37:44,  1.50it/s]
                                                         
{'loss': 1.0234, 'learning_rate': 8.903514142279907e-07, 'epoch': 503.7}

 12%|█▏        | 8160/65536 [1:31:16<10:37:44,  1.50it/s]
 12%|█▏        | 8161/65536 [1:31:17<10:54:11,  1.46it/s]
 12%|█▏        | 8162/65536 [1:31:18<10:42:30,  1.49it/s]
 12%|█▏        | 8163/65536 [1:31:18<10:50:40,  1.47it/s]
 12%|█▏        | 8164/65536 [1:31:19<10:49:22,  1.47it/s]
 12%|█▏        | 8165/65536 [1:31:20<10:43:42,  1.49it/s]
 12%|█▏        | 8166/65536 [1:31:20<10:21:42,  1.54it/s]
 12%|█▏        | 8167/65536 [1:31:21<10:31:27,  1.51it/s]
 12%|█▏        | 8168/65536 [1:31:22<10:33:09,  1.51it/s]
 12%|█▏        | 8169/65536 [1:31:22<10:22:05,  1.54it/s]
 12%|█▏        | 8170/65536 [1:31:23<10:23:43,  1.53it/s]
 12%|█▏        | 8171/65536 [1:31:24<10:18:24,  1.55it/s]
 12%|█▏        | 8172/65536 [1:31:24<10:29:21,  1.52it/s]
 12%|█▏        | 8173/65536 [1:31:25<10:39:04,  1.50it/s]
 12%|█▏        | 8174/65536 [1:31:26<10:46:45,  1.48it/s]
 12%|█▏        | 8175/65536 [1:31:26<10:54:15,  1.46it/s]
 12%|█▏        | 8176/65536 [1:31:27<10:47:53,  1.48it/s]
 12%|█▏        | 8177/65536 [1:31:28<10:35:34,  1.50it/s]
 12%|█▏        | 8178/65536 [1:31:28<10:22:24,  1.54it/s]
 12%|█▏        | 8179/65536 [1:31:29<10:34:04,  1.51it/s]
 12%|█▏        | 8180/65536 [1:31:30<10:42:58,  1.49it/s]
                                                         
{'loss': 1.0472, 'learning_rate': 8.900759152687646e-07, 'epoch': 504.94}

 12%|█▏        | 8180/65536 [1:31:30<10:42:58,  1.49it/s]
 12%|█▏        | 8181/65536 [1:31:30<10:35:32,  1.50it/s]
 12%|█▏        | 8182/65536 [1:31:31<10:58:35,  1.45it/s]
 12%|█▏        | 8183/65536 [1:31:32<10:55:35,  1.46it/s]
 12%|█▏        | 8184/65536 [1:31:32<10:45:12,  1.48it/s]
 12%|█▏        | 8185/65536 [1:31:33<10:42:24,  1.49it/s]
 12%|█▏        | 8186/65536 [1:31:34<10:36:52,  1.50it/s]
 12%|█▏        | 8187/65536 [1:31:34<10:35:50,  1.50it/s]
 12%|█▏        | 8188/65536 [1:31:35<10:32:03,  1.51it/s]
 12%|█▏        | 8189/65536 [1:31:36<10:11:21,  1.56it/s]
 12%|█▏        | 8190/65536 [1:31:36<10:39:16,  1.50it/s]
 12%|█▏        | 8191/65536 [1:31:37<10:55:12,  1.46it/s]
 12%|█▎        | 8192/65536 [1:31:38<10:36:37,  1.50it/s]
 13%|█▎        | 8193/65536 [1:31:38<10:50:58,  1.47it/s]
 13%|█▎        | 8194/65536 [1:31:39<10:50:43,  1.47it/s]
 13%|█▎        | 8195/65536 [1:31:40<10:34:49,  1.51it/s]
 13%|█▎        | 8196/65536 [1:31:40<10:39:22,  1.49it/s]
 13%|█▎        | 8197/65536 [1:31:41<10:33:20,  1.51it/s]
 13%|█▎        | 8198/65536 [1:31:42<10:44:04,  1.48it/s]
 13%|█▎        | 8199/65536 [1:31:42<10:40:35,  1.49it/s]
 13%|█▎        | 8200/65536 [1:31:43<10:48:03,  1.47it/s]
                                                         
{'loss': 1.0233, 'learning_rate': 8.898004163095384e-07, 'epoch': 506.17}

 13%|█▎        | 8200/65536 [1:31:43<10:48:03,  1.47it/s]
 13%|█▎        | 8201/65536 [1:31:44<10:49:43,  1.47it/s]
 13%|█▎        | 8202/65536 [1:31:44<10:36:02,  1.50it/s]
 13%|█▎        | 8203/65536 [1:31:45<10:42:41,  1.49it/s]
 13%|█▎        | 8204/65536 [1:31:46<10:41:44,  1.49it/s]
 13%|█▎        | 8205/65536 [1:31:46<10:32:18,  1.51it/s]
 13%|█▎        | 8206/65536 [1:31:47<10:32:59,  1.51it/s]
 13%|█▎        | 8207/65536 [1:31:48<10:58:47,  1.45it/s]
 13%|█▎        | 8208/65536 [1:31:49<10:46:28,  1.48it/s]
 13%|█▎        | 8209/65536 [1:31:49<10:49:21,  1.47it/s]
 13%|█▎        | 8210/65536 [1:31:50<10:58:11,  1.45it/s]
 13%|█▎        | 8211/65536 [1:31:51<10:44:12,  1.48it/s]
 13%|█▎        | 8212/65536 [1:31:51<10:32:59,  1.51it/s]
 13%|█▎        | 8213/65536 [1:31:52<10:16:01,  1.55it/s]
 13%|█▎        | 8214/65536 [1:31:53<10:29:20,  1.52it/s]
 13%|█▎        | 8215/65536 [1:31:53<10:37:16,  1.50it/s]
 13%|█▎        | 8216/65536 [1:31:54<10:30:20,  1.52it/s]
 13%|█▎        | 8217/65536 [1:31:54<10:20:44,  1.54it/s]
 13%|█▎        | 8218/65536 [1:31:55<10:25:25,  1.53it/s]
 13%|█▎        | 8219/65536 [1:31:56<10:24:40,  1.53it/s]
 13%|█▎        | 8220/65536 [1:31:57<10:45:25,  1.48it/s]
                                                         
{'loss': 1.0295, 'learning_rate': 8.895249173503122e-07, 'epoch': 507.41}

 13%|█▎        | 8220/65536 [1:31:57<10:45:25,  1.48it/s]
 13%|█▎        | 8221/65536 [1:31:57<10:48:56,  1.47it/s]
 13%|█▎        | 8222/65536 [1:31:58<10:45:18,  1.48it/s]
 13%|█▎        | 8223/65536 [1:31:59<10:48:18,  1.47it/s]
 13%|█▎        | 8224/65536 [1:31:59<11:01:31,  1.44it/s]
 13%|█▎        | 8225/65536 [1:32:00<10:45:39,  1.48it/s]
 13%|█▎        | 8226/65536 [1:32:01<10:51:48,  1.47it/s]
 13%|█▎        | 8227/65536 [1:32:01<10:32:01,  1.51it/s]
 13%|█▎        | 8228/65536 [1:32:02<10:44:30,  1.48it/s]
 13%|█▎        | 8229/65536 [1:32:03<10:29:57,  1.52it/s]
 13%|█▎        | 8230/65536 [1:32:03<10:33:20,  1.51it/s]
 13%|█▎        | 8231/65536 [1:32:04<10:41:23,  1.49it/s]
 13%|█▎        | 8232/65536 [1:32:05<10:41:46,  1.49it/s]
 13%|█▎        | 8233/65536 [1:32:05<10:49:54,  1.47it/s]
 13%|█▎        | 8234/65536 [1:32:06<10:51:31,  1.47it/s]
 13%|█▎        | 8235/65536 [1:32:07<10:48:27,  1.47it/s]
 13%|█▎        | 8236/65536 [1:32:07<10:27:21,  1.52it/s]
 13%|█▎        | 8237/65536 [1:32:08<10:20:36,  1.54it/s]
 13%|█▎        | 8238/65536 [1:32:09<10:17:42,  1.55it/s]
 13%|█▎        | 8239/65536 [1:32:09<10:28:15,  1.52it/s]
 13%|█▎        | 8240/65536 [1:32:10<10:31:09,  1.51it/s]
                                                         
{'loss': 1.042, 'learning_rate': 8.89249418391086e-07, 'epoch': 508.64}

 13%|█▎        | 8240/65536 [1:32:10<10:31:09,  1.51it/s]
 13%|█▎        | 8241/65536 [1:32:11<10:19:17,  1.54it/s]
 13%|█▎        | 8242/65536 [1:32:11<10:18:59,  1.54it/s]
 13%|█▎        | 8243/65536 [1:32:12<10:26:43,  1.52it/s]
 13%|█▎        | 8244/65536 [1:32:13<10:35:51,  1.50it/s]
 13%|█▎        | 8245/65536 [1:32:13<10:33:55,  1.51it/s]
 13%|█▎        | 8246/65536 [1:32:14<10:39:31,  1.49it/s]
 13%|█▎        | 8247/65536 [1:32:14<10:29:43,  1.52it/s]
 13%|█▎        | 8248/65536 [1:32:15<10:33:10,  1.51it/s]
 13%|█▎        | 8249/65536 [1:32:16<10:32:15,  1.51it/s]
 13%|█▎        | 8250/65536 [1:32:17<10:50:46,  1.47it/s]
 13%|█▎        | 8251/65536 [1:32:17<10:47:46,  1.47it/s]
 13%|█▎        | 8252/65536 [1:32:18<10:49:06,  1.47it/s]
 13%|█▎        | 8253/65536 [1:32:19<10:38:56,  1.49it/s]
 13%|█▎        | 8254/65536 [1:32:19<10:47:29,  1.47it/s]
 13%|█▎        | 8255/65536 [1:32:20<10:39:15,  1.49it/s]
 13%|█▎        | 8256/65536 [1:32:21<10:38:31,  1.50it/s]
 13%|█▎        | 8257/65536 [1:32:21<10:41:50,  1.49it/s]
 13%|█▎        | 8258/65536 [1:32:22<10:53:48,  1.46it/s]
 13%|█▎        | 8259/65536 [1:32:23<10:44:38,  1.48it/s]
 13%|█▎        | 8260/65536 [1:32:23<10:41:28,  1.49it/s]
                                                         
{'loss': 1.0444, 'learning_rate': 8.889739194318599e-07, 'epoch': 509.88}

 13%|█▎        | 8260/65536 [1:32:23<10:41:28,  1.49it/s]
 13%|█▎        | 8261/65536 [1:32:24<10:40:21,  1.49it/s]
 13%|█▎        | 8262/65536 [1:32:25<10:24:45,  1.53it/s]
 13%|█▎        | 8263/65536 [1:32:25<10:40:29,  1.49it/s]
 13%|█▎        | 8264/65536 [1:32:26<10:46:35,  1.48it/s]
 13%|█▎        | 8265/65536 [1:32:27<10:32:56,  1.51it/s]
 13%|█▎        | 8266/65536 [1:32:27<10:24:39,  1.53it/s]
 13%|█▎        | 8267/65536 [1:32:28<10:29:29,  1.52it/s]
 13%|█▎        | 8268/65536 [1:32:29<10:30:03,  1.51it/s]
 13%|█▎        | 8269/65536 [1:32:29<10:23:08,  1.53it/s]
 13%|█▎        | 8270/65536 [1:32:30<10:18:49,  1.54it/s]
 13%|█▎        | 8271/65536 [1:32:31<10:25:26,  1.53it/s]
 13%|█▎        | 8272/65536 [1:32:31<10:27:05,  1.52it/s]
 13%|█▎        | 8273/65536 [1:32:32<10:25:15,  1.53it/s]
 13%|█▎        | 8274/65536 [1:32:33<10:40:31,  1.49it/s]
 13%|█▎        | 8275/65536 [1:32:33<10:36:53,  1.50it/s]
 13%|█▎        | 8276/65536 [1:32:34<10:33:33,  1.51it/s]
 13%|█▎        | 8277/65536 [1:32:35<10:41:33,  1.49it/s]
 13%|█▎        | 8278/65536 [1:32:35<10:31:50,  1.51it/s]
 13%|█▎        | 8279/65536 [1:32:36<10:39:20,  1.49it/s]
 13%|█▎        | 8280/65536 [1:32:37<10:32:42,  1.51it/s]
                                                         
{'loss': 1.0554, 'learning_rate': 8.886984204726337e-07, 'epoch': 511.11}

 13%|█▎        | 8280/65536 [1:32:37<10:32:42,  1.51it/s]
 13%|█▎        | 8281/65536 [1:32:37<10:44:38,  1.48it/s]
 13%|█▎        | 8282/65536 [1:32:38<10:44:08,  1.48it/s]
 13%|█▎        | 8283/65536 [1:32:39<10:53:04,  1.46it/s]
 13%|█▎        | 8284/65536 [1:32:39<10:22:57,  1.53it/s]
 13%|█▎        | 8285/65536 [1:32:40<10:37:30,  1.50it/s]
 13%|█▎        | 8286/65536 [1:32:41<10:58:37,  1.45it/s]
 13%|█▎        | 8287/65536 [1:32:41<10:38:44,  1.49it/s]
 13%|█▎        | 8288/65536 [1:32:42<10:44:20,  1.48it/s]
 13%|█▎        | 8289/65536 [1:32:43<10:17:27,  1.55it/s]
 13%|█▎        | 8290/65536 [1:32:43<10:13:47,  1.55it/s]
 13%|█▎        | 8291/65536 [1:32:44<10:30:45,  1.51it/s]
 13%|█▎        | 8292/65536 [1:32:45<10:31:37,  1.51it/s]
 13%|█▎        | 8293/65536 [1:32:45<10:38:06,  1.50it/s]
 13%|█▎        | 8294/65536 [1:32:46<10:32:54,  1.51it/s]
 13%|█▎        | 8295/65536 [1:32:47<10:44:54,  1.48it/s]
 13%|█▎        | 8296/65536 [1:32:47<10:47:56,  1.47it/s]
 13%|█▎        | 8297/65536 [1:32:48<10:32:40,  1.51it/s]
 13%|█▎        | 8298/65536 [1:32:49<10:29:14,  1.52it/s]
 13%|█▎        | 8299/65536 [1:32:49<10:50:45,  1.47it/s]
 13%|█▎        | 8300/65536 [1:32:50<11:08:43,  1.43it/s]
                                                         
{'loss': 1.0247, 'learning_rate': 8.884229215134076e-07, 'epoch': 512.35}

 13%|█▎        | 8300/65536 [1:32:50<11:08:43,  1.43it/s]
 13%|█▎        | 8301/65536 [1:32:51<11:03:32,  1.44it/s]
 13%|█▎        | 8302/65536 [1:32:51<11:01:23,  1.44it/s]
 13%|█▎        | 8303/65536 [1:32:52<10:45:59,  1.48it/s]
 13%|█▎        | 8304/65536 [1:32:53<10:44:16,  1.48it/s]
 13%|█▎        | 8305/65536 [1:32:53<10:43:13,  1.48it/s]
 13%|█▎        | 8306/65536 [1:32:54<10:58:28,  1.45it/s]
 13%|█▎        | 8307/65536 [1:32:55<10:46:10,  1.48it/s]
 13%|█▎        | 8308/65536 [1:32:55<10:33:47,  1.50it/s]
 13%|█▎        | 8309/65536 [1:32:56<10:42:19,  1.48it/s]
 13%|█▎        | 8310/65536 [1:32:57<10:46:26,  1.48it/s]
 13%|█▎        | 8311/65536 [1:32:57<10:50:55,  1.47it/s]
 13%|█▎        | 8312/65536 [1:32:58<10:52:55,  1.46it/s]
 13%|█▎        | 8313/65536 [1:32:59<10:42:40,  1.48it/s]
 13%|█▎        | 8314/65536 [1:32:59<10:44:13,  1.48it/s]
 13%|█▎        | 8315/65536 [1:33:00<10:36:17,  1.50it/s]
 13%|█▎        | 8316/65536 [1:33:01<10:26:14,  1.52it/s]
 13%|█▎        | 8317/65536 [1:33:01<10:44:04,  1.48it/s]
 13%|█▎        | 8318/65536 [1:33:02<10:52:33,  1.46it/s]
 13%|█▎        | 8319/65536 [1:33:03<10:46:47,  1.47it/s]
 13%|█▎        | 8320/65536 [1:33:03<10:41:09,  1.49it/s]
                                                         
{'loss': 1.0235, 'learning_rate': 8.881474225541814e-07, 'epoch': 513.58}

 13%|█▎        | 8320/65536 [1:33:03<10:41:09,  1.49it/s]
 13%|█▎        | 8321/65536 [1:33:04<10:40:01,  1.49it/s]
 13%|█▎        | 8322/65536 [1:33:05<10:31:14,  1.51it/s]
 13%|█▎        | 8323/65536 [1:33:05<10:32:20,  1.51it/s]
 13%|█▎        | 8324/65536 [1:33:06<10:19:18,  1.54it/s]
 13%|█▎        | 8325/65536 [1:33:07<10:25:59,  1.52it/s]
 13%|█▎        | 8326/65536 [1:33:07<10:30:55,  1.51it/s]
 13%|█▎        | 8327/65536 [1:33:08<10:46:40,  1.47it/s]
 13%|█▎        | 8328/65536 [1:33:09<10:43:38,  1.48it/s]
 13%|█▎        | 8329/65536 [1:33:09<10:36:05,  1.50it/s]
 13%|█▎        | 8330/65536 [1:33:10<10:33:48,  1.50it/s]
 13%|█▎        | 8331/65536 [1:33:11<10:38:56,  1.49it/s]
 13%|█▎        | 8332/65536 [1:33:11<10:36:13,  1.50it/s]
 13%|█▎        | 8333/65536 [1:33:12<10:50:08,  1.47it/s]
 13%|█▎        | 8334/65536 [1:33:13<11:01:44,  1.44it/s]
 13%|█▎        | 8335/65536 [1:33:14<10:51:02,  1.46it/s]
 13%|█▎        | 8336/65536 [1:33:14<10:47:52,  1.47it/s]
 13%|█▎        | 8337/65536 [1:33:15<10:45:23,  1.48it/s]
 13%|█▎        | 8338/65536 [1:33:16<10:41:45,  1.49it/s]
 13%|█▎        | 8339/65536 [1:33:16<10:40:42,  1.49it/s]
 13%|█▎        | 8340/65536 [1:33:17<10:33:59,  1.50it/s]
                                                         
{'loss': 1.0184, 'learning_rate': 8.878719235949553e-07, 'epoch': 514.81}

 13%|█▎        | 8340/65536 [1:33:17<10:33:59,  1.50it/s]
 13%|█▎        | 8341/65536 [1:33:18<10:32:03,  1.51it/s]
 13%|█▎        | 8342/65536 [1:33:18<10:54:16,  1.46it/s]
 13%|█▎        | 8343/65536 [1:33:19<10:37:03,  1.50it/s]
 13%|█▎        | 8344/65536 [1:33:20<11:20:10,  1.40it/s]
 13%|█▎        | 8345/65536 [1:33:20<10:53:14,  1.46it/s]
 13%|█▎        | 8346/65536 [1:33:21<11:01:49,  1.44it/s]
 13%|█▎        | 8347/65536 [1:33:22<10:49:18,  1.47it/s]
 13%|█▎        | 8348/65536 [1:33:22<10:28:29,  1.52it/s]
 13%|█▎        | 8349/65536 [1:33:23<10:23:00,  1.53it/s]
 13%|█▎        | 8350/65536 [1:33:24<10:24:31,  1.53it/s]
 13%|█▎        | 8351/65536 [1:33:24<10:14:52,  1.55it/s]
 13%|█▎        | 8352/65536 [1:33:25<10:20:42,  1.54it/s]
 13%|█▎        | 8353/65536 [1:33:26<10:35:14,  1.50it/s]
 13%|█▎        | 8354/65536 [1:33:26<10:28:42,  1.52it/s]
 13%|█▎        | 8355/65536 [1:33:27<10:33:21,  1.50it/s]
 13%|█▎        | 8356/65536 [1:33:28<10:28:11,  1.52it/s]
 13%|█▎        | 8357/65536 [1:33:28<10:42:02,  1.48it/s]
 13%|█▎        | 8358/65536 [1:33:29<10:35:09,  1.50it/s]
 13%|█▎        | 8359/65536 [1:33:30<10:33:09,  1.51it/s]
 13%|█▎        | 8360/65536 [1:33:30<10:53:42,  1.46it/s]
                                                         
{'loss': 1.048, 'learning_rate': 8.875964246357292e-07, 'epoch': 516.05}

 13%|█▎        | 8360/65536 [1:33:30<10:53:42,  1.46it/s]
 13%|█▎        | 8361/65536 [1:33:31<11:05:16,  1.43it/s]
 13%|█▎        | 8362/65536 [1:33:32<10:55:55,  1.45it/s]
 13%|█▎        | 8363/65536 [1:33:32<10:38:12,  1.49it/s]
 13%|█▎        | 8364/65536 [1:33:33<10:45:59,  1.48it/s]
 13%|█▎        | 8365/65536 [1:33:34<10:50:07,  1.47it/s]
 13%|█▎        | 8366/65536 [1:33:34<10:54:06,  1.46it/s]
 13%|█▎        | 8367/65536 [1:33:35<10:33:41,  1.50it/s]
 13%|█▎        | 8368/65536 [1:33:36<10:41:43,  1.48it/s]
 13%|█▎        | 8369/65536 [1:33:36<10:42:19,  1.48it/s]
 13%|█▎        | 8370/65536 [1:33:37<10:34:44,  1.50it/s]
 13%|█▎        | 8371/65536 [1:33:38<10:20:12,  1.54it/s]
 13%|█▎        | 8372/65536 [1:33:38<10:22:04,  1.53it/s]
 13%|█▎        | 8373/65536 [1:33:39<10:30:27,  1.51it/s]
 13%|█▎        | 8374/65536 [1:33:40<10:33:16,  1.50it/s]
 13%|█▎        | 8375/65536 [1:33:40<10:22:05,  1.53it/s]
 13%|█▎        | 8376/65536 [1:33:41<10:50:45,  1.46it/s]
 13%|█▎        | 8377/65536 [1:33:42<10:58:52,  1.45it/s]
 13%|█▎        | 8378/65536 [1:33:43<11:17:39,  1.41it/s]
 13%|█▎        | 8379/65536 [1:33:43<10:45:57,  1.47it/s]
 13%|█▎        | 8380/65536 [1:33:44<10:30:10,  1.51it/s]
                                                         
{'loss': 1.0154, 'learning_rate': 8.873209256765029e-07, 'epoch': 517.28}

 13%|█▎        | 8380/65536 [1:33:44<10:30:10,  1.51it/s]
 13%|█▎        | 8381/65536 [1:33:44<10:16:35,  1.54it/s]
 13%|█▎        | 8382/65536 [1:33:45<10:31:58,  1.51it/s]
 13%|█▎        | 8383/65536 [1:33:46<10:25:59,  1.52it/s]
 13%|█▎        | 8384/65536 [1:33:46<10:12:34,  1.55it/s]
 13%|█▎        | 8385/65536 [1:33:47<10:24:31,  1.53it/s]
 13%|█▎        | 8386/65536 [1:33:48<10:32:50,  1.51it/s]
 13%|█▎        | 8387/65536 [1:33:48<10:32:19,  1.51it/s]
 13%|█▎        | 8388/65536 [1:33:49<10:25:12,  1.52it/s]
 13%|█▎        | 8389/65536 [1:33:50<10:21:51,  1.53it/s]
 13%|█▎        | 8390/65536 [1:33:50<10:23:41,  1.53it/s]
 13%|█▎        | 8391/65536 [1:33:51<10:24:43,  1.52it/s]
 13%|█▎        | 8392/65536 [1:33:52<10:45:55,  1.47it/s]
 13%|█▎        | 8393/65536 [1:33:52<10:28:02,  1.52it/s]
 13%|█▎        | 8394/65536 [1:33:53<10:22:42,  1.53it/s]
 13%|█▎        | 8395/65536 [1:33:54<10:29:55,  1.51it/s]
 13%|█▎        | 8396/65536 [1:33:54<10:44:40,  1.48it/s]
 13%|█▎        | 8397/65536 [1:33:55<10:33:26,  1.50it/s]
 13%|█▎        | 8398/65536 [1:33:56<10:39:53,  1.49it/s]
 13%|█▎        | 8399/65536 [1:33:56<10:32:33,  1.51it/s]
 13%|█▎        | 8400/65536 [1:33:57<10:28:27,  1.52it/s]
                                                         
{'loss': 1.0525, 'learning_rate': 8.870454267172768e-07, 'epoch': 518.52}

 13%|█▎        | 8400/65536 [1:33:57<10:28:27,  1.52it/s]
 13%|█▎        | 8401/65536 [1:33:58<10:36:47,  1.50it/s]
 13%|█▎        | 8402/65536 [1:33:58<10:59:51,  1.44it/s]
 13%|█▎        | 8403/65536 [1:33:59<10:53:10,  1.46it/s]
 13%|█▎        | 8404/65536 [1:34:00<10:38:36,  1.49it/s]
 13%|█▎        | 8405/65536 [1:34:00<10:31:52,  1.51it/s]
 13%|█▎        | 8406/65536 [1:34:01<10:39:15,  1.49it/s]
 13%|█▎        | 8407/65536 [1:34:02<10:35:35,  1.50it/s]
 13%|█▎        | 8408/65536 [1:34:02<10:47:38,  1.47it/s]
 13%|█▎        | 8409/65536 [1:34:03<10:51:03,  1.46it/s]
 13%|█▎        | 8410/65536 [1:34:04<11:02:45,  1.44it/s]
 13%|█▎        | 8411/65536 [1:34:04<10:48:03,  1.47it/s]
 13%|█▎        | 8412/65536 [1:34:05<10:47:13,  1.47it/s]
 13%|█▎        | 8413/65536 [1:34:06<11:03:48,  1.43it/s]
 13%|█▎        | 8414/65536 [1:34:07<11:00:28,  1.44it/s]
 13%|█▎        | 8415/65536 [1:34:07<11:00:02,  1.44it/s]
 13%|█▎        | 8416/65536 [1:34:08<10:57:15,  1.45it/s]
 13%|█▎        | 8417/65536 [1:34:09<10:51:44,  1.46it/s]
 13%|█▎        | 8418/65536 [1:34:09<10:33:40,  1.50it/s]
 13%|█▎        | 8419/65536 [1:34:10<10:34:41,  1.50it/s]
 13%|█▎        | 8420/65536 [1:34:11<10:28:01,  1.52it/s]
                                                         
{'loss': 1.0047, 'learning_rate': 8.867699277580506e-07, 'epoch': 519.75}

 13%|█▎        | 8420/65536 [1:34:11<10:28:01,  1.52it/s]
 13%|█▎        | 8421/65536 [1:34:11<10:18:03,  1.54it/s]
 13%|█▎        | 8422/65536 [1:34:12<10:18:06,  1.54it/s]
 13%|█▎        | 8423/65536 [1:34:12<10:20:54,  1.53it/s]
 13%|█▎        | 8424/65536 [1:34:13<10:10:48,  1.56it/s]
 13%|█▎        | 8425/65536 [1:34:14<10:45:01,  1.48it/s]
 13%|█▎        | 8426/65536 [1:34:15<10:35:08,  1.50it/s]
 13%|█▎        | 8427/65536 [1:34:15<10:42:55,  1.48it/s]
 13%|█▎        | 8428/65536 [1:34:16<10:33:20,  1.50it/s]
 13%|█▎        | 8429/65536 [1:34:16<10:23:49,  1.53it/s]
 13%|█▎        | 8430/65536 [1:34:17<10:33:55,  1.50it/s]
 13%|█▎        | 8431/65536 [1:34:18<10:35:44,  1.50it/s]
 13%|█▎        | 8432/65536 [1:34:18<10:33:14,  1.50it/s]
 13%|█▎        | 8433/65536 [1:34:19<10:36:26,  1.50it/s]
 13%|█▎        | 8434/65536 [1:34:20<10:41:55,  1.48it/s]
 13%|█▎        | 8435/65536 [1:34:21<10:56:36,  1.45it/s]
 13%|█▎        | 8436/65536 [1:34:21<10:42:27,  1.48it/s]
 13%|█▎        | 8437/65536 [1:34:22<10:38:05,  1.49it/s]
 13%|█▎        | 8438/65536 [1:34:22<10:13:50,  1.55it/s]
 13%|█▎        | 8439/65536 [1:34:23<10:17:39,  1.54it/s]
 13%|█▎        | 8440/65536 [1:34:24<10:24:13,  1.52it/s]
                                                         
{'loss': 1.0389, 'learning_rate': 8.864944287988245e-07, 'epoch': 520.99}

 13%|█▎        | 8440/65536 [1:34:24<10:24:13,  1.52it/s]
 13%|█▎        | 8441/65536 [1:34:24<10:31:45,  1.51it/s]
 13%|█▎        | 8442/65536 [1:34:25<10:35:17,  1.50it/s]
 13%|█▎        | 8443/65536 [1:34:26<10:38:01,  1.49it/s]
 13%|█▎        | 8444/65536 [1:34:27<10:37:56,  1.49it/s]
 13%|█▎        | 8445/65536 [1:34:27<10:27:41,  1.52it/s]
 13%|█▎        | 8446/65536 [1:34:28<10:25:56,  1.52it/s]
 13%|█▎        | 8447/65536 [1:34:29<10:58:12,  1.45it/s]
 13%|█▎        | 8448/65536 [1:34:29<10:43:15,  1.48it/s]
 13%|█▎        | 8449/65536 [1:34:30<10:36:19,  1.50it/s]
 13%|█▎        | 8450/65536 [1:34:31<10:43:54,  1.48it/s]
 13%|█▎        | 8451/65536 [1:34:31<10:46:22,  1.47it/s]
 13%|█▎        | 8452/65536 [1:34:32<10:14:54,  1.55it/s]
 13%|█▎        | 8453/65536 [1:34:32<10:24:23,  1.52it/s]
 13%|█▎        | 8454/65536 [1:34:33<10:31:24,  1.51it/s]
 13%|█▎        | 8455/65536 [1:34:34<10:32:13,  1.50it/s]
 13%|█▎        | 8456/65536 [1:34:35<10:39:34,  1.49it/s]
 13%|█▎        | 8457/65536 [1:34:35<11:04:59,  1.43it/s]
 13%|█▎        | 8458/65536 [1:34:36<11:11:32,  1.42it/s]
 13%|█▎        | 8459/65536 [1:34:37<11:12:24,  1.41it/s]
 13%|█▎        | 8460/65536 [1:34:37<10:58:47,  1.44it/s]
                                                         
{'loss': 1.0296, 'learning_rate': 8.862189298395984e-07, 'epoch': 522.22}

 13%|█▎        | 8460/65536 [1:34:37<10:58:47,  1.44it/s]
 13%|█▎        | 8461/65536 [1:34:38<10:51:02,  1.46it/s]
 13%|█▎        | 8462/65536 [1:34:39<10:36:40,  1.49it/s]
 13%|█▎        | 8463/65536 [1:34:39<10:33:14,  1.50it/s]
 13%|█▎        | 8464/65536 [1:34:40<10:27:08,  1.52it/s]
 13%|█▎        | 8465/65536 [1:34:41<10:18:40,  1.54it/s]
 13%|█▎        | 8466/65536 [1:34:41<10:29:36,  1.51it/s]
 13%|█▎        | 8467/65536 [1:34:42<10:28:58,  1.51it/s]
 13%|█▎        | 8468/65536 [1:34:43<10:18:48,  1.54it/s]
 13%|█▎        | 8469/65536 [1:34:43<10:26:37,  1.52it/s]
 13%|█▎        | 8470/65536 [1:34:44<10:39:24,  1.49it/s]
 13%|█▎        | 8471/65536 [1:34:45<10:32:17,  1.50it/s]
 13%|█▎        | 8472/65536 [1:34:45<10:34:26,  1.50it/s]
 13%|█▎        | 8473/65536 [1:34:46<10:55:16,  1.45it/s]
 13%|█▎        | 8474/65536 [1:34:47<10:54:07,  1.45it/s]
 13%|█▎        | 8475/65536 [1:34:47<10:49:34,  1.46it/s]
 13%|█▎        | 8476/65536 [1:34:48<10:46:32,  1.47it/s]
 13%|█▎        | 8477/65536 [1:34:49<10:51:22,  1.46it/s]
 13%|█▎        | 8478/65536 [1:34:49<10:40:55,  1.48it/s]
 13%|█▎        | 8479/65536 [1:34:50<10:40:06,  1.49it/s]
 13%|█▎        | 8480/65536 [1:34:51<10:26:15,  1.52it/s]
                                                         
{'loss': 1.0246, 'learning_rate': 8.859434308803721e-07, 'epoch': 523.46}

 13%|█▎        | 8480/65536 [1:34:51<10:26:15,  1.52it/s]
 13%|█▎        | 8481/65536 [1:34:51<10:46:25,  1.47it/s]
 13%|█▎        | 8482/65536 [1:34:52<10:55:36,  1.45it/s]
 13%|█▎        | 8483/65536 [1:34:53<10:36:09,  1.49it/s]
 13%|█▎        | 8484/65536 [1:34:53<10:24:23,  1.52it/s]
 13%|█▎        | 8485/65536 [1:34:54<10:20:24,  1.53it/s]
 13%|█▎        | 8486/65536 [1:34:55<10:45:19,  1.47it/s]
 13%|█▎        | 8487/65536 [1:34:55<10:35:19,  1.50it/s]
 13%|█▎        | 8488/65536 [1:34:56<10:31:51,  1.50it/s]
 13%|█▎        | 8489/65536 [1:34:57<10:39:36,  1.49it/s]
 13%|█▎        | 8490/65536 [1:34:57<10:21:25,  1.53it/s]
 13%|█▎        | 8491/65536 [1:34:58<10:21:03,  1.53it/s]
 13%|█▎        | 8492/65536 [1:34:59<10:23:22,  1.53it/s]
 13%|█▎        | 8493/65536 [1:34:59<10:25:17,  1.52it/s]
 13%|█▎        | 8494/65536 [1:35:00<10:31:43,  1.50it/s]
 13%|█▎        | 8495/65536 [1:35:01<10:35:10,  1.50it/s]
 13%|█▎        | 8496/65536 [1:35:01<10:32:17,  1.50it/s]
 13%|█▎        | 8497/65536 [1:35:02<10:36:19,  1.49it/s]
 13%|█▎        | 8498/65536 [1:35:03<10:29:31,  1.51it/s]
 13%|█▎        | 8499/65536 [1:35:03<10:16:07,  1.54it/s]
 13%|█▎        | 8500/65536 [1:35:04<10:22:56,  1.53it/s]
                                                         
{'loss': 1.0446, 'learning_rate': 8.85667931921146e-07, 'epoch': 524.69}

 13%|█▎        | 8500/65536 [1:35:04<10:22:56,  1.53it/s]
 13%|█▎        | 8501/65536 [1:35:05<10:35:25,  1.50it/s]
 13%|█▎        | 8502/65536 [1:35:05<10:29:06,  1.51it/s]
 13%|█▎        | 8503/65536 [1:35:06<10:45:25,  1.47it/s]
 13%|█▎        | 8504/65536 [1:35:07<10:57:23,  1.45it/s]
 13%|█▎        | 8505/65536 [1:35:07<11:02:51,  1.43it/s]
 13%|█▎        | 8506/65536 [1:35:08<10:58:15,  1.44it/s]
 13%|█▎        | 8507/65536 [1:35:09<10:43:28,  1.48it/s]
 13%|█▎        | 8508/65536 [1:35:09<10:35:53,  1.49it/s]
 13%|█▎        | 8509/65536 [1:35:10<10:53:38,  1.45it/s]
 13%|█▎        | 8510/65536 [1:35:11<10:46:14,  1.47it/s]
 13%|█▎        | 8511/65536 [1:35:12<11:08:12,  1.42it/s]
 13%|█▎        | 8512/65536 [1:35:12<11:04:16,  1.43it/s]
 13%|█▎        | 8513/65536 [1:35:13<10:59:19,  1.44it/s]
 13%|█▎        | 8514/65536 [1:35:14<10:35:09,  1.50it/s]
 13%|█▎        | 8515/65536 [1:35:14<10:23:22,  1.52it/s]
 13%|█▎        | 8516/65536 [1:35:15<10:30:34,  1.51it/s]
 13%|█▎        | 8517/65536 [1:35:16<10:27:13,  1.52it/s]
 13%|█▎        | 8518/65536 [1:35:16<10:28:51,  1.51it/s]
 13%|█▎        | 8519/65536 [1:35:17<10:20:19,  1.53it/s]
 13%|█▎        | 8520/65536 [1:35:17<10:17:59,  1.54it/s]
                                                         
{'loss': 1.0259, 'learning_rate': 8.853924329619198e-07, 'epoch': 525.93}

 13%|█▎        | 8520/65536 [1:35:17<10:17:59,  1.54it/s]
 13%|█▎        | 8521/65536 [1:35:18<10:31:06,  1.51it/s]
 13%|█▎        | 8522/65536 [1:35:19<10:59:00,  1.44it/s]
 13%|█▎        | 8523/65536 [1:35:20<11:06:49,  1.42it/s]
 13%|█▎        | 8524/65536 [1:35:20<10:43:58,  1.48it/s]
 13%|█▎        | 8525/65536 [1:35:21<11:03:30,  1.43it/s]
 13%|█▎        | 8526/65536 [1:35:22<10:49:54,  1.46it/s]
 13%|█▎        | 8527/65536 [1:35:22<10:52:20,  1.46it/s]
 13%|█▎        | 8528/65536 [1:35:23<10:40:51,  1.48it/s]
 13%|█▎        | 8529/65536 [1:35:24<10:33:04,  1.50it/s]
 13%|█▎        | 8530/65536 [1:35:24<10:14:02,  1.55it/s]
 13%|█▎        | 8531/65536 [1:35:25<10:24:31,  1.52it/s]
 13%|█▎        | 8532/65536 [1:35:26<10:22:24,  1.53it/s]
 13%|█▎        | 8533/65536 [1:35:26<10:26:52,  1.52it/s]
 13%|█▎        | 8534/65536 [1:35:27<10:43:29,  1.48it/s]
 13%|█▎        | 8535/65536 [1:35:28<10:26:00,  1.52it/s]
 13%|█▎        | 8536/65536 [1:35:28<10:23:57,  1.52it/s]
 13%|█▎        | 8537/65536 [1:35:29<10:31:37,  1.50it/s]
 13%|█▎        | 8538/65536 [1:35:30<10:42:09,  1.48it/s]
 13%|█▎        | 8539/65536 [1:35:30<10:38:48,  1.49it/s]
 13%|█▎        | 8540/65536 [1:35:31<10:41:31,  1.48it/s]
                                                         
{'loss': 1.0215, 'learning_rate': 8.851169340026937e-07, 'epoch': 527.16}

 13%|█▎        | 8540/65536 [1:35:31<10:41:31,  1.48it/s]
 13%|█▎        | 8541/65536 [1:35:32<10:39:30,  1.49it/s]
 13%|█▎        | 8542/65536 [1:35:32<10:41:08,  1.48it/s]
 13%|█▎        | 8543/65536 [1:35:33<10:56:07,  1.45it/s]
 13%|█▎        | 8544/65536 [1:35:34<10:42:15,  1.48it/s]
 13%|█▎        | 8545/65536 [1:35:34<10:35:52,  1.49it/s]
 13%|█▎        | 8546/65536 [1:35:35<10:36:05,  1.49it/s]
 13%|█▎        | 8547/65536 [1:35:36<10:25:13,  1.52it/s]
 13%|█▎        | 8548/65536 [1:35:36<10:30:06,  1.51it/s]
 13%|█▎        | 8549/65536 [1:35:37<10:48:02,  1.47it/s]
 13%|█▎        | 8550/65536 [1:35:38<10:34:03,  1.50it/s]
 13%|█▎        | 8551/65536 [1:35:38<10:35:50,  1.49it/s]
 13%|█▎        | 8552/65536 [1:35:39<10:49:14,  1.46it/s]
 13%|█▎        | 8553/65536 [1:35:40<10:43:51,  1.48it/s]
 13%|█▎        | 8554/65536 [1:35:40<10:48:55,  1.46it/s]
 13%|█▎        | 8555/65536 [1:35:41<11:00:46,  1.44it/s]
 13%|█▎        | 8556/65536 [1:35:42<10:45:43,  1.47it/s]
 13%|█▎        | 8557/65536 [1:35:42<10:42:07,  1.48it/s]
 13%|█▎        | 8558/65536 [1:35:43<10:40:15,  1.48it/s]
 13%|█▎        | 8559/65536 [1:35:44<10:35:06,  1.50it/s]
 13%|█▎        | 8560/65536 [1:35:44<10:34:20,  1.50it/s]
                                                         
{'loss': 1.0114, 'learning_rate': 8.848414350434676e-07, 'epoch': 528.4}

 13%|█▎        | 8560/65536 [1:35:44<10:34:20,  1.50it/s]
 13%|█▎        | 8561/65536 [1:35:45<10:28:33,  1.51it/s]
 13%|█▎        | 8562/65536 [1:35:46<10:17:25,  1.54it/s]
 13%|█▎        | 8563/65536 [1:35:46<10:20:18,  1.53it/s]
 13%|█▎        | 8564/65536 [1:35:47<10:19:39,  1.53it/s]
 13%|█▎        | 8565/65536 [1:35:48<10:20:16,  1.53it/s]
 13%|█▎        | 8566/65536 [1:35:48<10:50:08,  1.46it/s]
 13%|█▎        | 8567/65536 [1:35:49<10:50:18,  1.46it/s]
 13%|█▎        | 8568/65536 [1:35:50<10:58:18,  1.44it/s]
 13%|█▎        | 8569/65536 [1:35:51<10:46:13,  1.47it/s]
 13%|█▎        | 8570/65536 [1:35:51<10:53:59,  1.45it/s]
 13%|█▎        | 8571/65536 [1:35:52<10:59:59,  1.44it/s]
 13%|█▎        | 8572/65536 [1:35:53<10:54:42,  1.45it/s]
 13%|█▎        | 8573/65536 [1:35:53<10:40:16,  1.48it/s]
 13%|█▎        | 8574/65536 [1:35:54<10:36:27,  1.49it/s]
 13%|█▎        | 8575/65536 [1:35:55<10:49:30,  1.46it/s]
 13%|█▎        | 8576/65536 [1:35:55<10:40:30,  1.48it/s]
 13%|█▎        | 8577/65536 [1:35:56<10:42:23,  1.48it/s]
 13%|█▎        | 8578/65536 [1:35:57<10:44:18,  1.47it/s]
 13%|█▎        | 8579/65536 [1:35:57<10:54:06,  1.45it/s]
 13%|█▎        | 8580/65536 [1:35:58<10:37:35,  1.49it/s]
                                                         
{'loss': 0.9947, 'learning_rate': 8.845659360842414e-07, 'epoch': 529.63}

 13%|█▎        | 8580/65536 [1:35:58<10:37:35,  1.49it/s]
 13%|█▎        | 8581/65536 [1:35:59<10:32:55,  1.50it/s]
 13%|█▎        | 8582/65536 [1:35:59<10:32:29,  1.50it/s]
 13%|█▎        | 8583/65536 [1:36:00<10:24:03,  1.52it/s]
 13%|█▎        | 8584/65536 [1:36:01<10:30:57,  1.50it/s]
 13%|█▎        | 8585/65536 [1:36:01<10:30:42,  1.50it/s]
 13%|█▎        | 8586/65536 [1:36:02<10:21:37,  1.53it/s]
 13%|█▎        | 8587/65536 [1:36:03<10:33:50,  1.50it/s]
 13%|█▎        | 8588/65536 [1:36:03<10:19:05,  1.53it/s]
 13%|█▎        | 8589/65536 [1:36:04<10:36:38,  1.49it/s]
 13%|█▎        | 8590/65536 [1:36:05<10:30:11,  1.51it/s]
 13%|█▎        | 8591/65536 [1:36:05<10:45:59,  1.47it/s]
 13%|█▎        | 8592/65536 [1:36:06<10:37:27,  1.49it/s]
 13%|█▎        | 8593/65536 [1:36:07<10:26:05,  1.52it/s]
 13%|█▎        | 8594/65536 [1:36:07<10:20:26,  1.53it/s]
 13%|█▎        | 8595/65536 [1:36:08<10:09:04,  1.56it/s]
 13%|█▎        | 8596/65536 [1:36:09<10:32:13,  1.50it/s]
 13%|█▎        | 8597/65536 [1:36:09<10:35:00,  1.49it/s]
 13%|█▎        | 8598/65536 [1:36:10<10:34:57,  1.49it/s]
 13%|█▎        | 8599/65536 [1:36:11<10:42:58,  1.48it/s]
 13%|█▎        | 8600/65536 [1:36:11<10:41:14,  1.48it/s]
                                                         
{'loss': 1.0313, 'learning_rate': 8.842904371250153e-07, 'epoch': 530.86}

 13%|█▎        | 8600/65536 [1:36:11<10:41:14,  1.48it/s]
 13%|█▎        | 8601/65536 [1:36:12<10:28:31,  1.51it/s]
 13%|█▎        | 8602/65536 [1:36:13<10:33:00,  1.50it/s]
 13%|█▎        | 8603/65536 [1:36:13<10:57:05,  1.44it/s]
 13%|█▎        | 8604/65536 [1:36:14<10:58:39,  1.44it/s]
 13%|█▎        | 8605/65536 [1:36:15<10:46:28,  1.47it/s]
 13%|█▎        | 8606/65536 [1:36:15<10:39:37,  1.48it/s]
 13%|█▎        | 8607/65536 [1:36:16<10:44:47,  1.47it/s]
 13%|█▎        | 8608/65536 [1:36:17<10:49:16,  1.46it/s]
 13%|█▎        | 8609/65536 [1:36:17<10:41:34,  1.48it/s]
 13%|█▎        | 8610/65536 [1:36:18<10:39:17,  1.48it/s]
 13%|█▎        | 8611/65536 [1:36:19<10:34:26,  1.50it/s]
 13%|█▎        | 8612/65536 [1:36:19<10:24:56,  1.52it/s]
 13%|█▎        | 8613/65536 [1:36:20<10:18:07,  1.53it/s]
 13%|█▎        | 8614/65536 [1:36:21<10:07:18,  1.56it/s]
 13%|█▎        | 8615/65536 [1:36:21<9:55:06,  1.59it/s] 
 13%|█▎        | 8616/65536 [1:36:22<10:05:38,  1.57it/s]
 13%|█▎        | 8617/65536 [1:36:23<10:27:03,  1.51it/s]
 13%|█▎        | 8618/65536 [1:36:23<10:22:38,  1.52it/s]
 13%|█▎        | 8619/65536 [1:36:24<10:46:28,  1.47it/s]
 13%|█▎        | 8620/65536 [1:36:25<10:37:03,  1.49it/s]
                                                         
{'loss': 1.0343, 'learning_rate': 8.840149381657891e-07, 'epoch': 532.1}

 13%|█▎        | 8620/65536 [1:36:25<10:37:03,  1.49it/s]
 13%|█▎        | 8621/65536 [1:36:25<10:34:58,  1.49it/s]
 13%|█▎        | 8622/65536 [1:36:26<10:24:44,  1.52it/s]
 13%|█▎        | 8623/65536 [1:36:27<10:25:52,  1.52it/s]
 13%|█▎        | 8624/65536 [1:36:27<10:28:51,  1.51it/s]
 13%|█▎        | 8625/65536 [1:36:28<10:24:02,  1.52it/s]
 13%|█▎        | 8626/65536 [1:36:29<10:36:57,  1.49it/s]
 13%|█▎        | 8627/65536 [1:36:29<10:35:54,  1.49it/s]
 13%|█▎        | 8628/65536 [1:36:30<10:30:55,  1.50it/s]
 13%|█▎        | 8629/65536 [1:36:31<10:34:39,  1.49it/s]
 13%|█▎        | 8630/65536 [1:36:31<10:31:43,  1.50it/s]
 13%|█▎        | 8631/65536 [1:36:32<10:28:13,  1.51it/s]
 13%|█▎        | 8632/65536 [1:36:33<10:33:39,  1.50it/s]
 13%|█▎        | 8633/65536 [1:36:33<10:32:46,  1.50it/s]
 13%|█▎        | 8634/65536 [1:36:34<10:49:03,  1.46it/s]
 13%|█▎        | 8635/65536 [1:36:35<10:51:45,  1.46it/s]
 13%|█▎        | 8636/65536 [1:36:35<10:33:36,  1.50it/s]
 13%|█▎        | 8637/65536 [1:36:36<10:26:19,  1.51it/s]
 13%|█▎        | 8638/65536 [1:36:37<10:38:42,  1.48it/s]
 13%|█▎        | 8639/65536 [1:36:37<10:36:04,  1.49it/s]
 13%|█▎        | 8640/65536 [1:36:38<10:45:15,  1.47it/s]
                                                         
{'loss': 1.0191, 'learning_rate': 8.837394392065629e-07, 'epoch': 533.33}

 13%|█▎        | 8640/65536 [1:36:38<10:45:15,  1.47it/s]
 13%|█▎        | 8641/65536 [1:36:39<10:37:37,  1.49it/s]
 13%|█▎        | 8642/65536 [1:36:39<10:40:47,  1.48it/s]
 13%|█▎        | 8643/65536 [1:36:40<10:41:08,  1.48it/s]
 13%|█▎        | 8644/65536 [1:36:41<10:34:42,  1.49it/s]
 13%|█▎        | 8645/65536 [1:36:41<10:31:40,  1.50it/s]
 13%|█▎        | 8646/65536 [1:36:42<10:38:57,  1.48it/s]
 13%|█▎        | 8647/65536 [1:36:43<10:58:24,  1.44it/s]
 13%|█▎        | 8648/65536 [1:36:43<10:48:30,  1.46it/s]
 13%|█▎        | 8649/65536 [1:36:44<10:31:00,  1.50it/s]
 13%|█▎        | 8650/65536 [1:36:45<10:32:47,  1.50it/s]
 13%|█▎        | 8651/65536 [1:36:45<10:47:10,  1.46it/s]
 13%|█▎        | 8652/65536 [1:36:46<10:44:31,  1.47it/s]
 13%|█▎        | 8653/65536 [1:36:47<10:29:46,  1.51it/s]
 13%|█▎        | 8654/65536 [1:36:47<10:35:38,  1.49it/s]
 13%|█▎        | 8655/65536 [1:36:48<10:14:28,  1.54it/s]
 13%|█▎        | 8656/65536 [1:36:49<10:27:34,  1.51it/s]
 13%|█▎        | 8657/65536 [1:36:49<10:24:07,  1.52it/s]
 13%|█▎        | 8658/65536 [1:36:50<10:22:46,  1.52it/s]
 13%|█▎        | 8659/65536 [1:36:51<10:36:03,  1.49it/s]
 13%|█▎        | 8660/65536 [1:36:51<10:50:14,  1.46it/s]
                                                         
{'loss': 0.997, 'learning_rate': 8.834639402473367e-07, 'epoch': 534.57}

 13%|█▎        | 8660/65536 [1:36:51<10:50:14,  1.46it/s]
 13%|█▎        | 8661/65536 [1:36:52<10:54:35,  1.45it/s]
 13%|█▎        | 8662/65536 [1:36:53<10:51:44,  1.45it/s]
 13%|█▎        | 8663/65536 [1:36:54<10:54:32,  1.45it/s]
 13%|█▎        | 8664/65536 [1:36:54<10:40:14,  1.48it/s]
 13%|█▎        | 8665/65536 [1:36:55<10:38:35,  1.48it/s]
 13%|█▎        | 8666/65536 [1:36:55<10:27:06,  1.51it/s]
 13%|█▎        | 8667/65536 [1:36:56<10:20:22,  1.53it/s]
 13%|█▎        | 8668/65536 [1:36:57<10:52:03,  1.45it/s]
 13%|█▎        | 8669/65536 [1:36:58<10:36:32,  1.49it/s]
 13%|█▎        | 8670/65536 [1:36:58<10:37:33,  1.49it/s]
 13%|█▎        | 8671/65536 [1:36:59<10:39:39,  1.48it/s]
 13%|█▎        | 8672/65536 [1:37:00<10:30:35,  1.50it/s]
 13%|█▎        | 8673/65536 [1:37:00<10:56:34,  1.44it/s]
 13%|█▎        | 8674/65536 [1:37:01<10:41:28,  1.48it/s]
 13%|█▎        | 8675/65536 [1:37:02<10:36:36,  1.49it/s]
 13%|█▎        | 8676/65536 [1:37:02<10:38:46,  1.48it/s]
 13%|█▎        | 8677/65536 [1:37:03<10:32:17,  1.50it/s]
 13%|█▎        | 8678/65536 [1:37:04<10:42:58,  1.47it/s]
 13%|█▎        | 8679/65536 [1:37:04<10:37:32,  1.49it/s]
 13%|█▎        | 8680/65536 [1:37:05<10:30:35,  1.50it/s]
                                                         
{'loss': 1.0211, 'learning_rate': 8.831884412881107e-07, 'epoch': 535.8}

 13%|█▎        | 8680/65536 [1:37:05<10:30:35,  1.50it/s]
 13%|█▎        | 8681/65536 [1:37:06<10:28:54,  1.51it/s]
 13%|█▎        | 8682/65536 [1:37:06<10:23:58,  1.52it/s]
 13%|█▎        | 8683/65536 [1:37:07<10:45:33,  1.47it/s]
 13%|█▎        | 8684/65536 [1:37:08<10:57:02,  1.44it/s]
 13%|█▎        | 8685/65536 [1:37:08<10:58:02,  1.44it/s]
 13%|█▎        | 8686/65536 [1:37:09<10:44:53,  1.47it/s]
 13%|█▎        | 8687/65536 [1:37:10<10:46:58,  1.46it/s]
 13%|█▎        | 8688/65536 [1:37:10<10:42:41,  1.47it/s]
 13%|█▎        | 8689/65536 [1:37:11<10:26:39,  1.51it/s]
 13%|█▎        | 8690/65536 [1:37:12<10:17:15,  1.53it/s]
 13%|█▎        | 8691/65536 [1:37:12<10:20:51,  1.53it/s]
 13%|█▎        | 8692/65536 [1:37:13<10:37:44,  1.49it/s]
 13%|█▎        | 8693/65536 [1:37:14<10:18:04,  1.53it/s]
 13%|█▎        | 8694/65536 [1:37:14<10:21:23,  1.52it/s]
 13%|█▎        | 8695/65536 [1:37:15<10:34:41,  1.49it/s]
 13%|█▎        | 8696/65536 [1:37:16<10:41:44,  1.48it/s]
 13%|█▎        | 8697/65536 [1:37:16<10:30:08,  1.50it/s]
 13%|█▎        | 8698/65536 [1:37:17<10:40:38,  1.48it/s]
 13%|█▎        | 8699/65536 [1:37:18<10:30:14,  1.50it/s]
 13%|█▎        | 8700/65536 [1:37:18<10:39:27,  1.48it/s]
                                                         
{'loss': 1.0237, 'learning_rate': 8.829129423288845e-07, 'epoch': 537.04}

 13%|█▎        | 8700/65536 [1:37:18<10:39:27,  1.48it/s]
 13%|█▎        | 8701/65536 [1:37:19<10:38:49,  1.48it/s]
 13%|█▎        | 8702/65536 [1:37:20<10:32:37,  1.50it/s]
 13%|█▎        | 8703/65536 [1:37:20<10:15:03,  1.54it/s]
 13%|█▎        | 8704/65536 [1:37:21<10:10:46,  1.55it/s]
 13%|█▎        | 8705/65536 [1:37:22<10:05:18,  1.56it/s]
 13%|█▎        | 8706/65536 [1:37:22<10:06:08,  1.56it/s]
 13%|█▎        | 8707/65536 [1:37:23<10:15:53,  1.54it/s]
 13%|█▎        | 8708/65536 [1:37:24<10:29:36,  1.50it/s]
 13%|█▎        | 8709/65536 [1:37:24<10:20:27,  1.53it/s]
 13%|█▎        | 8710/65536 [1:37:25<10:43:53,  1.47it/s]
 13%|█▎        | 8711/65536 [1:37:26<10:40:13,  1.48it/s]
 13%|█▎        | 8712/65536 [1:37:26<10:58:02,  1.44it/s]
 13%|█▎        | 8713/65536 [1:37:27<10:46:56,  1.46it/s]
 13%|█▎        | 8714/65536 [1:37:28<10:32:44,  1.50it/s]
 13%|█▎        | 8715/65536 [1:37:28<10:42:04,  1.47it/s]
 13%|█▎        | 8716/65536 [1:37:29<11:03:08,  1.43it/s]
 13%|█▎        | 8717/65536 [1:37:30<10:33:11,  1.50it/s]
 13%|█▎        | 8718/65536 [1:37:30<10:35:08,  1.49it/s]
 13%|█▎        | 8719/65536 [1:37:31<10:37:26,  1.49it/s]
 13%|█▎        | 8720/65536 [1:37:32<10:37:57,  1.48it/s]
                                                         
{'loss': 1.0261, 'learning_rate': 8.826374433696583e-07, 'epoch': 538.27}

 13%|█▎        | 8720/65536 [1:37:32<10:37:57,  1.48it/s]
 13%|█▎        | 8721/65536 [1:37:32<10:28:39,  1.51it/s]
 13%|█▎        | 8722/65536 [1:37:33<10:28:31,  1.51it/s]
 13%|█▎        | 8723/65536 [1:37:34<10:17:15,  1.53it/s]
 13%|█▎        | 8724/65536 [1:37:34<10:33:10,  1.50it/s]
 13%|█▎        | 8725/65536 [1:37:35<11:07:59,  1.42it/s]
 13%|█▎        | 8726/65536 [1:37:36<10:42:19,  1.47it/s]
 13%|█▎        | 8727/65536 [1:37:36<10:41:05,  1.48it/s]
 13%|█▎        | 8728/65536 [1:37:37<10:44:24,  1.47it/s]
 13%|█▎        | 8729/65536 [1:37:38<10:23:41,  1.52it/s]
 13%|█▎        | 8730/65536 [1:37:38<10:25:24,  1.51it/s]
 13%|█▎        | 8731/65536 [1:37:39<10:31:15,  1.50it/s]
 13%|█▎        | 8732/65536 [1:37:40<10:30:07,  1.50it/s]
 13%|█▎        | 8733/65536 [1:37:40<10:43:47,  1.47it/s]
 13%|█▎        | 8734/65536 [1:37:41<10:49:20,  1.46it/s]
 13%|█▎        | 8735/65536 [1:37:42<10:36:11,  1.49it/s]
 13%|█▎        | 8736/65536 [1:37:42<10:20:53,  1.52it/s]
 13%|█▎        | 8737/65536 [1:37:43<10:23:42,  1.52it/s]
 13%|█▎        | 8738/65536 [1:37:44<10:31:28,  1.50it/s]
 13%|█▎        | 8739/65536 [1:37:44<10:29:04,  1.50it/s]
 13%|█▎        | 8740/65536 [1:37:45<10:45:30,  1.47it/s]
                                                         
{'loss': 1.0196, 'learning_rate': 8.823619444104322e-07, 'epoch': 539.51}

 13%|█▎        | 8740/65536 [1:37:45<10:45:30,  1.47it/s]
 13%|█▎        | 8741/65536 [1:37:46<10:39:24,  1.48it/s]
 13%|█▎        | 8742/65536 [1:37:47<10:53:19,  1.45it/s]
 13%|█▎        | 8743/65536 [1:37:47<10:51:06,  1.45it/s]
 13%|█▎        | 8744/65536 [1:37:48<10:42:51,  1.47it/s]
 13%|█▎        | 8745/65536 [1:37:49<10:35:59,  1.49it/s]
 13%|█▎        | 8746/65536 [1:37:49<10:32:50,  1.50it/s]
 13%|█▎        | 8747/65536 [1:37:50<10:22:09,  1.52it/s]
 13%|█▎        | 8748/65536 [1:37:50<9:57:30,  1.58it/s] 
 13%|█▎        | 8749/65536 [1:37:51<10:19:39,  1.53it/s]
 13%|█▎        | 8750/65536 [1:37:52<10:24:45,  1.51it/s]
 13%|█▎        | 8751/65536 [1:37:52<10:30:39,  1.50it/s]
 13%|█▎        | 8752/65536 [1:37:53<10:17:38,  1.53it/s]
 13%|█▎        | 8753/65536 [1:37:54<10:37:55,  1.48it/s]
 13%|█▎        | 8754/65536 [1:37:54<10:48:12,  1.46it/s]
 13%|█▎        | 8755/65536 [1:37:55<10:41:30,  1.48it/s]
 13%|█▎        | 8756/65536 [1:37:56<10:17:04,  1.53it/s]
 13%|█▎        | 8757/65536 [1:37:56<10:15:40,  1.54it/s]
 13%|█▎        | 8758/65536 [1:37:57<10:25:14,  1.51it/s]
 13%|█▎        | 8759/65536 [1:37:58<10:32:43,  1.50it/s]
 13%|█▎        | 8760/65536 [1:37:58<10:27:58,  1.51it/s]
                                                         
{'loss': 1.037, 'learning_rate': 8.82086445451206e-07, 'epoch': 540.74}

 13%|█▎        | 8760/65536 [1:37:58<10:27:58,  1.51it/s]
 13%|█▎        | 8761/65536 [1:37:59<10:28:47,  1.50it/s]
 13%|█▎        | 8762/65536 [1:38:00<10:24:44,  1.51it/s]
 13%|█▎        | 8763/65536 [1:38:00<10:43:11,  1.47it/s]
 13%|█▎        | 8764/65536 [1:38:01<10:48:02,  1.46it/s]
 13%|█▎        | 8765/65536 [1:38:02<11:00:46,  1.43it/s]
 13%|█▎        | 8766/65536 [1:38:03<11:03:54,  1.43it/s]
 13%|█▎        | 8767/65536 [1:38:03<10:57:46,  1.44it/s]
 13%|█▎        | 8768/65536 [1:38:04<10:44:50,  1.47it/s]
 13%|█▎        | 8769/65536 [1:38:05<10:30:11,  1.50it/s]
 13%|█▎        | 8770/65536 [1:38:05<10:43:24,  1.47it/s]
 13%|█▎        | 8771/65536 [1:38:06<10:31:51,  1.50it/s]
 13%|█▎        | 8772/65536 [1:38:07<10:24:44,  1.51it/s]
 13%|█▎        | 8773/65536 [1:38:07<10:24:14,  1.52it/s]
 13%|█▎        | 8774/65536 [1:38:08<10:21:02,  1.52it/s]
 13%|█▎        | 8775/65536 [1:38:08<10:18:52,  1.53it/s]
 13%|█▎        | 8776/65536 [1:38:09<10:17:05,  1.53it/s]
 13%|█▎        | 8777/65536 [1:38:10<10:10:39,  1.55it/s]
 13%|█▎        | 8778/65536 [1:38:11<10:40:21,  1.48it/s]
 13%|█▎        | 8779/65536 [1:38:11<10:36:59,  1.49it/s]
 13%|█▎        | 8780/65536 [1:38:12<10:41:55,  1.47it/s]
                                                         
{'loss': 1.0088, 'learning_rate': 8.818109464919799e-07, 'epoch': 541.98}

 13%|█▎        | 8780/65536 [1:38:12<10:41:55,  1.47it/s]
 13%|█▎        | 8781/65536 [1:38:13<10:53:41,  1.45it/s]
 13%|█▎        | 8782/65536 [1:38:13<10:53:55,  1.45it/s]
 13%|█▎        | 8783/65536 [1:38:14<10:46:35,  1.46it/s]
 13%|█▎        | 8784/65536 [1:38:15<10:57:09,  1.44it/s]
 13%|█▎        | 8785/65536 [1:38:15<10:31:31,  1.50it/s]
 13%|█▎        | 8786/65536 [1:38:16<10:15:01,  1.54it/s]
 13%|█▎        | 8787/65536 [1:38:17<10:12:06,  1.55it/s]
 13%|█▎        | 8788/65536 [1:38:17<10:24:44,  1.51it/s]
 13%|█▎        | 8789/65536 [1:38:18<10:19:50,  1.53it/s]
 13%|█▎        | 8790/65536 [1:38:19<10:16:12,  1.53it/s]
 13%|█▎        | 8791/65536 [1:38:19<10:27:44,  1.51it/s]
 13%|█▎        | 8792/65536 [1:38:20<10:27:01,  1.51it/s]
 13%|█▎        | 8793/65536 [1:38:21<10:33:15,  1.49it/s]
 13%|█▎        | 8794/65536 [1:38:21<10:26:39,  1.51it/s]
 13%|█▎        | 8795/65536 [1:38:22<10:39:58,  1.48it/s]
 13%|█▎        | 8796/65536 [1:38:23<10:48:40,  1.46it/s]
 13%|█▎        | 8797/65536 [1:38:23<10:48:04,  1.46it/s]
 13%|█▎        | 8798/65536 [1:38:24<10:55:42,  1.44it/s]
 13%|█▎        | 8799/65536 [1:38:25<10:46:25,  1.46it/s]
 13%|█▎        | 8800/65536 [1:38:25<10:33:27,  1.49it/s]
                                                         
{'loss': 1.0296, 'learning_rate': 8.815354475327538e-07, 'epoch': 543.21}

 13%|█▎        | 8800/65536 [1:38:25<10:33:27,  1.49it/s]
 13%|█▎        | 8801/65536 [1:38:26<11:08:25,  1.41it/s]
 13%|█▎        | 8802/65536 [1:38:27<10:56:32,  1.44it/s]
 13%|█▎        | 8803/65536 [1:38:27<10:39:28,  1.48it/s]
 13%|█▎        | 8804/65536 [1:38:28<10:40:21,  1.48it/s]
 13%|█▎        | 8805/65536 [1:38:29<10:55:47,  1.44it/s]
 13%|█▎        | 8806/65536 [1:38:29<10:48:20,  1.46it/s]
 13%|█▎        | 8807/65536 [1:38:30<10:44:18,  1.47it/s]
 13%|█▎        | 8808/65536 [1:38:31<10:38:15,  1.48it/s]
 13%|█▎        | 8809/65536 [1:38:31<10:31:33,  1.50it/s]
 13%|█▎        | 8810/65536 [1:38:32<10:35:30,  1.49it/s]
 13%|█▎        | 8811/65536 [1:38:33<10:27:37,  1.51it/s]
 13%|█▎        | 8812/65536 [1:38:33<10:17:19,  1.53it/s]
 13%|█▎        | 8813/65536 [1:38:34<10:46:51,  1.46it/s]
 13%|█▎        | 8814/65536 [1:38:35<10:50:01,  1.45it/s]
 13%|█▎        | 8815/65536 [1:38:36<10:52:38,  1.45it/s]
 13%|█▎        | 8816/65536 [1:38:36<10:33:29,  1.49it/s]
 13%|█▎        | 8817/65536 [1:38:37<10:21:20,  1.52it/s]
 13%|█▎        | 8818/65536 [1:38:37<10:22:28,  1.52it/s]
 13%|█▎        | 8819/65536 [1:38:38<10:20:58,  1.52it/s]
 13%|█▎        | 8820/65536 [1:38:39<10:44:47,  1.47it/s]
                                                         
{'loss': 0.9991, 'learning_rate': 8.812599485735276e-07, 'epoch': 544.44}

 13%|█▎        | 8820/65536 [1:38:39<10:44:47,  1.47it/s]
 13%|█▎        | 8821/65536 [1:38:40<10:57:53,  1.44it/s]
 13%|█▎        | 8822/65536 [1:38:40<10:44:06,  1.47it/s]
 13%|█▎        | 8823/65536 [1:38:41<10:40:39,  1.48it/s]
 13%|█▎        | 8824/65536 [1:38:42<10:37:52,  1.48it/s]
 13%|█▎        | 8825/65536 [1:38:42<10:32:26,  1.49it/s]
 13%|█▎        | 8826/65536 [1:38:43<10:10:18,  1.55it/s]
 13%|█▎        | 8827/65536 [1:38:44<10:21:49,  1.52it/s]
 13%|█▎        | 8828/65536 [1:38:44<10:22:40,  1.52it/s]
 13%|█▎        | 8829/65536 [1:38:45<10:34:23,  1.49it/s]
 13%|█▎        | 8830/65536 [1:38:46<10:35:25,  1.49it/s]
 13%|█▎        | 8831/65536 [1:38:46<10:44:27,  1.47it/s]
 13%|█▎        | 8832/65536 [1:38:47<10:31:26,  1.50it/s]
 13%|█▎        | 8833/65536 [1:38:48<10:34:25,  1.49it/s]
 13%|█▎        | 8834/65536 [1:38:48<10:49:59,  1.45it/s]
 13%|█▎        | 8835/65536 [1:38:49<10:38:00,  1.48it/s]
 13%|█▎        | 8836/65536 [1:38:50<10:32:47,  1.49it/s]
 13%|█▎        | 8837/65536 [1:38:50<10:36:25,  1.48it/s]
 13%|█▎        | 8838/65536 [1:38:51<10:32:31,  1.49it/s]
 13%|█▎        | 8839/65536 [1:38:52<10:19:02,  1.53it/s]
 13%|█▎        | 8840/65536 [1:38:52<10:28:42,  1.50it/s]
                                                         
{'loss': 0.9906, 'learning_rate': 8.809844496143015e-07, 'epoch': 545.68}

 13%|█▎        | 8840/65536 [1:38:52<10:28:42,  1.50it/s]
 13%|█▎        | 8841/65536 [1:38:53<10:33:45,  1.49it/s]
 13%|█▎        | 8842/65536 [1:38:54<10:32:26,  1.49it/s]
 13%|█▎        | 8843/65536 [1:38:54<10:40:20,  1.48it/s]
 13%|█▎        | 8844/65536 [1:38:55<10:27:39,  1.51it/s]
 13%|█▎        | 8845/65536 [1:38:56<10:35:08,  1.49it/s]
 13%|█▎        | 8846/65536 [1:38:56<10:46:39,  1.46it/s]
 13%|█▎        | 8847/65536 [1:38:57<10:41:08,  1.47it/s]
 14%|█▎        | 8848/65536 [1:38:58<10:42:58,  1.47it/s]
 14%|█▎        | 8849/65536 [1:38:58<10:39:09,  1.48it/s]
 14%|█▎        | 8850/65536 [1:38:59<10:33:45,  1.49it/s]
 14%|█▎        | 8851/65536 [1:39:00<10:29:53,  1.50it/s]
 14%|█▎        | 8852/65536 [1:39:00<10:28:44,  1.50it/s]
 14%|█▎        | 8853/65536 [1:39:01<10:14:57,  1.54it/s]
 14%|█▎        | 8854/65536 [1:39:02<10:17:48,  1.53it/s]
 14%|█▎        | 8855/65536 [1:39:02<10:15:38,  1.53it/s]
 14%|█▎        | 8856/65536 [1:39:03<10:31:56,  1.49it/s]
 14%|█▎        | 8857/65536 [1:39:04<10:25:49,  1.51it/s]
 14%|█▎        | 8858/65536 [1:39:04<10:24:35,  1.51it/s]
 14%|█▎        | 8859/65536 [1:39:05<10:43:18,  1.47it/s]
 14%|█▎        | 8860/65536 [1:39:06<10:55:30,  1.44it/s]
                                                         
{'loss': 1.0111, 'learning_rate': 8.807089506550753e-07, 'epoch': 546.91}

 14%|█▎        | 8860/65536 [1:39:06<10:55:30,  1.44it/s]
 14%|█▎        | 8861/65536 [1:39:06<11:03:56,  1.42it/s]
 14%|█▎        | 8862/65536 [1:39:07<11:01:15,  1.43it/s]
 14%|█▎        | 8863/65536 [1:39:08<10:53:00,  1.45it/s]
 14%|█▎        | 8864/65536 [1:39:08<10:38:18,  1.48it/s]
 14%|█▎        | 8865/65536 [1:39:09<10:33:12,  1.49it/s]
 14%|█▎        | 8866/65536 [1:39:10<10:34:08,  1.49it/s]
 14%|█▎        | 8867/65536 [1:39:10<10:38:59,  1.48it/s]
 14%|█▎        | 8868/65536 [1:39:11<10:10:20,  1.55it/s]
 14%|█▎        | 8869/65536 [1:39:12<10:25:26,  1.51it/s]
 14%|█▎        | 8870/65536 [1:39:12<10:31:21,  1.50it/s]
 14%|█▎        | 8871/65536 [1:39:13<10:47:13,  1.46it/s]
 14%|█▎        | 8872/65536 [1:39:14<10:31:58,  1.49it/s]
 14%|█▎        | 8873/65536 [1:39:14<10:18:54,  1.53it/s]
 14%|█▎        | 8874/65536 [1:39:15<10:35:26,  1.49it/s]
 14%|█▎        | 8875/65536 [1:39:16<10:27:37,  1.50it/s]
 14%|█▎        | 8876/65536 [1:39:16<10:34:56,  1.49it/s]
 14%|█▎        | 8877/65536 [1:39:17<10:41:19,  1.47it/s]
 14%|█▎        | 8878/65536 [1:39:18<10:51:19,  1.45it/s]
 14%|█▎        | 8879/65536 [1:39:19<11:04:10,  1.42it/s]
 14%|█▎        | 8880/65536 [1:39:19<11:06:14,  1.42it/s]
                                                         
{'loss': 0.9988, 'learning_rate': 8.804334516958492e-07, 'epoch': 548.15}

 14%|█▎        | 8880/65536 [1:39:19<11:06:14,  1.42it/s]
 14%|█▎        | 8881/65536 [1:39:20<10:50:58,  1.45it/s]
 14%|█▎        | 8882/65536 [1:39:21<10:40:38,  1.47it/s]
 14%|█▎        | 8883/65536 [1:39:21<10:44:59,  1.46it/s]
 14%|█▎        | 8884/65536 [1:39:22<10:28:40,  1.50it/s]
 14%|█▎        | 8885/65536 [1:39:23<10:29:46,  1.50it/s]
 14%|█▎        | 8886/65536 [1:39:23<10:29:37,  1.50it/s]
 14%|█▎        | 8887/65536 [1:39:24<10:24:38,  1.51it/s]
 14%|█▎        | 8888/65536 [1:39:25<10:22:24,  1.52it/s]
 14%|█▎        | 8889/65536 [1:39:25<10:18:11,  1.53it/s]
 14%|█▎        | 8890/65536 [1:39:26<10:24:37,  1.51it/s]
 14%|█▎        | 8891/65536 [1:39:27<10:24:58,  1.51it/s]
 14%|█▎        | 8892/65536 [1:39:27<10:20:26,  1.52it/s]
 14%|█▎        | 8893/65536 [1:39:28<10:19:10,  1.52it/s]
 14%|█▎        | 8894/65536 [1:39:29<10:30:03,  1.50it/s]
 14%|█▎        | 8895/65536 [1:39:29<10:22:43,  1.52it/s]
 14%|█▎        | 8896/65536 [1:39:30<10:25:32,  1.51it/s]
 14%|█▎        | 8897/65536 [1:39:31<10:26:22,  1.51it/s]
 14%|█▎        | 8898/65536 [1:39:31<10:35:25,  1.49it/s]
 14%|█▎        | 8899/65536 [1:39:32<10:34:33,  1.49it/s]
 14%|█▎        | 8900/65536 [1:39:32<10:09:55,  1.55it/s]
                                                         
{'loss': 1.0259, 'learning_rate': 8.80157952736623e-07, 'epoch': 549.38}

 14%|█▎        | 8900/65536 [1:39:32<10:09:55,  1.55it/s]
 14%|█▎        | 8901/65536 [1:39:33<10:12:04,  1.54it/s]
 14%|█▎        | 8902/65536 [1:39:34<10:06:24,  1.56it/s]
 14%|█▎        | 8903/65536 [1:39:34<10:14:32,  1.54it/s]
 14%|█▎        | 8904/65536 [1:39:35<10:18:58,  1.52it/s]
 14%|█▎        | 8905/65536 [1:39:36<10:22:44,  1.52it/s]
 14%|█▎        | 8906/65536 [1:39:36<10:16:32,  1.53it/s]
 14%|█▎        | 8907/65536 [1:39:37<10:45:36,  1.46it/s]
 14%|█▎        | 8908/65536 [1:39:38<10:34:35,  1.49it/s]
 14%|█▎        | 8909/65536 [1:39:38<10:33:19,  1.49it/s]
 14%|█▎        | 8910/65536 [1:39:39<10:46:59,  1.46it/s]
 14%|█▎        | 8911/65536 [1:39:40<10:53:28,  1.44it/s]
 14%|█▎        | 8912/65536 [1:39:41<10:30:42,  1.50it/s]
 14%|█▎        | 8913/65536 [1:39:41<10:28:18,  1.50it/s]
 14%|█▎        | 8914/65536 [1:39:42<10:32:15,  1.49it/s]
 14%|█▎        | 8915/65536 [1:39:43<10:24:48,  1.51it/s]
 14%|█▎        | 8916/65536 [1:39:43<10:32:22,  1.49it/s]
 14%|█▎        | 8917/65536 [1:39:44<10:21:32,  1.52it/s]
 14%|█▎        | 8918/65536 [1:39:44<10:25:04,  1.51it/s]
 14%|█▎        | 8919/65536 [1:39:45<10:40:18,  1.47it/s]
 14%|█▎        | 8920/65536 [1:39:46<10:53:48,  1.44it/s]
                                                         
{'loss': 1.0179, 'learning_rate': 8.798824537773968e-07, 'epoch': 550.62}

 14%|█▎        | 8920/65536 [1:39:46<10:53:48,  1.44it/s]
 14%|█▎        | 8921/65536 [1:39:47<10:49:41,  1.45it/s]
 14%|█▎        | 8922/65536 [1:39:47<10:35:20,  1.49it/s]
 14%|█▎        | 8923/65536 [1:39:48<10:44:16,  1.46it/s]
 14%|█▎        | 8924/65536 [1:39:49<10:39:59,  1.47it/s]
 14%|█▎        | 8925/65536 [1:39:49<10:29:08,  1.50it/s]
 14%|█▎        | 8926/65536 [1:39:50<10:25:46,  1.51it/s]
 14%|█▎        | 8927/65536 [1:39:51<10:33:52,  1.49it/s]
 14%|█▎        | 8928/65536 [1:39:51<10:17:33,  1.53it/s]
 14%|█▎        | 8929/65536 [1:39:52<10:14:39,  1.53it/s]
 14%|█▎        | 8930/65536 [1:39:53<10:33:09,  1.49it/s]
 14%|█▎        | 8931/65536 [1:39:53<10:32:41,  1.49it/s]
 14%|█▎        | 8932/65536 [1:39:54<10:45:42,  1.46it/s]
 14%|█▎        | 8933/65536 [1:39:55<10:30:53,  1.50it/s]
 14%|█▎        | 8934/65536 [1:39:55<10:49:37,  1.45it/s]
 14%|█▎        | 8935/65536 [1:39:56<10:30:25,  1.50it/s]
 14%|█▎        | 8936/65536 [1:39:57<10:27:15,  1.50it/s]
 14%|█▎        | 8937/65536 [1:39:57<10:27:47,  1.50it/s]
 14%|█▎        | 8938/65536 [1:39:58<10:19:54,  1.52it/s]
 14%|█▎        | 8939/65536 [1:39:59<10:15:15,  1.53it/s]
 14%|█▎        | 8940/65536 [1:39:59<10:17:04,  1.53it/s]
                                                         
{'loss': 1.0089, 'learning_rate': 8.796069548181707e-07, 'epoch': 551.85}

 14%|█▎        | 8940/65536 [1:39:59<10:17:04,  1.53it/s]
 14%|█▎        | 8941/65536 [1:40:00<10:36:00,  1.48it/s]
 14%|█▎        | 8942/65536 [1:40:01<10:35:48,  1.48it/s]
 14%|█▎        | 8943/65536 [1:40:01<10:52:14,  1.45it/s]
 14%|█▎        | 8944/65536 [1:40:02<11:03:48,  1.42it/s]
 14%|█▎        | 8945/65536 [1:40:03<10:51:43,  1.45it/s]
 14%|█▎        | 8946/65536 [1:40:03<10:36:36,  1.48it/s]
 14%|█▎        | 8947/65536 [1:40:04<10:26:50,  1.50it/s]
 14%|█▎        | 8948/65536 [1:40:05<10:33:54,  1.49it/s]
 14%|█▎        | 8949/65536 [1:40:05<10:39:30,  1.47it/s]
 14%|█▎        | 8950/65536 [1:40:06<10:29:49,  1.50it/s]
 14%|█▎        | 8951/65536 [1:40:07<10:45:42,  1.46it/s]
 14%|█▎        | 8952/65536 [1:40:07<10:48:47,  1.45it/s]
 14%|█▎        | 8953/65536 [1:40:08<10:48:59,  1.45it/s]
 14%|█▎        | 8954/65536 [1:40:09<10:41:39,  1.47it/s]
 14%|█▎        | 8955/65536 [1:40:10<10:47:57,  1.46it/s]
 14%|█▎        | 8956/65536 [1:40:10<10:39:19,  1.47it/s]
 14%|█▎        | 8957/65536 [1:40:11<10:27:38,  1.50it/s]
 14%|█▎        | 8958/65536 [1:40:11<10:16:19,  1.53it/s]
 14%|█▎        | 8959/65536 [1:40:12<10:07:30,  1.55it/s]
 14%|█▎        | 8960/65536 [1:40:13<10:23:26,  1.51it/s]
                                                         
{'loss': 0.9922, 'learning_rate': 8.793314558589445e-07, 'epoch': 553.09}

 14%|█▎        | 8960/65536 [1:40:13<10:23:26,  1.51it/s]
 14%|█▎        | 8961/65536 [1:40:13<10:35:25,  1.48it/s]
 14%|█▎        | 8962/65536 [1:40:14<10:13:12,  1.54it/s]
 14%|█▎        | 8963/65536 [1:40:15<10:18:56,  1.52it/s]
 14%|█▎        | 8964/65536 [1:40:15<10:24:21,  1.51it/s]
 14%|█▎        | 8965/65536 [1:40:16<10:18:13,  1.53it/s]
 14%|█▎        | 8966/65536 [1:40:17<10:22:05,  1.52it/s]
 14%|█▎        | 8967/65536 [1:40:17<10:13:00,  1.54it/s]
 14%|█▎        | 8968/65536 [1:40:18<10:17:34,  1.53it/s]
 14%|█▎        | 8969/65536 [1:40:19<10:06:29,  1.55it/s]
 14%|█▎        | 8970/65536 [1:40:19<10:20:01,  1.52it/s]
 14%|█▎        | 8971/65536 [1:40:20<10:16:09,  1.53it/s]
 14%|█▎        | 8972/65536 [1:40:21<10:18:32,  1.52it/s]
 14%|█▎        | 8973/65536 [1:40:21<10:32:27,  1.49it/s]
 14%|█▎        | 8974/65536 [1:40:22<10:46:22,  1.46it/s]
 14%|█▎        | 8975/65536 [1:40:23<10:41:24,  1.47it/s]
 14%|█▎        | 8976/65536 [1:40:23<10:45:03,  1.46it/s]
 14%|█▎        | 8977/65536 [1:40:24<10:50:56,  1.45it/s]
 14%|█▎        | 8978/65536 [1:40:25<10:59:41,  1.43it/s]
 14%|█▎        | 8979/65536 [1:40:26<10:53:51,  1.44it/s]
 14%|█▎        | 8980/65536 [1:40:26<10:32:07,  1.49it/s]
                                                         
{'loss': 1.0285, 'learning_rate': 8.790559568997184e-07, 'epoch': 554.32}

 14%|█▎        | 8980/65536 [1:40:26<10:32:07,  1.49it/s]
 14%|█▎        | 8981/65536 [1:40:27<10:23:01,  1.51it/s]
 14%|█▎        | 8982/65536 [1:40:27<10:31:25,  1.49it/s]
 14%|█▎        | 8983/65536 [1:40:28<10:32:52,  1.49it/s]
 14%|█▎        | 8984/65536 [1:40:29<10:20:30,  1.52it/s]
 14%|█▎        | 8985/65536 [1:40:29<10:01:50,  1.57it/s]
 14%|█▎        | 8986/65536 [1:40:30<10:00:48,  1.57it/s]
 14%|█▎        | 8987/65536 [1:40:31<10:16:57,  1.53it/s]
 14%|█▎        | 8988/65536 [1:40:31<10:16:22,  1.53it/s]
 14%|█▎        | 8989/65536 [1:40:32<10:14:10,  1.53it/s]
 14%|█▎        | 8990/65536 [1:40:33<10:21:16,  1.52it/s]
 14%|█▎        | 8991/65536 [1:40:33<10:28:29,  1.50it/s]
 14%|█▎        | 8992/65536 [1:40:34<10:31:21,  1.49it/s]
 14%|█▎        | 8993/65536 [1:40:35<10:52:23,  1.44it/s]
 14%|█▎        | 8994/65536 [1:40:35<10:41:53,  1.47it/s]
 14%|█▎        | 8995/65536 [1:40:36<10:38:45,  1.48it/s]
 14%|█▎        | 8996/65536 [1:40:37<10:32:34,  1.49it/s]
 14%|█▎        | 8997/65536 [1:40:37<10:18:56,  1.52it/s]
 14%|█▎        | 8998/65536 [1:40:38<10:16:04,  1.53it/s]
 14%|█▎        | 8999/65536 [1:40:39<10:11:54,  1.54it/s]
 14%|█▎        | 9000/65536 [1:40:39<10:20:10,  1.52it/s]
                                                         
{'loss': 1.0303, 'learning_rate': 8.787804579404922e-07, 'epoch': 555.56}

 14%|█▎        | 9000/65536 [1:40:39<10:20:10,  1.52it/s]
 14%|█▎        | 9001/65536 [1:40:40<10:26:12,  1.50it/s]
 14%|█▎        | 9002/65536 [1:40:41<10:35:37,  1.48it/s]
 14%|█▎        | 9003/65536 [1:40:41<10:53:14,  1.44it/s]
 14%|█▎        | 9004/65536 [1:40:42<10:40:54,  1.47it/s]
 14%|█▎        | 9005/65536 [1:40:43<10:24:08,  1.51it/s]
 14%|█▎        | 9006/65536 [1:40:43<10:18:29,  1.52it/s]
 14%|█▎        | 9007/65536 [1:40:44<10:24:29,  1.51it/s]
 14%|█▎        | 9008/65536 [1:40:45<10:31:51,  1.49it/s]
 14%|█▎        | 9009/65536 [1:40:45<10:32:27,  1.49it/s]
 14%|█▎        | 9010/65536 [1:40:46<10:37:21,  1.48it/s]
 14%|█▎        | 9011/65536 [1:40:47<10:45:19,  1.46it/s]
 14%|█▍        | 9012/65536 [1:40:47<10:41:12,  1.47it/s]
 14%|█▍        | 9013/65536 [1:40:48<10:44:55,  1.46it/s]
 14%|█▍        | 9014/65536 [1:40:49<10:31:05,  1.49it/s]
 14%|█▍        | 9015/65536 [1:40:50<10:40:42,  1.47it/s]
 14%|█▍        | 9016/65536 [1:40:50<10:35:03,  1.48it/s]
 14%|█▍        | 9017/65536 [1:40:51<10:29:48,  1.50it/s]
 14%|█▍        | 9018/65536 [1:40:52<10:35:55,  1.48it/s]
 14%|█▍        | 9019/65536 [1:40:52<10:47:30,  1.45it/s]
 14%|█▍        | 9020/65536 [1:40:53<10:21:34,  1.52it/s]
                                                         
{'loss': 1.0037, 'learning_rate': 8.78504958981266e-07, 'epoch': 556.79}

 14%|█▍        | 9020/65536 [1:40:53<10:21:34,  1.52it/s]
 14%|█▍        | 9021/65536 [1:40:53<10:20:42,  1.52it/s]
 14%|█▍        | 9022/65536 [1:40:54<10:21:24,  1.52it/s]
 14%|█▍        | 9023/65536 [1:40:55<10:15:46,  1.53it/s]
 14%|█▍        | 9024/65536 [1:40:55<10:21:46,  1.51it/s]
 14%|█▍        | 9025/65536 [1:40:56<10:13:31,  1.54it/s]
 14%|█▍        | 9026/65536 [1:40:57<10:24:31,  1.51it/s]
 14%|█▍        | 9027/65536 [1:40:57<10:17:46,  1.52it/s]
 14%|█▍        | 9028/65536 [1:40:58<10:25:07,  1.51it/s]
 14%|█▍        | 9029/65536 [1:40:59<10:39:36,  1.47it/s]
 14%|█▍        | 9030/65536 [1:41:00<10:45:11,  1.46it/s]
 14%|█▍        | 9031/65536 [1:41:00<10:50:11,  1.45it/s]
 14%|█▍        | 9032/65536 [1:41:01<10:28:58,  1.50it/s]
 14%|█▍        | 9033/65536 [1:41:01<10:25:35,  1.51it/s]
 14%|█▍        | 9034/65536 [1:41:02<10:13:05,  1.54it/s]
 14%|█▍        | 9035/65536 [1:41:03<10:10:29,  1.54it/s]
 14%|█▍        | 9036/65536 [1:41:03<9:58:53,  1.57it/s] 
 14%|█▍        | 9037/65536 [1:41:04<10:25:47,  1.50it/s]
 14%|█▍        | 9038/65536 [1:41:05<10:28:39,  1.50it/s]
 14%|█▍        | 9039/65536 [1:41:05<10:22:29,  1.51it/s]
 14%|█▍        | 9040/65536 [1:41:06<10:34:55,  1.48it/s]
                                                         
{'loss': 1.0281, 'learning_rate': 8.782294600220397e-07, 'epoch': 558.02}

 14%|█▍        | 9040/65536 [1:41:06<10:34:55,  1.48it/s]
 14%|█▍        | 9041/65536 [1:41:07<10:41:44,  1.47it/s]
 14%|█▍        | 9042/65536 [1:41:08<10:51:31,  1.45it/s]
 14%|█▍        | 9043/65536 [1:41:08<10:46:02,  1.46it/s]
 14%|█▍        | 9044/65536 [1:41:09<10:57:41,  1.43it/s]
 14%|█▍        | 9045/65536 [1:41:10<10:42:13,  1.47it/s]
 14%|█▍        | 9046/65536 [1:41:10<10:31:24,  1.49it/s]
 14%|█▍        | 9047/65536 [1:41:11<10:28:25,  1.50it/s]
 14%|█▍        | 9048/65536 [1:41:12<10:28:46,  1.50it/s]
 14%|█▍        | 9049/65536 [1:41:12<10:25:32,  1.51it/s]
 14%|█▍        | 9050/65536 [1:41:13<10:02:05,  1.56it/s]
 14%|█▍        | 9051/65536 [1:41:13<9:53:57,  1.58it/s] 
 14%|█▍        | 9052/65536 [1:41:14<10:07:18,  1.55it/s]
 14%|█▍        | 9053/65536 [1:41:15<10:20:36,  1.52it/s]
 14%|█▍        | 9054/65536 [1:41:15<10:41:22,  1.47it/s]
 14%|█▍        | 9055/65536 [1:41:16<10:31:17,  1.49it/s]
 14%|█▍        | 9056/65536 [1:41:17<10:31:45,  1.49it/s]
 14%|█▍        | 9057/65536 [1:41:18<10:42:53,  1.46it/s]
 14%|█▍        | 9058/65536 [1:41:18<10:27:00,  1.50it/s]
 14%|█▍        | 9059/65536 [1:41:19<10:20:07,  1.52it/s]
 14%|█▍        | 9060/65536 [1:41:19<10:18:11,  1.52it/s]
                                                         
{'loss': 1.0133, 'learning_rate': 8.779539610628137e-07, 'epoch': 559.26}

 14%|█▍        | 9060/65536 [1:41:19<10:18:11,  1.52it/s]
 14%|█▍        | 9061/65536 [1:41:20<10:13:15,  1.53it/s]
 14%|█▍        | 9062/65536 [1:41:21<10:20:02,  1.52it/s]
 14%|█▍        | 9063/65536 [1:41:21<10:36:40,  1.48it/s]
 14%|█▍        | 9064/65536 [1:41:22<10:18:01,  1.52it/s]
 14%|█▍        | 9065/65536 [1:41:23<10:28:45,  1.50it/s]
 14%|█▍        | 9066/65536 [1:41:23<10:38:33,  1.47it/s]
 14%|█▍        | 9067/65536 [1:41:24<10:34:08,  1.48it/s]
 14%|█▍        | 9068/65536 [1:41:25<10:46:08,  1.46it/s]
 14%|█▍        | 9069/65536 [1:41:26<10:47:08,  1.45it/s]
 14%|█▍        | 9070/65536 [1:41:26<10:42:40,  1.46it/s]
 14%|█▍        | 9071/65536 [1:41:27<10:37:02,  1.48it/s]
 14%|█▍        | 9072/65536 [1:41:27<10:14:32,  1.53it/s]
 14%|█▍        | 9073/65536 [1:41:28<10:33:58,  1.48it/s]
 14%|█▍        | 9074/65536 [1:41:29<10:22:12,  1.51it/s]
 14%|█▍        | 9075/65536 [1:41:30<10:32:22,  1.49it/s]
 14%|█▍        | 9076/65536 [1:41:30<10:23:22,  1.51it/s]
 14%|█▍        | 9077/65536 [1:41:31<10:28:14,  1.50it/s]
 14%|█▍        | 9078/65536 [1:41:32<10:22:59,  1.51it/s]
 14%|█▍        | 9079/65536 [1:41:32<10:12:56,  1.54it/s]
 14%|█▍        | 9080/65536 [1:41:33<10:29:36,  1.49it/s]
                                                         
{'loss': 1.0045, 'learning_rate': 8.776784621035876e-07, 'epoch': 560.49}

 14%|█▍        | 9080/65536 [1:41:33<10:29:36,  1.49it/s]
 14%|█▍        | 9081/65536 [1:41:34<10:41:38,  1.47it/s]
 14%|█▍        | 9082/65536 [1:41:34<10:56:16,  1.43it/s]
 14%|█▍        | 9083/65536 [1:41:35<10:49:46,  1.45it/s]
 14%|█▍        | 9084/65536 [1:41:36<10:49:25,  1.45it/s]
 14%|█▍        | 9085/65536 [1:41:36<10:45:49,  1.46it/s]
 14%|█▍        | 9086/65536 [1:41:37<10:53:49,  1.44it/s]
 14%|█▍        | 9087/65536 [1:41:38<10:35:48,  1.48it/s]
 14%|█▍        | 9088/65536 [1:41:38<10:35:38,  1.48it/s]
 14%|█▍        | 9089/65536 [1:41:39<10:46:16,  1.46it/s]
 14%|█▍        | 9090/65536 [1:41:40<10:43:01,  1.46it/s]
 14%|█▍        | 9091/65536 [1:41:40<10:30:44,  1.49it/s]
 14%|█▍        | 9092/65536 [1:41:41<10:25:06,  1.50it/s]
 14%|█▍        | 9093/65536 [1:41:42<10:18:36,  1.52it/s]
 14%|█▍        | 9094/65536 [1:41:42<10:20:16,  1.52it/s]
 14%|█▍        | 9095/65536 [1:41:43<10:10:03,  1.54it/s]
 14%|█▍        | 9096/65536 [1:41:44<10:12:42,  1.54it/s]
 14%|█▍        | 9097/65536 [1:41:44<10:17:08,  1.52it/s]
 14%|█▍        | 9098/65536 [1:41:45<10:22:43,  1.51it/s]
 14%|█▍        | 9099/65536 [1:41:46<10:17:11,  1.52it/s]
 14%|█▍        | 9100/65536 [1:41:46<10:38:36,  1.47it/s]
                                                         
{'loss': 0.9849, 'learning_rate': 8.774029631443614e-07, 'epoch': 561.73}

 14%|█▍        | 9100/65536 [1:41:46<10:38:36,  1.47it/s]
 14%|█▍        | 9101/65536 [1:41:47<10:33:29,  1.48it/s]
 14%|█▍        | 9102/65536 [1:41:48<10:21:48,  1.51it/s]
 14%|█▍        | 9103/65536 [1:41:48<10:47:45,  1.45it/s]
 14%|█▍        | 9104/65536 [1:41:49<10:32:32,  1.49it/s]
 14%|█▍        | 9105/65536 [1:41:50<10:47:10,  1.45it/s]
 14%|█▍        | 9106/65536 [1:41:50<10:47:54,  1.45it/s]
 14%|█▍        | 9107/65536 [1:41:51<10:39:17,  1.47it/s]
 14%|█▍        | 9108/65536 [1:41:52<10:16:24,  1.53it/s]
 14%|█▍        | 9109/65536 [1:41:52<10:16:29,  1.53it/s]
 14%|█▍        | 9110/65536 [1:41:53<10:15:00,  1.53it/s]
 14%|█▍        | 9111/65536 [1:41:54<10:18:38,  1.52it/s]
 14%|█▍        | 9112/65536 [1:41:54<10:21:22,  1.51it/s]
 14%|█▍        | 9113/65536 [1:41:55<10:32:43,  1.49it/s]
 14%|█▍        | 9114/65536 [1:41:56<10:26:30,  1.50it/s]
 14%|█▍        | 9115/65536 [1:41:56<10:15:25,  1.53it/s]
 14%|█▍        | 9116/65536 [1:41:57<10:19:07,  1.52it/s]
 14%|█▍        | 9117/65536 [1:41:58<10:42:41,  1.46it/s]
 14%|█▍        | 9118/65536 [1:41:58<10:43:37,  1.46it/s]
 14%|█▍        | 9119/65536 [1:41:59<10:37:08,  1.48it/s]
 14%|█▍        | 9120/65536 [1:42:00<10:31:24,  1.49it/s]
                                                         
{'loss': 1.0032, 'learning_rate': 8.771274641851353e-07, 'epoch': 562.96}

 14%|█▍        | 9120/65536 [1:42:00<10:31:24,  1.49it/s]
 14%|█▍        | 9121/65536 [1:42:00<10:38:41,  1.47it/s]
 14%|█▍        | 9122/65536 [1:42:01<10:38:17,  1.47it/s]
 14%|█▍        | 9123/65536 [1:42:02<10:28:15,  1.50it/s]
 14%|█▍        | 9124/65536 [1:42:02<10:27:39,  1.50it/s]
 14%|█▍        | 9125/65536 [1:42:03<10:43:52,  1.46it/s]
 14%|█▍        | 9126/65536 [1:42:04<10:21:00,  1.51it/s]
 14%|█▍        | 9127/65536 [1:42:04<10:24:46,  1.50it/s]
 14%|█▍        | 9128/65536 [1:42:05<10:35:41,  1.48it/s]
 14%|█▍        | 9129/65536 [1:42:06<10:23:26,  1.51it/s]
 14%|█▍        | 9130/65536 [1:42:06<10:14:55,  1.53it/s]
 14%|█▍        | 9131/65536 [1:42:07<10:16:33,  1.52it/s]
 14%|█▍        | 9132/65536 [1:42:08<10:11:43,  1.54it/s]
 14%|█▍        | 9133/65536 [1:42:08<10:05:50,  1.55it/s]
 14%|█▍        | 9134/65536 [1:42:09<10:19:11,  1.52it/s]
 14%|█▍        | 9135/65536 [1:42:10<10:22:54,  1.51it/s]
 14%|█▍        | 9136/65536 [1:42:10<10:24:22,  1.51it/s]
 14%|█▍        | 9137/65536 [1:42:11<11:01:23,  1.42it/s]
 14%|█▍        | 9138/65536 [1:42:12<10:53:06,  1.44it/s]
 14%|█▍        | 9139/65536 [1:42:12<10:36:33,  1.48it/s]
 14%|█▍        | 9140/65536 [1:42:13<10:18:09,  1.52it/s]
                                                         
{'loss': 1.0353, 'learning_rate': 8.768519652259091e-07, 'epoch': 564.2}

 14%|█▍        | 9140/65536 [1:42:13<10:18:09,  1.52it/s]
 14%|█▍        | 9141/65536 [1:42:14<10:14:13,  1.53it/s]
 14%|█▍        | 9142/65536 [1:42:14<10:14:09,  1.53it/s]
 14%|█▍        | 9143/65536 [1:42:15<10:18:18,  1.52it/s]
 14%|█▍        | 9144/65536 [1:42:16<10:00:56,  1.56it/s]
 14%|█▍        | 9145/65536 [1:42:16<10:02:35,  1.56it/s]
 14%|█▍        | 9146/65536 [1:42:17<10:14:05,  1.53it/s]
 14%|█▍        | 9147/65536 [1:42:18<10:06:19,  1.55it/s]
 14%|█▍        | 9148/65536 [1:42:18<10:19:12,  1.52it/s]
 14%|█▍        | 9149/65536 [1:42:19<10:34:58,  1.48it/s]
 14%|█▍        | 9150/65536 [1:42:20<10:27:35,  1.50it/s]
 14%|█▍        | 9151/65536 [1:42:20<10:38:27,  1.47it/s]
 14%|█▍        | 9152/65536 [1:42:21<11:03:50,  1.42it/s]
 14%|█▍        | 9153/65536 [1:42:22<10:43:31,  1.46it/s]
 14%|█▍        | 9154/65536 [1:42:22<10:55:19,  1.43it/s]
 14%|█▍        | 9155/65536 [1:42:23<10:49:57,  1.45it/s]
 14%|█▍        | 9156/65536 [1:42:24<10:41:30,  1.46it/s]
 14%|█▍        | 9157/65536 [1:42:24<10:35:05,  1.48it/s]
 14%|█▍        | 9158/65536 [1:42:25<10:17:16,  1.52it/s]
 14%|█▍        | 9159/65536 [1:42:26<10:35:33,  1.48it/s]
 14%|█▍        | 9160/65536 [1:42:26<10:31:11,  1.49it/s]
                                                         
{'loss': 1.0111, 'learning_rate': 8.76576466266683e-07, 'epoch': 565.43}

 14%|█▍        | 9160/65536 [1:42:26<10:31:11,  1.49it/s]
 14%|█▍        | 9161/65536 [1:42:27<10:31:40,  1.49it/s]
 14%|█▍        | 9162/65536 [1:42:28<10:29:36,  1.49it/s]
 14%|█▍        | 9163/65536 [1:42:28<10:12:55,  1.53it/s]
 14%|█▍        | 9164/65536 [1:42:29<10:16:32,  1.52it/s]
 14%|█▍        | 9165/65536 [1:42:30<10:20:39,  1.51it/s]
 14%|█▍        | 9166/65536 [1:42:30<10:21:01,  1.51it/s]
 14%|█▍        | 9167/65536 [1:42:31<10:28:07,  1.50it/s]
 14%|█▍        | 9168/65536 [1:42:32<10:28:36,  1.49it/s]
 14%|█▍        | 9169/65536 [1:42:32<10:34:25,  1.48it/s]
 14%|█▍        | 9170/65536 [1:42:33<10:53:54,  1.44it/s]
 14%|█▍        | 9171/65536 [1:42:34<10:58:35,  1.43it/s]
 14%|█▍        | 9172/65536 [1:42:35<11:03:18,  1.42it/s]
 14%|█▍        | 9173/65536 [1:42:35<10:45:20,  1.46it/s]
 14%|█▍        | 9174/65536 [1:42:36<10:38:34,  1.47it/s]
 14%|█▍        | 9175/65536 [1:42:37<10:33:39,  1.48it/s]
 14%|█▍        | 9176/65536 [1:42:37<10:50:49,  1.44it/s]
 14%|█▍        | 9177/65536 [1:42:38<10:49:08,  1.45it/s]
 14%|█▍        | 9178/65536 [1:42:39<10:40:55,  1.47it/s]
 14%|█▍        | 9179/65536 [1:42:39<10:36:42,  1.48it/s]
 14%|█▍        | 9180/65536 [1:42:40<10:34:09,  1.48it/s]
                                                         
{'loss': 0.9963, 'learning_rate': 8.763009673074568e-07, 'epoch': 566.67}

 14%|█▍        | 9180/65536 [1:42:40<10:34:09,  1.48it/s]
 14%|█▍        | 9181/65536 [1:42:41<10:18:08,  1.52it/s]
 14%|█▍        | 9182/65536 [1:42:41<10:04:18,  1.55it/s]
 14%|█▍        | 9183/65536 [1:42:42<10:16:03,  1.52it/s]
 14%|█▍        | 9184/65536 [1:42:43<10:03:17,  1.56it/s]
 14%|█▍        | 9185/65536 [1:42:43<9:59:07,  1.57it/s] 
 14%|█▍        | 9186/65536 [1:42:44<10:20:10,  1.51it/s]
 14%|█▍        | 9187/65536 [1:42:45<10:26:44,  1.50it/s]
 14%|█▍        | 9188/65536 [1:42:45<10:52:48,  1.44it/s]
 14%|█▍        | 9189/65536 [1:42:46<11:07:41,  1.41it/s]
 14%|█▍        | 9190/65536 [1:42:47<11:10:22,  1.40it/s]
 14%|█▍        | 9191/65536 [1:42:47<10:57:04,  1.43it/s]
 14%|█▍        | 9192/65536 [1:42:48<10:50:48,  1.44it/s]
 14%|█▍        | 9193/65536 [1:42:49<10:37:28,  1.47it/s]
 14%|█▍        | 9194/65536 [1:42:49<10:22:51,  1.51it/s]
 14%|█▍        | 9195/65536 [1:42:50<10:11:25,  1.54it/s]
 14%|█▍        | 9196/65536 [1:42:51<10:08:09,  1.54it/s]
 14%|█▍        | 9197/65536 [1:42:51<10:16:00,  1.52it/s]
 14%|█▍        | 9198/65536 [1:42:52<10:15:32,  1.53it/s]
 14%|█▍        | 9199/65536 [1:42:53<10:14:47,  1.53it/s]
 14%|█▍        | 9200/65536 [1:42:53<10:15:24,  1.53it/s]
                                                         
{'loss': 0.9932, 'learning_rate': 8.760254683482306e-07, 'epoch': 567.9}

 14%|█▍        | 9200/65536 [1:42:53<10:15:24,  1.53it/s]
 14%|█▍        | 9201/65536 [1:42:54<10:26:08,  1.50it/s]
 14%|█▍        | 9202/65536 [1:42:55<10:23:20,  1.51it/s]
 14%|█▍        | 9203/65536 [1:42:55<10:35:31,  1.48it/s]
 14%|█▍        | 9204/65536 [1:42:56<10:31:33,  1.49it/s]
 14%|█▍        | 9205/65536 [1:42:57<10:28:13,  1.49it/s]
 14%|█▍        | 9206/65536 [1:42:57<10:29:39,  1.49it/s]
 14%|█▍        | 9207/65536 [1:42:58<10:29:11,  1.49it/s]
 14%|█▍        | 9208/65536 [1:42:59<10:28:27,  1.49it/s]
 14%|█▍        | 9209/65536 [1:42:59<10:51:11,  1.44it/s]
 14%|█▍        | 9210/65536 [1:43:00<10:41:58,  1.46it/s]
 14%|█▍        | 9211/65536 [1:43:01<10:44:19,  1.46it/s]
 14%|█▍        | 9212/65536 [1:43:01<10:31:13,  1.49it/s]
 14%|█▍        | 9213/65536 [1:43:02<10:14:16,  1.53it/s]
 14%|█▍        | 9214/65536 [1:43:03<10:24:54,  1.50it/s]
 14%|█▍        | 9215/65536 [1:43:03<10:23:06,  1.51it/s]
 14%|█▍        | 9216/65536 [1:43:04<10:21:08,  1.51it/s]
 14%|█▍        | 9217/65536 [1:43:05<10:11:27,  1.54it/s]
 14%|█▍        | 9218/65536 [1:43:05<10:27:51,  1.49it/s]
 14%|█▍        | 9219/65536 [1:43:06<10:26:34,  1.50it/s]
 14%|█▍        | 9220/65536 [1:43:07<10:16:39,  1.52it/s]
                                                         
{'loss': 1.0088, 'learning_rate': 8.757499693890045e-07, 'epoch': 569.14}

 14%|█▍        | 9220/65536 [1:43:07<10:16:39,  1.52it/s]
 14%|█▍        | 9221/65536 [1:43:07<10:26:36,  1.50it/s]
 14%|█▍        | 9222/65536 [1:43:08<10:34:08,  1.48it/s]
 14%|█▍        | 9223/65536 [1:43:09<10:38:13,  1.47it/s]
 14%|█▍        | 9224/65536 [1:43:09<10:47:24,  1.45it/s]
 14%|█▍        | 9225/65536 [1:43:10<10:35:44,  1.48it/s]
 14%|█▍        | 9226/65536 [1:43:11<10:20:58,  1.51it/s]
 14%|█▍        | 9227/65536 [1:43:11<9:59:07,  1.57it/s] 
 14%|█▍        | 9228/65536 [1:43:12<10:24:50,  1.50it/s]
 14%|█▍        | 9229/65536 [1:43:13<10:22:50,  1.51it/s]
 14%|█▍        | 9230/65536 [1:43:13<10:25:02,  1.50it/s]
 14%|█▍        | 9231/65536 [1:43:14<10:07:32,  1.54it/s]
 14%|█▍        | 9232/65536 [1:43:15<10:00:57,  1.56it/s]
 14%|█▍        | 9233/65536 [1:43:15<10:15:16,  1.53it/s]
 14%|█▍        | 9234/65536 [1:43:16<10:26:50,  1.50it/s]
 14%|█▍        | 9235/65536 [1:43:17<10:36:14,  1.47it/s]
 14%|█▍        | 9236/65536 [1:43:17<10:37:21,  1.47it/s]
 14%|█▍        | 9237/65536 [1:43:18<10:55:30,  1.43it/s]
 14%|█▍        | 9238/65536 [1:43:19<11:04:31,  1.41it/s]
 14%|█▍        | 9239/65536 [1:43:20<10:44:12,  1.46it/s]
 14%|█▍        | 9240/65536 [1:43:20<10:44:24,  1.46it/s]
                                                         
{'loss': 0.9893, 'learning_rate': 8.754744704297783e-07, 'epoch': 570.37}

 14%|█▍        | 9240/65536 [1:43:20<10:44:24,  1.46it/s]
 14%|█▍        | 9241/65536 [1:43:21<10:34:39,  1.48it/s]
 14%|█▍        | 9242/65536 [1:43:22<10:44:41,  1.46it/s]
 14%|█▍        | 9243/65536 [1:43:22<10:24:28,  1.50it/s]
 14%|█▍        | 9244/65536 [1:43:23<10:24:06,  1.50it/s]
 14%|█▍        | 9245/65536 [1:43:23<10:09:58,  1.54it/s]
 14%|█▍        | 9246/65536 [1:43:24<10:13:12,  1.53it/s]
 14%|█▍        | 9247/65536 [1:43:25<10:13:15,  1.53it/s]
 14%|█▍        | 9248/65536 [1:43:25<10:13:05,  1.53it/s]
 14%|█▍        | 9249/65536 [1:43:26<10:18:56,  1.52it/s]
 14%|█▍        | 9250/65536 [1:43:27<10:14:06,  1.53it/s]
 14%|█▍        | 9251/65536 [1:43:27<10:33:14,  1.48it/s]
 14%|█▍        | 9252/65536 [1:43:28<10:26:37,  1.50it/s]
 14%|█▍        | 9253/65536 [1:43:29<10:24:11,  1.50it/s]
 14%|█▍        | 9254/65536 [1:43:29<10:15:49,  1.52it/s]
 14%|█▍        | 9255/65536 [1:43:30<10:05:07,  1.55it/s]
 14%|█▍        | 9256/65536 [1:43:31<10:04:29,  1.55it/s]
 14%|█▍        | 9257/65536 [1:43:31<10:14:34,  1.53it/s]
 14%|█▍        | 9258/65536 [1:43:32<10:28:29,  1.49it/s]
 14%|█▍        | 9259/65536 [1:43:33<10:35:43,  1.48it/s]
 14%|█▍        | 9260/65536 [1:43:33<10:33:10,  1.48it/s]
                                                         
{'loss': 1.0086, 'learning_rate': 8.751989714705522e-07, 'epoch': 571.6}

 14%|█▍        | 9260/65536 [1:43:33<10:33:10,  1.48it/s]
 14%|█▍        | 9261/65536 [1:43:34<10:27:37,  1.49it/s]
 14%|█▍        | 9262/65536 [1:43:35<10:40:34,  1.46it/s]
 14%|█▍        | 9263/65536 [1:43:35<10:35:49,  1.48it/s]
 14%|█▍        | 9264/65536 [1:43:36<10:24:00,  1.50it/s]
 14%|█▍        | 9265/65536 [1:43:37<10:36:44,  1.47it/s]
 14%|█▍        | 9266/65536 [1:43:38<10:41:30,  1.46it/s]
 14%|█▍        | 9267/65536 [1:43:38<10:38:49,  1.47it/s]
 14%|█▍        | 9268/65536 [1:43:39<10:47:54,  1.45it/s]
 14%|█▍        | 9269/65536 [1:43:40<10:46:16,  1.45it/s]
 14%|█▍        | 9270/65536 [1:43:40<10:31:06,  1.49it/s]
 14%|█▍        | 9271/65536 [1:43:41<10:27:45,  1.49it/s]
 14%|█▍        | 9272/65536 [1:43:42<10:16:02,  1.52it/s]
 14%|█▍        | 9273/65536 [1:43:42<10:34:06,  1.48it/s]
 14%|█▍        | 9274/65536 [1:43:43<10:29:27,  1.49it/s]
 14%|█▍        | 9275/65536 [1:43:44<10:41:05,  1.46it/s]
 14%|█▍        | 9276/65536 [1:43:44<10:22:21,  1.51it/s]
 14%|█▍        | 9277/65536 [1:43:45<10:42:52,  1.46it/s]
 14%|█▍        | 9278/65536 [1:43:46<10:35:03,  1.48it/s]
 14%|█▍        | 9279/65536 [1:43:46<10:25:50,  1.50it/s]
 14%|█▍        | 9280/65536 [1:43:47<10:09:19,  1.54it/s]
                                                         
{'loss': 0.992, 'learning_rate': 8.74923472511326e-07, 'epoch': 572.84}

 14%|█▍        | 9280/65536 [1:43:47<10:09:19,  1.54it/s]
 14%|█▍        | 9281/65536 [1:43:47<10:01:00,  1.56it/s]
 14%|█▍        | 9282/65536 [1:43:48<10:18:06,  1.52it/s]
 14%|█▍        | 9283/65536 [1:43:49<10:18:10,  1.52it/s]
 14%|█▍        | 9284/65536 [1:43:49<10:12:33,  1.53it/s]
 14%|█▍        | 9285/65536 [1:43:50<10:15:31,  1.52it/s]
 14%|█▍        | 9286/65536 [1:43:51<10:12:11,  1.53it/s]
 14%|█▍        | 9287/65536 [1:43:51<10:10:12,  1.54it/s]
 14%|█▍        | 9288/65536 [1:43:52<10:07:30,  1.54it/s]
 14%|█▍        | 9289/65536 [1:43:53<10:07:39,  1.54it/s]
 14%|█▍        | 9290/65536 [1:43:53<10:20:55,  1.51it/s]
 14%|█▍        | 9291/65536 [1:43:54<10:36:48,  1.47it/s]
 14%|█▍        | 9292/65536 [1:43:55<10:53:48,  1.43it/s]
 14%|█▍        | 9293/65536 [1:43:56<10:40:25,  1.46it/s]
 14%|█▍        | 9294/65536 [1:43:56<10:48:30,  1.45it/s]
 14%|█▍        | 9295/65536 [1:43:57<10:31:51,  1.48it/s]
 14%|█▍        | 9296/65536 [1:43:58<10:39:57,  1.46it/s]
 14%|█▍        | 9297/65536 [1:43:58<10:33:48,  1.48it/s]
 14%|█▍        | 9298/65536 [1:43:59<10:25:47,  1.50it/s]
 14%|█▍        | 9299/65536 [1:44:00<10:48:57,  1.44it/s]
 14%|█▍        | 9300/65536 [1:44:00<10:41:52,  1.46it/s]
                                                         
{'loss': 1.0009, 'learning_rate': 8.746479735520998e-07, 'epoch': 574.07}

 14%|█▍        | 9300/65536 [1:44:00<10:41:52,  1.46it/s]
 14%|█▍        | 9301/65536 [1:44:01<10:52:39,  1.44it/s]
 14%|█▍        | 9302/65536 [1:44:02<10:33:52,  1.48it/s]
 14%|█▍        | 9303/65536 [1:44:02<10:29:25,  1.49it/s]
 14%|█▍        | 9304/65536 [1:44:03<10:46:53,  1.45it/s]
 14%|█▍        | 9305/65536 [1:44:04<10:29:11,  1.49it/s]
 14%|█▍        | 9306/65536 [1:44:04<10:29:10,  1.49it/s]
 14%|█▍        | 9307/65536 [1:44:05<10:19:38,  1.51it/s]
 14%|█▍        | 9308/65536 [1:44:06<10:14:34,  1.52it/s]
 14%|█▍        | 9309/65536 [1:44:06<10:05:55,  1.55it/s]
 14%|█▍        | 9310/65536 [1:44:07<9:54:01,  1.58it/s] 
 14%|█▍        | 9311/65536 [1:44:08<10:08:02,  1.54it/s]
 14%|█▍        | 9312/65536 [1:44:08<10:13:41,  1.53it/s]
 14%|█▍        | 9313/65536 [1:44:09<10:11:01,  1.53it/s]
 14%|█▍        | 9314/65536 [1:44:10<10:28:27,  1.49it/s]
 14%|█▍        | 9315/65536 [1:44:10<10:15:26,  1.52it/s]
 14%|█▍        | 9316/65536 [1:44:11<10:37:16,  1.47it/s]
 14%|█▍        | 9317/65536 [1:44:12<10:13:09,  1.53it/s]
 14%|█▍        | 9318/65536 [1:44:12<10:24:53,  1.50it/s]
 14%|█▍        | 9319/65536 [1:44:13<10:20:07,  1.51it/s]
 14%|█▍        | 9320/65536 [1:44:14<10:37:48,  1.47it/s]
                                                         
{'loss': 1.0138, 'learning_rate': 8.743724745928737e-07, 'epoch': 575.31}

 14%|█▍        | 9320/65536 [1:44:14<10:37:48,  1.47it/s]
 14%|█▍        | 9321/65536 [1:44:14<10:24:40,  1.50it/s]
 14%|█▍        | 9322/65536 [1:44:15<10:35:24,  1.47it/s]
 14%|█▍        | 9323/65536 [1:44:16<10:44:57,  1.45it/s]
 14%|█▍        | 9324/65536 [1:44:16<10:26:44,  1.49it/s]
 14%|█▍        | 9325/65536 [1:44:17<10:18:35,  1.51it/s]
 14%|█▍        | 9326/65536 [1:44:18<10:09:05,  1.54it/s]
 14%|█▍        | 9327/65536 [1:44:18<10:03:01,  1.55it/s]
 14%|█▍        | 9328/65536 [1:44:19<10:08:10,  1.54it/s]
 14%|█▍        | 9329/65536 [1:44:20<10:13:36,  1.53it/s]
 14%|█▍        | 9330/65536 [1:44:20<10:17:35,  1.52it/s]
 14%|█▍        | 9331/65536 [1:44:21<10:17:51,  1.52it/s]
 14%|█▍        | 9332/65536 [1:44:22<10:37:54,  1.47it/s]
 14%|█▍        | 9333/65536 [1:44:22<10:39:08,  1.47it/s]
 14%|█▍        | 9334/65536 [1:44:23<10:51:01,  1.44it/s]
 14%|█▍        | 9335/65536 [1:44:24<10:29:45,  1.49it/s]
 14%|█▍        | 9336/65536 [1:44:24<10:38:49,  1.47it/s]
 14%|█▍        | 9337/65536 [1:44:25<10:28:20,  1.49it/s]
 14%|█▍        | 9338/65536 [1:44:26<10:23:59,  1.50it/s]
 14%|█▍        | 9339/65536 [1:44:26<10:14:11,  1.52it/s]
 14%|█▍        | 9340/65536 [1:44:27<10:19:44,  1.51it/s]
                                                         
{'loss': 1.0075, 'learning_rate': 8.740969756336475e-07, 'epoch': 576.54}

 14%|█▍        | 9340/65536 [1:44:27<10:19:44,  1.51it/s]
 14%|█▍        | 9341/65536 [1:44:28<10:28:02,  1.49it/s]
 14%|█▍        | 9342/65536 [1:44:28<10:30:43,  1.48it/s]
 14%|█▍        | 9343/65536 [1:44:29<10:37:51,  1.47it/s]
 14%|█▍        | 9344/65536 [1:44:30<10:31:06,  1.48it/s]
 14%|█▍        | 9345/65536 [1:44:30<10:18:58,  1.51it/s]
 14%|█▍        | 9346/65536 [1:44:31<10:13:20,  1.53it/s]
 14%|█▍        | 9347/65536 [1:44:32<10:07:05,  1.54it/s]
 14%|█▍        | 9348/65536 [1:44:32<10:21:53,  1.51it/s]
 14%|█▍        | 9349/65536 [1:44:33<10:04:52,  1.55it/s]
 14%|█▍        | 9350/65536 [1:44:33<10:08:00,  1.54it/s]
 14%|█▍        | 9351/65536 [1:44:34<10:32:29,  1.48it/s]
 14%|█▍        | 9352/65536 [1:44:35<10:22:29,  1.50it/s]
 14%|█▍        | 9353/65536 [1:44:35<10:10:59,  1.53it/s]
 14%|█▍        | 9354/65536 [1:44:36<10:18:29,  1.51it/s]
 14%|█▍        | 9355/65536 [1:44:37<10:03:15,  1.55it/s]
 14%|█▍        | 9356/65536 [1:44:37<9:55:37,  1.57it/s] 
 14%|█▍        | 9357/65536 [1:44:38<10:01:29,  1.56it/s]
 14%|█▍        | 9358/65536 [1:44:39<10:11:11,  1.53it/s]
 14%|█▍        | 9359/65536 [1:44:39<10:25:00,  1.50it/s]
 14%|█▍        | 9360/65536 [1:44:40<10:28:26,  1.49it/s]
                                                         
{'loss': 0.997, 'learning_rate': 8.738214766744214e-07, 'epoch': 577.78}

 14%|█▍        | 9360/65536 [1:44:40<10:28:26,  1.49it/s]
 14%|█▍        | 9361/65536 [1:44:41<10:24:55,  1.50it/s]
 14%|█▍        | 9362/65536 [1:44:42<10:55:01,  1.43it/s]
 14%|█▍        | 9363/65536 [1:44:42<10:47:20,  1.45it/s]
 14%|█▍        | 9364/65536 [1:44:43<10:54:47,  1.43it/s]
 14%|█▍        | 9365/65536 [1:44:44<10:31:35,  1.48it/s]
 14%|█▍        | 9366/65536 [1:44:44<10:15:05,  1.52it/s]
 14%|█▍        | 9367/65536 [1:44:45<10:25:03,  1.50it/s]
 14%|█▍        | 9368/65536 [1:44:46<10:34:01,  1.48it/s]
 14%|█▍        | 9369/65536 [1:44:46<10:22:10,  1.50it/s]
 14%|█▍        | 9370/65536 [1:44:47<10:17:55,  1.51it/s]
 14%|█▍        | 9371/65536 [1:44:48<10:15:51,  1.52it/s]
 14%|█▍        | 9372/65536 [1:44:48<10:29:36,  1.49it/s]
 14%|█▍        | 9373/65536 [1:44:49<10:45:47,  1.45it/s]
 14%|█▍        | 9374/65536 [1:44:50<10:37:29,  1.47it/s]
 14%|█▍        | 9375/65536 [1:44:50<10:24:25,  1.50it/s]
 14%|█▍        | 9376/65536 [1:44:51<10:27:03,  1.49it/s]
 14%|█▍        | 9377/65536 [1:44:52<10:30:26,  1.48it/s]
 14%|█▍        | 9378/65536 [1:44:52<10:25:56,  1.50it/s]
 14%|█▍        | 9379/65536 [1:44:53<10:21:18,  1.51it/s]
 14%|█▍        | 9380/65536 [1:44:54<10:50:18,  1.44it/s]
                                                         
{'loss': 1.0075, 'learning_rate': 8.735459777151952e-07, 'epoch': 579.01}

 14%|█▍        | 9380/65536 [1:44:54<10:50:18,  1.44it/s]
 14%|█▍        | 9381/65536 [1:44:54<11:01:17,  1.42it/s]
 14%|█▍        | 9382/65536 [1:44:55<10:40:57,  1.46it/s]
 14%|█▍        | 9383/65536 [1:44:56<10:29:31,  1.49it/s]
 14%|█▍        | 9384/65536 [1:44:56<10:33:09,  1.48it/s]
 14%|█▍        | 9385/65536 [1:44:57<10:29:23,  1.49it/s]
 14%|█▍        | 9386/65536 [1:44:58<10:34:31,  1.47it/s]
 14%|█▍        | 9387/65536 [1:44:58<10:32:28,  1.48it/s]
 14%|█▍        | 9388/65536 [1:44:59<10:20:46,  1.51it/s]
 14%|█▍        | 9389/65536 [1:45:00<10:24:48,  1.50it/s]
 14%|█▍        | 9390/65536 [1:45:00<10:16:03,  1.52it/s]
 14%|█▍        | 9391/65536 [1:45:01<10:19:26,  1.51it/s]
 14%|█▍        | 9392/65536 [1:45:02<10:26:05,  1.49it/s]
 14%|█▍        | 9393/65536 [1:45:02<10:35:47,  1.47it/s]
 14%|█▍        | 9394/65536 [1:45:03<10:16:08,  1.52it/s]
 14%|█▍        | 9395/65536 [1:45:04<10:27:53,  1.49it/s]
 14%|█▍        | 9396/65536 [1:45:04<10:19:17,  1.51it/s]
 14%|█▍        | 9397/65536 [1:45:05<10:37:15,  1.47it/s]
 14%|█▍        | 9398/65536 [1:45:06<10:38:21,  1.47it/s]
 14%|█▍        | 9399/65536 [1:45:06<10:43:41,  1.45it/s]
 14%|█▍        | 9400/65536 [1:45:07<10:28:20,  1.49it/s]
                                                         
{'loss': 0.9865, 'learning_rate': 8.732704787559691e-07, 'epoch': 580.25}

 14%|█▍        | 9400/65536 [1:45:07<10:28:20,  1.49it/s]
 14%|█▍        | 9401/65536 [1:45:08<10:28:27,  1.49it/s]
 14%|█▍        | 9402/65536 [1:45:08<10:17:03,  1.52it/s]
 14%|█▍        | 9403/65536 [1:45:09<10:15:45,  1.52it/s]
 14%|█▍        | 9404/65536 [1:45:10<10:06:52,  1.54it/s]
 14%|█▍        | 9405/65536 [1:45:10<10:07:22,  1.54it/s]
 14%|█▍        | 9406/65536 [1:45:11<10:18:01,  1.51it/s]
 14%|█▍        | 9407/65536 [1:45:12<10:24:36,  1.50it/s]
 14%|█▍        | 9408/65536 [1:45:12<10:27:42,  1.49it/s]
 14%|█▍        | 9409/65536 [1:45:13<10:19:55,  1.51it/s]
 14%|█▍        | 9410/65536 [1:45:14<10:07:03,  1.54it/s]
 14%|█▍        | 9411/65536 [1:45:14<10:16:21,  1.52it/s]
 14%|█▍        | 9412/65536 [1:45:15<10:40:22,  1.46it/s]
 14%|█▍        | 9413/65536 [1:45:16<10:52:11,  1.43it/s]
 14%|█▍        | 9414/65536 [1:45:16<10:39:45,  1.46it/s]
 14%|█▍        | 9415/65536 [1:45:17<10:18:00,  1.51it/s]
 14%|█▍        | 9416/65536 [1:45:18<10:12:22,  1.53it/s]
 14%|█▍        | 9417/65536 [1:45:18<10:12:42,  1.53it/s]
 14%|█▍        | 9418/65536 [1:45:19<10:17:47,  1.51it/s]
 14%|█▍        | 9419/65536 [1:45:20<10:20:28,  1.51it/s]
 14%|█▍        | 9420/65536 [1:45:20<10:29:19,  1.49it/s]
                                                         
{'loss': 0.9952, 'learning_rate': 8.72994979796743e-07, 'epoch': 581.48}

 14%|█▍        | 9420/65536 [1:45:20<10:29:19,  1.49it/s]
 14%|█▍        | 9421/65536 [1:45:21<10:33:23,  1.48it/s]
 14%|█▍        | 9422/65536 [1:45:22<10:47:51,  1.44it/s]
 14%|█▍        | 9423/65536 [1:45:22<10:37:20,  1.47it/s]
 14%|█▍        | 9424/65536 [1:45:23<10:31:47,  1.48it/s]
 14%|█▍        | 9425/65536 [1:45:24<10:14:10,  1.52it/s]
 14%|█▍        | 9426/65536 [1:45:24<10:20:03,  1.51it/s]
 14%|█▍        | 9427/65536 [1:45:25<10:25:53,  1.49it/s]
 14%|█▍        | 9428/65536 [1:45:26<10:20:18,  1.51it/s]
 14%|█▍        | 9429/65536 [1:45:27<11:01:13,  1.41it/s]
 14%|█▍        | 9430/65536 [1:45:27<11:01:20,  1.41it/s]
 14%|█▍        | 9431/65536 [1:45:28<10:50:17,  1.44it/s]
 14%|█▍        | 9432/65536 [1:45:29<10:38:35,  1.46it/s]
 14%|█▍        | 9433/65536 [1:45:29<10:26:14,  1.49it/s]
 14%|█▍        | 9434/65536 [1:45:30<10:22:21,  1.50it/s]
 14%|█▍        | 9435/65536 [1:45:31<10:16:59,  1.52it/s]
 14%|█▍        | 9436/65536 [1:45:31<10:22:03,  1.50it/s]
 14%|█▍        | 9437/65536 [1:45:32<10:33:29,  1.48it/s]
 14%|█▍        | 9438/65536 [1:45:33<10:32:01,  1.48it/s]
 14%|█▍        | 9439/65536 [1:45:33<10:24:09,  1.50it/s]
 14%|█▍        | 9440/65536 [1:45:34<10:19:36,  1.51it/s]
                                                         
{'loss': 0.985, 'learning_rate': 8.727194808375168e-07, 'epoch': 582.72}

 14%|█▍        | 9440/65536 [1:45:34<10:19:36,  1.51it/s]
 14%|█▍        | 9441/65536 [1:45:35<10:35:00,  1.47it/s]
 14%|█▍        | 9442/65536 [1:45:35<10:26:43,  1.49it/s]
 14%|█▍        | 9443/65536 [1:45:36<10:18:01,  1.51it/s]
 14%|█▍        | 9444/65536 [1:45:37<10:13:05,  1.52it/s]
 14%|█▍        | 9445/65536 [1:45:37<10:28:23,  1.49it/s]
 14%|█▍        | 9446/65536 [1:45:38<10:23:15,  1.50it/s]
 14%|█▍        | 9447/65536 [1:45:39<10:23:11,  1.50it/s]
 14%|█▍        | 9448/65536 [1:45:39<10:29:57,  1.48it/s]
 14%|█▍        | 9449/65536 [1:45:40<10:18:20,  1.51it/s]
 14%|█▍        | 9450/65536 [1:45:41<10:46:29,  1.45it/s]
 14%|█▍        | 9451/65536 [1:45:41<10:21:03,  1.51it/s]
 14%|█▍        | 9452/65536 [1:45:42<10:28:35,  1.49it/s]
 14%|█▍        | 9453/65536 [1:45:43<10:25:29,  1.49it/s]
 14%|█▍        | 9454/65536 [1:45:43<10:14:04,  1.52it/s]
 14%|█▍        | 9455/65536 [1:45:44<10:20:55,  1.51it/s]
 14%|█▍        | 9456/65536 [1:45:45<10:22:51,  1.50it/s]
 14%|█▍        | 9457/65536 [1:45:45<10:08:43,  1.54it/s]
 14%|█▍        | 9458/65536 [1:45:46<10:14:11,  1.52it/s]
 14%|█▍        | 9459/65536 [1:45:47<10:29:47,  1.48it/s]
 14%|█▍        | 9460/65536 [1:45:47<10:19:16,  1.51it/s]
                                                         
{'loss': 0.9982, 'learning_rate': 8.724439818782906e-07, 'epoch': 583.95}

 14%|█▍        | 9460/65536 [1:45:47<10:19:16,  1.51it/s]
 14%|█▍        | 9461/65536 [1:45:48<10:49:44,  1.44it/s]
 14%|█▍        | 9462/65536 [1:45:49<10:33:30,  1.48it/s]
 14%|█▍        | 9463/65536 [1:45:49<10:45:43,  1.45it/s]
 14%|█▍        | 9464/65536 [1:45:50<10:21:15,  1.50it/s]
 14%|█▍        | 9465/65536 [1:45:51<10:34:14,  1.47it/s]
 14%|█▍        | 9466/65536 [1:45:51<10:36:25,  1.47it/s]
 14%|█▍        | 9467/65536 [1:45:52<10:19:28,  1.51it/s]
 14%|█▍        | 9468/65536 [1:45:53<10:13:28,  1.52it/s]
 14%|█▍        | 9469/65536 [1:45:53<10:20:19,  1.51it/s]
 14%|█▍        | 9470/65536 [1:45:54<10:17:49,  1.51it/s]
 14%|█▍        | 9471/65536 [1:45:55<10:24:12,  1.50it/s]
 14%|█▍        | 9472/65536 [1:45:55<10:24:59,  1.50it/s]
 14%|█▍        | 9473/65536 [1:45:56<10:16:55,  1.51it/s]
 14%|█▍        | 9474/65536 [1:45:57<10:10:59,  1.53it/s]
 14%|█▍        | 9475/65536 [1:45:57<10:14:00,  1.52it/s]
 14%|█▍        | 9476/65536 [1:45:58<10:04:18,  1.55it/s]
 14%|█▍        | 9477/65536 [1:45:59<10:10:24,  1.53it/s]
 14%|█▍        | 9478/65536 [1:45:59<10:27:23,  1.49it/s]
 14%|█▍        | 9479/65536 [1:46:00<10:41:08,  1.46it/s]
 14%|█▍        | 9480/65536 [1:46:01<10:38:55,  1.46it/s]
                                                         
{'loss': 1.0179, 'learning_rate': 8.721684829190644e-07, 'epoch': 585.19}

 14%|█▍        | 9480/65536 [1:46:01<10:38:55,  1.46it/s]
 14%|█▍        | 9481/65536 [1:46:01<10:38:08,  1.46it/s]
 14%|█▍        | 9482/65536 [1:46:02<10:29:36,  1.48it/s]
 14%|█▍        | 9483/65536 [1:46:03<10:15:39,  1.52it/s]
 14%|█▍        | 9484/65536 [1:46:03<10:28:36,  1.49it/s]
 14%|█▍        | 9485/65536 [1:46:04<10:29:50,  1.48it/s]
 14%|█▍        | 9486/65536 [1:46:05<10:22:06,  1.50it/s]
 14%|█▍        | 9487/65536 [1:46:05<10:08:20,  1.54it/s]
 14%|█▍        | 9488/65536 [1:46:06<10:05:38,  1.54it/s]
 14%|█▍        | 9489/65536 [1:46:07<10:09:26,  1.53it/s]
 14%|█▍        | 9490/65536 [1:46:07<10:11:32,  1.53it/s]
 14%|█▍        | 9491/65536 [1:46:08<10:13:34,  1.52it/s]
 14%|█▍        | 9492/65536 [1:46:09<10:42:39,  1.45it/s]
 14%|█▍        | 9493/65536 [1:46:09<10:12:21,  1.53it/s]
 14%|█▍        | 9494/65536 [1:46:10<10:16:22,  1.52it/s]
 14%|█▍        | 9495/65536 [1:46:11<10:06:49,  1.54it/s]
 14%|█▍        | 9496/65536 [1:46:11<10:00:50,  1.55it/s]
 14%|█▍        | 9497/65536 [1:46:12<10:11:05,  1.53it/s]
 14%|█▍        | 9498/65536 [1:46:13<10:18:29,  1.51it/s]
 14%|█▍        | 9499/65536 [1:46:13<10:55:51,  1.42it/s]
 14%|█▍        | 9500/65536 [1:46:14<10:46:41,  1.44it/s]
                                                         
{'loss': 0.9943, 'learning_rate': 8.718929839598383e-07, 'epoch': 586.42}

 14%|█▍        | 9500/65536 [1:46:14<10:46:41,  1.44it/s]
 14%|█▍        | 9501/65536 [1:46:15<10:30:18,  1.48it/s]
 14%|█▍        | 9502/65536 [1:46:15<10:33:28,  1.47it/s]
 15%|█▍        | 9503/65536 [1:46:16<10:31:54,  1.48it/s]
 15%|█▍        | 9504/65536 [1:46:17<10:36:38,  1.47it/s]
 15%|█▍        | 9505/65536 [1:46:17<10:30:29,  1.48it/s]
 15%|█▍        | 9506/65536 [1:46:18<10:32:44,  1.48it/s]
 15%|█▍        | 9507/65536 [1:46:19<10:25:07,  1.49it/s]
 15%|█▍        | 9508/65536 [1:46:19<10:27:26,  1.49it/s]
 15%|█▍        | 9509/65536 [1:46:20<10:15:15,  1.52it/s]
 15%|█▍        | 9510/65536 [1:46:21<10:31:28,  1.48it/s]
 15%|█▍        | 9511/65536 [1:46:21<10:43:49,  1.45it/s]
 15%|█▍        | 9512/65536 [1:46:22<10:28:20,  1.49it/s]
 15%|█▍        | 9513/65536 [1:46:23<10:50:15,  1.44it/s]
 15%|█▍        | 9514/65536 [1:46:23<10:39:37,  1.46it/s]
 15%|█▍        | 9515/65536 [1:46:24<10:29:06,  1.48it/s]
 15%|█▍        | 9516/65536 [1:46:25<10:33:17,  1.47it/s]
 15%|█▍        | 9517/65536 [1:46:25<10:29:52,  1.48it/s]
 15%|█▍        | 9518/65536 [1:46:26<10:22:00,  1.50it/s]
 15%|█▍        | 9519/65536 [1:46:27<10:31:12,  1.48it/s]
 15%|█▍        | 9520/65536 [1:46:27<10:18:01,  1.51it/s]
                                                         
{'loss': 0.9745, 'learning_rate': 8.716174850006122e-07, 'epoch': 587.65}

 15%|█▍        | 9520/65536 [1:46:27<10:18:01,  1.51it/s]
 15%|█▍        | 9521/65536 [1:46:28<10:12:01,  1.53it/s]
 15%|█▍        | 9522/65536 [1:46:29<10:23:58,  1.50it/s]
 15%|█▍        | 9523/65536 [1:46:29<10:26:20,  1.49it/s]
 15%|█▍        | 9524/65536 [1:46:30<10:20:43,  1.50it/s]
 15%|█▍        | 9525/65536 [1:46:31<10:26:03,  1.49it/s]
 15%|█▍        | 9526/65536 [1:46:31<10:41:03,  1.46it/s]
 15%|█▍        | 9527/65536 [1:46:32<10:38:27,  1.46it/s]
 15%|█▍        | 9528/65536 [1:46:33<10:31:33,  1.48it/s]
 15%|█▍        | 9529/65536 [1:46:33<10:27:50,  1.49it/s]
 15%|█▍        | 9530/65536 [1:46:34<10:17:47,  1.51it/s]
 15%|█▍        | 9531/65536 [1:46:35<10:15:44,  1.52it/s]
 15%|█▍        | 9532/65536 [1:46:35<10:19:16,  1.51it/s]
 15%|█▍        | 9533/65536 [1:46:36<10:13:38,  1.52it/s]
 15%|█▍        | 9534/65536 [1:46:37<10:22:52,  1.50it/s]
 15%|█▍        | 9535/65536 [1:46:38<10:34:50,  1.47it/s]
 15%|█▍        | 9536/65536 [1:46:38<10:33:22,  1.47it/s]
 15%|█▍        | 9537/65536 [1:46:39<10:23:28,  1.50it/s]
 15%|█▍        | 9538/65536 [1:46:40<10:30:13,  1.48it/s]
 15%|█▍        | 9539/65536 [1:46:40<10:17:24,  1.51it/s]
 15%|█▍        | 9540/65536 [1:46:41<10:08:06,  1.53it/s]
                                                         
{'loss': 0.9864, 'learning_rate': 8.713419860413861e-07, 'epoch': 588.89}

 15%|█▍        | 9540/65536 [1:46:41<10:08:06,  1.53it/s]
 15%|█▍        | 9541/65536 [1:46:41<10:21:37,  1.50it/s]
 15%|█▍        | 9542/65536 [1:46:42<10:45:35,  1.45it/s]
 15%|█▍        | 9543/65536 [1:46:43<10:26:39,  1.49it/s]
 15%|█▍        | 9544/65536 [1:46:44<10:38:47,  1.46it/s]
 15%|█▍        | 9545/65536 [1:46:44<10:20:17,  1.50it/s]
 15%|█▍        | 9546/65536 [1:46:45<10:31:22,  1.48it/s]
 15%|█▍        | 9547/65536 [1:46:46<10:31:45,  1.48it/s]
 15%|█▍        | 9548/65536 [1:46:46<10:22:58,  1.50it/s]
 15%|█▍        | 9549/65536 [1:46:47<10:08:16,  1.53it/s]
 15%|█▍        | 9550/65536 [1:46:48<10:33:14,  1.47it/s]
 15%|█▍        | 9551/65536 [1:46:48<10:33:40,  1.47it/s]
 15%|█▍        | 9552/65536 [1:46:49<10:19:51,  1.51it/s]
 15%|█▍        | 9553/65536 [1:46:50<10:14:37,  1.52it/s]
 15%|█▍        | 9554/65536 [1:46:50<10:16:37,  1.51it/s]
 15%|█▍        | 9555/65536 [1:46:51<10:30:59,  1.48it/s]
 15%|█▍        | 9556/65536 [1:46:52<10:45:44,  1.44it/s]
 15%|█▍        | 9557/65536 [1:46:52<10:28:13,  1.49it/s]
 15%|█▍        | 9558/65536 [1:46:53<10:21:31,  1.50it/s]
 15%|█▍        | 9559/65536 [1:46:54<10:51:05,  1.43it/s]
 15%|█▍        | 9560/65536 [1:46:54<10:52:52,  1.43it/s]
                                                         
{'loss': 0.9934, 'learning_rate': 8.710664870821599e-07, 'epoch': 590.12}

 15%|█▍        | 9560/65536 [1:46:54<10:52:52,  1.43it/s]
 15%|█▍        | 9561/65536 [1:46:55<10:45:42,  1.44it/s]
 15%|█▍        | 9562/65536 [1:46:56<10:29:14,  1.48it/s]
 15%|█▍        | 9563/65536 [1:46:56<10:33:23,  1.47it/s]
 15%|█▍        | 9564/65536 [1:46:57<10:17:53,  1.51it/s]
 15%|█▍        | 9565/65536 [1:46:58<9:59:47,  1.56it/s] 
 15%|█▍        | 9566/65536 [1:46:58<10:01:21,  1.55it/s]
 15%|█▍        | 9567/65536 [1:46:59<10:10:55,  1.53it/s]
 15%|█▍        | 9568/65536 [1:47:00<10:15:40,  1.52it/s]
 15%|█▍        | 9569/65536 [1:47:00<10:11:49,  1.52it/s]
 15%|█▍        | 9570/65536 [1:47:01<10:22:59,  1.50it/s]
 15%|█▍        | 9571/65536 [1:47:02<10:40:05,  1.46it/s]
 15%|█▍        | 9572/65536 [1:47:02<10:14:59,  1.52it/s]
 15%|█▍        | 9573/65536 [1:47:03<10:07:51,  1.53it/s]
 15%|█▍        | 9574/65536 [1:47:04<10:08:42,  1.53it/s]
 15%|█▍        | 9575/65536 [1:47:04<10:32:34,  1.47it/s]
 15%|█▍        | 9576/65536 [1:47:05<10:35:59,  1.47it/s]
 15%|█▍        | 9577/65536 [1:47:06<10:17:28,  1.51it/s]
 15%|█▍        | 9578/65536 [1:47:06<10:25:14,  1.49it/s]
 15%|█▍        | 9579/65536 [1:47:07<10:16:31,  1.51it/s]
 15%|█▍        | 9580/65536 [1:47:08<10:17:17,  1.51it/s]
                                                         
{'loss': 1.0141, 'learning_rate': 8.707909881229337e-07, 'epoch': 591.36}

 15%|█▍        | 9580/65536 [1:47:08<10:17:17,  1.51it/s]
 15%|█▍        | 9581/65536 [1:47:08<10:15:56,  1.51it/s]
 15%|█▍        | 9582/65536 [1:47:09<10:16:05,  1.51it/s]
 15%|█▍        | 9583/65536 [1:47:10<10:29:47,  1.48it/s]
 15%|█▍        | 9584/65536 [1:47:10<10:30:30,  1.48it/s]
 15%|█▍        | 9585/65536 [1:47:11<10:29:14,  1.48it/s]
 15%|█▍        | 9586/65536 [1:47:12<10:23:53,  1.49it/s]
 15%|█▍        | 9587/65536 [1:47:12<10:22:21,  1.50it/s]
 15%|█▍        | 9588/65536 [1:47:13<10:20:16,  1.50it/s]
 15%|█▍        | 9589/65536 [1:47:14<10:02:10,  1.55it/s]
 15%|█▍        | 9590/65536 [1:47:14<10:07:03,  1.54it/s]
 15%|█▍        | 9591/65536 [1:47:15<10:14:56,  1.52it/s]
 15%|█▍        | 9592/65536 [1:47:16<10:10:52,  1.53it/s]
 15%|█▍        | 9593/65536 [1:47:16<10:16:03,  1.51it/s]
 15%|█▍        | 9594/65536 [1:47:17<10:10:11,  1.53it/s]
 15%|█▍        | 9595/65536 [1:47:17<9:59:30,  1.56it/s] 
 15%|█▍        | 9596/65536 [1:47:18<9:42:40,  1.60it/s]
 15%|█▍        | 9597/65536 [1:47:19<9:50:41,  1.58it/s]
 15%|█▍        | 9598/65536 [1:47:19<9:50:19,  1.58it/s]
 15%|█▍        | 9599/65536 [1:47:20<10:05:14,  1.54it/s]
 15%|█▍        | 9600/65536 [1:47:21<9:51:24,  1.58it/s] 
                                                        
{'loss': 1.024, 'learning_rate': 8.705154891637076e-07, 'epoch': 592.59}

 15%|█▍        | 9600/65536 [1:47:21<9:51:24,  1.58it/s]
 15%|█▍        | 9601/65536 [1:47:21<10:00:19,  1.55it/s]
 15%|█▍        | 9602/65536 [1:47:22<10:07:48,  1.53it/s]
 15%|█▍        | 9603/65536 [1:47:23<10:11:50,  1.52it/s]
 15%|█▍        | 9604/65536 [1:47:23<10:31:39,  1.48it/s]
 15%|█▍        | 9605/65536 [1:47:24<10:34:22,  1.47it/s]
 15%|█▍        | 9606/65536 [1:47:25<10:41:28,  1.45it/s]
 15%|█▍        | 9607/65536 [1:47:25<10:39:11,  1.46it/s]
 15%|█▍        | 9608/65536 [1:47:26<10:55:59,  1.42it/s]
 15%|█▍        | 9609/65536 [1:47:27<10:46:35,  1.44it/s]
 15%|█▍        | 9610/65536 [1:47:27<10:31:14,  1.48it/s]
 15%|█▍        | 9611/65536 [1:47:28<10:14:06,  1.52it/s]
 15%|█▍        | 9612/65536 [1:47:29<10:17:54,  1.51it/s]
 15%|█▍        | 9613/65536 [1:47:29<10:36:01,  1.47it/s]
 15%|█▍        | 9614/65536 [1:47:30<10:29:11,  1.48it/s]
 15%|█▍        | 9615/65536 [1:47:31<10:30:44,  1.48it/s]
 15%|█▍        | 9616/65536 [1:47:31<10:17:15,  1.51it/s]
 15%|█▍        | 9617/65536 [1:47:32<10:15:35,  1.51it/s]
 15%|█▍        | 9618/65536 [1:47:33<10:09:46,  1.53it/s]
 15%|█▍        | 9619/65536 [1:47:33<10:03:56,  1.54it/s]
 15%|█▍        | 9620/65536 [1:47:34<10:18:11,  1.51it/s]
                                                         
{'loss': 0.9827, 'learning_rate': 8.702399902044814e-07, 'epoch': 593.83}

 15%|█▍        | 9620/65536 [1:47:34<10:18:11,  1.51it/s]
 15%|█▍        | 9621/65536 [1:47:35<10:21:51,  1.50it/s]
 15%|█▍        | 9622/65536 [1:47:35<10:33:37,  1.47it/s]
 15%|█▍        | 9623/65536 [1:47:36<11:00:28,  1.41it/s]
 15%|█▍        | 9624/65536 [1:47:37<10:47:09,  1.44it/s]
 15%|█▍        | 9625/65536 [1:47:38<10:30:31,  1.48it/s]
 15%|█▍        | 9626/65536 [1:47:38<10:27:46,  1.48it/s]
 15%|█▍        | 9627/65536 [1:47:39<10:38:43,  1.46it/s]
 15%|█▍        | 9628/65536 [1:47:40<10:22:28,  1.50it/s]
 15%|█▍        | 9629/65536 [1:47:40<10:30:46,  1.48it/s]
 15%|█▍        | 9630/65536 [1:47:41<10:32:45,  1.47it/s]
 15%|█▍        | 9631/65536 [1:47:42<10:24:42,  1.49it/s]
 15%|█▍        | 9632/65536 [1:47:42<10:10:44,  1.53it/s]
 15%|█▍        | 9633/65536 [1:47:43<10:51:22,  1.43it/s]
 15%|█▍        | 9634/65536 [1:47:44<10:40:15,  1.46it/s]
 15%|█▍        | 9635/65536 [1:47:44<10:33:02,  1.47it/s]
 15%|█▍        | 9636/65536 [1:47:45<10:30:09,  1.48it/s]
 15%|█▍        | 9637/65536 [1:47:46<10:20:31,  1.50it/s]
 15%|█▍        | 9638/65536 [1:47:46<10:19:27,  1.50it/s]
 15%|█▍        | 9639/65536 [1:47:47<10:25:46,  1.49it/s]
 15%|█▍        | 9640/65536 [1:47:48<10:46:30,  1.44it/s]
                                                         
{'loss': 0.9912, 'learning_rate': 8.699644912452553e-07, 'epoch': 595.06}

 15%|█▍        | 9640/65536 [1:47:48<10:46:30,  1.44it/s]
 15%|█▍        | 9641/65536 [1:47:48<10:34:49,  1.47it/s]
 15%|█▍        | 9642/65536 [1:47:49<10:20:03,  1.50it/s]
 15%|█▍        | 9643/65536 [1:47:50<10:24:12,  1.49it/s]
 15%|█▍        | 9644/65536 [1:47:50<10:30:10,  1.48it/s]
 15%|█▍        | 9645/65536 [1:47:51<10:31:38,  1.47it/s]
 15%|█▍        | 9646/65536 [1:47:52<10:19:23,  1.50it/s]
 15%|█▍        | 9647/65536 [1:47:52<10:29:43,  1.48it/s]
 15%|█▍        | 9648/65536 [1:47:53<10:30:16,  1.48it/s]
 15%|█▍        | 9649/65536 [1:47:54<10:20:49,  1.50it/s]
 15%|█▍        | 9650/65536 [1:47:54<10:23:45,  1.49it/s]
 15%|█▍        | 9651/65536 [1:47:55<10:21:09,  1.50it/s]
 15%|█▍        | 9652/65536 [1:47:56<10:14:13,  1.52it/s]
 15%|█▍        | 9653/65536 [1:47:56<10:02:45,  1.55it/s]
 15%|█▍        | 9654/65536 [1:47:57<10:04:34,  1.54it/s]
 15%|█▍        | 9655/65536 [1:47:58<10:11:58,  1.52it/s]
 15%|█▍        | 9656/65536 [1:47:58<10:41:49,  1.45it/s]
 15%|█▍        | 9657/65536 [1:47:59<10:51:23,  1.43it/s]
 15%|█▍        | 9658/65536 [1:48:00<10:33:41,  1.47it/s]
 15%|█▍        | 9659/65536 [1:48:00<10:25:17,  1.49it/s]
 15%|█▍        | 9660/65536 [1:48:01<10:20:26,  1.50it/s]
                                                         
{'loss': 1.0012, 'learning_rate': 8.69688992286029e-07, 'epoch': 596.3}

 15%|█▍        | 9660/65536 [1:48:01<10:20:26,  1.50it/s]
 15%|█▍        | 9661/65536 [1:48:02<10:13:51,  1.52it/s]
 15%|█▍        | 9662/65536 [1:48:02<10:13:36,  1.52it/s]
 15%|█▍        | 9663/65536 [1:48:03<10:16:37,  1.51it/s]
 15%|█▍        | 9664/65536 [1:48:04<10:05:23,  1.54it/s]
 15%|█▍        | 9665/65536 [1:48:04<10:22:40,  1.50it/s]
 15%|█▍        | 9666/65536 [1:48:05<10:19:46,  1.50it/s]
 15%|█▍        | 9667/65536 [1:48:06<10:24:23,  1.49it/s]
 15%|█▍        | 9668/65536 [1:48:06<10:29:04,  1.48it/s]
 15%|█▍        | 9669/65536 [1:48:07<10:31:15,  1.48it/s]
 15%|█▍        | 9670/65536 [1:48:08<10:28:22,  1.48it/s]
 15%|█▍        | 9671/65536 [1:48:08<10:21:39,  1.50it/s]
 15%|█▍        | 9672/65536 [1:48:09<10:24:48,  1.49it/s]
 15%|█▍        | 9673/65536 [1:48:10<10:06:43,  1.53it/s]
 15%|█▍        | 9674/65536 [1:48:10<10:28:36,  1.48it/s]
 15%|█▍        | 9675/65536 [1:48:11<10:09:20,  1.53it/s]
 15%|█▍        | 9676/65536 [1:48:12<10:09:58,  1.53it/s]
 15%|█▍        | 9677/65536 [1:48:12<10:06:35,  1.53it/s]
 15%|█▍        | 9678/65536 [1:48:13<10:16:42,  1.51it/s]
 15%|█▍        | 9679/65536 [1:48:14<10:26:36,  1.49it/s]
 15%|█▍        | 9680/65536 [1:48:14<10:25:53,  1.49it/s]
                                                         
{'loss': 0.9917, 'learning_rate': 8.69413493326803e-07, 'epoch': 597.53}

 15%|█▍        | 9680/65536 [1:48:14<10:25:53,  1.49it/s]
 15%|█▍        | 9681/65536 [1:48:15<10:14:46,  1.51it/s]
 15%|█▍        | 9682/65536 [1:48:16<10:15:23,  1.51it/s]
 15%|█▍        | 9683/65536 [1:48:16<10:20:48,  1.50it/s]
 15%|█▍        | 9684/65536 [1:48:17<10:30:45,  1.48it/s]
 15%|█▍        | 9685/65536 [1:48:18<10:37:23,  1.46it/s]
 15%|█▍        | 9686/65536 [1:48:18<10:35:16,  1.47it/s]
 15%|█▍        | 9687/65536 [1:48:19<10:38:14,  1.46it/s]
 15%|█▍        | 9688/65536 [1:48:20<10:39:04,  1.46it/s]
 15%|█▍        | 9689/65536 [1:48:21<10:32:48,  1.47it/s]
 15%|█▍        | 9690/65536 [1:48:21<10:49:25,  1.43it/s]
 15%|█▍        | 9691/65536 [1:48:22<10:40:09,  1.45it/s]
 15%|█▍        | 9692/65536 [1:48:23<10:29:51,  1.48it/s]
 15%|█▍        | 9693/65536 [1:48:23<10:19:40,  1.50it/s]
 15%|█▍        | 9694/65536 [1:48:24<10:23:29,  1.49it/s]
 15%|█▍        | 9695/65536 [1:48:25<10:25:11,  1.49it/s]
 15%|█▍        | 9696/65536 [1:48:25<10:23:22,  1.49it/s]
 15%|█▍        | 9697/65536 [1:48:26<10:36:41,  1.46it/s]
 15%|█▍        | 9698/65536 [1:48:27<10:37:09,  1.46it/s]
 15%|█▍        | 9699/65536 [1:48:27<10:48:00,  1.44it/s]
 15%|█▍        | 9700/65536 [1:48:28<10:39:26,  1.46it/s]
                                                         
{'loss': 0.9779, 'learning_rate': 8.691379943675769e-07, 'epoch': 598.77}

 15%|█▍        | 9700/65536 [1:48:28<10:39:26,  1.46it/s]
 15%|█▍        | 9701/65536 [1:48:29<10:32:34,  1.47it/s]
 15%|█▍        | 9702/65536 [1:48:29<10:22:33,  1.49it/s]
 15%|█▍        | 9703/65536 [1:48:30<10:30:41,  1.48it/s]
 15%|█▍        | 9704/65536 [1:48:31<10:33:32,  1.47it/s]
 15%|█▍        | 9705/65536 [1:48:31<10:32:16,  1.47it/s]
 15%|█▍        | 9706/65536 [1:48:32<10:41:40,  1.45it/s]
 15%|█▍        | 9707/65536 [1:48:33<10:32:43,  1.47it/s]
 15%|█▍        | 9708/65536 [1:48:33<10:18:49,  1.50it/s]
 15%|█▍        | 9709/65536 [1:48:34<10:12:37,  1.52it/s]
 15%|█▍        | 9710/65536 [1:48:35<10:30:44,  1.48it/s]
 15%|█▍        | 9711/65536 [1:48:35<10:32:06,  1.47it/s]
 15%|█▍        | 9712/65536 [1:48:36<10:15:13,  1.51it/s]
 15%|█▍        | 9713/65536 [1:48:37<10:12:23,  1.52it/s]
 15%|█▍        | 9714/65536 [1:48:37<10:11:27,  1.52it/s]
 15%|█▍        | 9715/65536 [1:48:38<10:20:55,  1.50it/s]
 15%|█▍        | 9716/65536 [1:48:39<10:16:30,  1.51it/s]
 15%|█▍        | 9717/65536 [1:48:39<10:27:51,  1.48it/s]
 15%|█▍        | 9718/65536 [1:48:40<10:21:23,  1.50it/s]
 15%|█▍        | 9719/65536 [1:48:41<10:26:12,  1.49it/s]
 15%|█▍        | 9720/65536 [1:48:41<10:21:05,  1.50it/s]
                                                         
{'loss': 0.9943, 'learning_rate': 8.688624954083506e-07, 'epoch': 600.0}

 15%|█▍        | 9720/65536 [1:48:41<10:21:05,  1.50it/s]
 15%|█▍        | 9721/65536 [1:48:42<10:39:11,  1.46it/s]
 15%|█▍        | 9722/65536 [1:48:43<10:34:06,  1.47it/s]
 15%|█▍        | 9723/65536 [1:48:43<10:32:32,  1.47it/s]
 15%|█▍        | 9724/65536 [1:48:44<10:22:01,  1.50it/s]
 15%|█▍        | 9725/65536 [1:48:45<10:17:18,  1.51it/s]
 15%|█▍        | 9726/65536 [1:48:45<10:08:03,  1.53it/s]
 15%|█▍        | 9727/65536 [1:48:46<10:07:21,  1.53it/s]
 15%|█▍        | 9728/65536 [1:48:47<10:23:41,  1.49it/s]
 15%|█▍        | 9729/65536 [1:48:47<10:09:35,  1.53it/s]
 15%|█▍        | 9730/65536 [1:48:48<10:15:02,  1.51it/s]
 15%|█▍        | 9731/65536 [1:48:49<10:14:28,  1.51it/s]
 15%|█▍        | 9732/65536 [1:48:49<10:16:43,  1.51it/s]
 15%|█▍        | 9733/65536 [1:48:50<10:20:40,  1.50it/s]
 15%|█▍        | 9734/65536 [1:48:51<10:22:11,  1.49it/s]
 15%|█▍        | 9735/65536 [1:48:51<10:31:56,  1.47it/s]
 15%|█▍        | 9736/65536 [1:48:52<10:29:40,  1.48it/s]
 15%|█▍        | 9737/65536 [1:48:53<10:30:53,  1.47it/s]
 15%|█▍        | 9738/65536 [1:48:53<10:15:17,  1.51it/s]
 15%|█▍        | 9739/65536 [1:48:54<10:23:02,  1.49it/s]
 15%|█▍        | 9740/65536 [1:48:55<10:08:00,  1.53it/s]
                                                         
{'loss': 1.001, 'learning_rate': 8.685869964491245e-07, 'epoch': 601.23}

 15%|█▍        | 9740/65536 [1:48:55<10:08:00,  1.53it/s]
 15%|█▍        | 9741/65536 [1:48:55<10:08:56,  1.53it/s]
 15%|█▍        | 9742/65536 [1:48:56<10:13:38,  1.52it/s]
 15%|█▍        | 9743/65536 [1:48:57<10:29:59,  1.48it/s]
 15%|█▍        | 9744/65536 [1:48:57<10:33:51,  1.47it/s]
 15%|█▍        | 9745/65536 [1:48:58<10:46:10,  1.44it/s]
 15%|█▍        | 9746/65536 [1:48:59<10:40:13,  1.45it/s]
 15%|█▍        | 9747/65536 [1:49:00<10:30:44,  1.47it/s]
 15%|█▍        | 9748/65536 [1:49:00<10:43:28,  1.44it/s]
 15%|█▍        | 9749/65536 [1:49:01<10:32:16,  1.47it/s]
 15%|█▍        | 9750/65536 [1:49:02<10:30:49,  1.47it/s]
 15%|█▍        | 9751/65536 [1:49:02<10:33:42,  1.47it/s]
 15%|█▍        | 9752/65536 [1:49:03<10:33:49,  1.47it/s]
 15%|█▍        | 9753/65536 [1:49:04<10:46:37,  1.44it/s]
 15%|█▍        | 9754/65536 [1:49:04<10:37:06,  1.46it/s]
 15%|█▍        | 9755/65536 [1:49:05<10:47:24,  1.44it/s]
 15%|█▍        | 9756/65536 [1:49:06<10:38:20,  1.46it/s]
 15%|█▍        | 9757/65536 [1:49:06<10:29:17,  1.48it/s]
 15%|█▍        | 9758/65536 [1:49:07<10:28:36,  1.48it/s]
 15%|█▍        | 9759/65536 [1:49:08<10:20:24,  1.50it/s]
 15%|█▍        | 9760/65536 [1:49:08<10:12:05,  1.52it/s]
                                                         
{'loss': 0.9672, 'learning_rate': 8.683114974898983e-07, 'epoch': 602.47}

 15%|█▍        | 9760/65536 [1:49:08<10:12:05,  1.52it/s]
 15%|█▍        | 9761/65536 [1:49:09<10:13:51,  1.51it/s]
 15%|█▍        | 9762/65536 [1:49:10<10:27:23,  1.48it/s]
 15%|█▍        | 9763/65536 [1:49:10<10:26:16,  1.48it/s]
 15%|█▍        | 9764/65536 [1:49:11<10:12:00,  1.52it/s]
 15%|█▍        | 9765/65536 [1:49:12<10:15:06,  1.51it/s]
 15%|█▍        | 9766/65536 [1:49:12<10:23:08,  1.49it/s]
 15%|█▍        | 9767/65536 [1:49:13<10:28:08,  1.48it/s]
 15%|█▍        | 9768/65536 [1:49:14<10:31:57,  1.47it/s]
 15%|█▍        | 9769/65536 [1:49:14<10:57:15,  1.41it/s]
 15%|█▍        | 9770/65536 [1:49:15<11:00:47,  1.41it/s]
 15%|█▍        | 9771/65536 [1:49:16<10:54:14,  1.42it/s]
 15%|█▍        | 9772/65536 [1:49:17<11:02:34,  1.40it/s]
 15%|█▍        | 9773/65536 [1:49:17<10:38:04,  1.46it/s]
 15%|█▍        | 9774/65536 [1:49:18<10:26:37,  1.48it/s]
 15%|█▍        | 9775/65536 [1:49:19<10:57:25,  1.41it/s]
 15%|█▍        | 9776/65536 [1:49:19<10:45:38,  1.44it/s]
 15%|█▍        | 9777/65536 [1:49:20<10:25:22,  1.49it/s]
 15%|█▍        | 9778/65536 [1:49:21<10:20:03,  1.50it/s]
 15%|█▍        | 9779/65536 [1:49:21<10:08:13,  1.53it/s]
 15%|█▍        | 9780/65536 [1:49:22<10:07:03,  1.53it/s]
                                                         
{'loss': 0.9631, 'learning_rate': 8.680359985306722e-07, 'epoch': 603.7}

 15%|█▍        | 9780/65536 [1:49:22<10:07:03,  1.53it/s]
 15%|█▍        | 9781/65536 [1:49:23<10:25:08,  1.49it/s]
 15%|█▍        | 9782/65536 [1:49:23<10:27:12,  1.48it/s]
 15%|█▍        | 9783/65536 [1:49:24<10:16:16,  1.51it/s]
 15%|█▍        | 9784/65536 [1:49:25<10:16:59,  1.51it/s]
 15%|█▍        | 9785/65536 [1:49:25<10:30:35,  1.47it/s]
 15%|█▍        | 9786/65536 [1:49:26<10:33:00,  1.47it/s]
 15%|█▍        | 9787/65536 [1:49:27<10:18:39,  1.50it/s]
 15%|█▍        | 9788/65536 [1:49:27<10:23:12,  1.49it/s]
 15%|█▍        | 9789/65536 [1:49:28<10:44:36,  1.44it/s]
 15%|█▍        | 9790/65536 [1:49:29<10:48:57,  1.43it/s]
 15%|█▍        | 9791/65536 [1:49:29<10:39:40,  1.45it/s]
 15%|█▍        | 9792/65536 [1:49:30<10:51:20,  1.43it/s]
 15%|█▍        | 9793/65536 [1:49:31<10:44:41,  1.44it/s]
 15%|█▍        | 9794/65536 [1:49:32<10:46:33,  1.44it/s]
 15%|█▍        | 9795/65536 [1:49:32<10:36:29,  1.46it/s]
 15%|█▍        | 9796/65536 [1:49:33<10:17:52,  1.50it/s]
 15%|█▍        | 9797/65536 [1:49:33<9:59:51,  1.55it/s] 
 15%|█▍        | 9798/65536 [1:49:34<10:01:47,  1.54it/s]
 15%|█▍        | 9799/65536 [1:49:35<10:13:39,  1.51it/s]
 15%|█▍        | 9800/65536 [1:49:35<10:15:07,  1.51it/s]
                                                         
{'loss': 0.9909, 'learning_rate': 8.677604995714461e-07, 'epoch': 604.94}

 15%|█▍        | 9800/65536 [1:49:35<10:15:07,  1.51it/s]
 15%|█▍        | 9801/65536 [1:49:36<10:02:05,  1.54it/s]
 15%|█▍        | 9802/65536 [1:49:37<10:25:56,  1.48it/s]
 15%|█▍        | 9803/65536 [1:49:37<10:22:53,  1.49it/s]
 15%|█▍        | 9804/65536 [1:49:38<10:16:10,  1.51it/s]
 15%|█▍        | 9805/65536 [1:49:39<10:24:13,  1.49it/s]
 15%|█▍        | 9806/65536 [1:49:39<10:05:04,  1.54it/s]
 15%|█▍        | 9807/65536 [1:49:40<10:17:23,  1.50it/s]
 15%|█▍        | 9808/65536 [1:49:41<10:21:21,  1.49it/s]
 15%|█▍        | 9809/65536 [1:49:41<10:22:59,  1.49it/s]
 15%|█▍        | 9810/65536 [1:49:42<10:26:05,  1.48it/s]
 15%|█▍        | 9811/65536 [1:49:43<10:21:20,  1.49it/s]
 15%|█▍        | 9812/65536 [1:49:43<10:26:26,  1.48it/s]
 15%|█▍        | 9813/65536 [1:49:44<10:24:07,  1.49it/s]
 15%|█▍        | 9814/65536 [1:49:45<10:24:31,  1.49it/s]
 15%|█▍        | 9815/65536 [1:49:45<10:24:06,  1.49it/s]
 15%|█▍        | 9816/65536 [1:49:46<10:31:41,  1.47it/s]
 15%|█▍        | 9817/65536 [1:49:47<10:18:22,  1.50it/s]
 15%|█▍        | 9818/65536 [1:49:48<10:37:59,  1.46it/s]
 15%|█▍        | 9819/65536 [1:49:48<10:36:15,  1.46it/s]
 15%|█▍        | 9820/65536 [1:49:49<10:22:40,  1.49it/s]
                                                         
{'loss': 0.997, 'learning_rate': 8.674850006122198e-07, 'epoch': 606.17}

 15%|█▍        | 9820/65536 [1:49:49<10:22:40,  1.49it/s]
 15%|█▍        | 9821/65536 [1:49:50<10:21:43,  1.49it/s]
 15%|█▍        | 9822/65536 [1:49:50<10:25:26,  1.48it/s]
 15%|█▍        | 9823/65536 [1:49:51<10:15:58,  1.51it/s]
 15%|█▍        | 9824/65536 [1:49:52<10:28:38,  1.48it/s]
 15%|█▍        | 9825/65536 [1:49:52<10:26:00,  1.48it/s]
 15%|█▍        | 9826/65536 [1:49:53<10:20:34,  1.50it/s]
 15%|█▍        | 9827/65536 [1:49:54<10:21:57,  1.49it/s]
 15%|█▍        | 9828/65536 [1:49:54<10:24:34,  1.49it/s]
 15%|█▍        | 9829/65536 [1:49:55<10:32:24,  1.47it/s]
 15%|█▍        | 9830/65536 [1:49:56<10:40:08,  1.45it/s]
 15%|█▌        | 9831/65536 [1:49:56<10:10:43,  1.52it/s]
 15%|█▌        | 9832/65536 [1:49:57<10:04:15,  1.54it/s]
 15%|█▌        | 9833/65536 [1:49:58<10:08:13,  1.53it/s]
 15%|█▌        | 9834/65536 [1:49:58<10:27:17,  1.48it/s]
 15%|█▌        | 9835/65536 [1:49:59<10:24:39,  1.49it/s]
 15%|█▌        | 9836/65536 [1:50:00<10:09:42,  1.52it/s]
 15%|█▌        | 9837/65536 [1:50:00<10:06:18,  1.53it/s]
 15%|█▌        | 9838/65536 [1:50:01<10:08:02,  1.53it/s]
 15%|█▌        | 9839/65536 [1:50:01<10:02:05,  1.54it/s]
 15%|█▌        | 9840/65536 [1:50:02<10:17:46,  1.50it/s]
                                                         
{'loss': 1.0081, 'learning_rate': 8.672095016529937e-07, 'epoch': 607.41}

 15%|█▌        | 9840/65536 [1:50:02<10:17:46,  1.50it/s]
 15%|█▌        | 9841/65536 [1:50:03<10:21:38,  1.49it/s]
 15%|█▌        | 9842/65536 [1:50:04<10:37:28,  1.46it/s]
 15%|█▌        | 9843/65536 [1:50:04<10:27:52,  1.48it/s]
 15%|█▌        | 9844/65536 [1:50:05<10:10:34,  1.52it/s]
 15%|█▌        | 9845/65536 [1:50:06<10:37:56,  1.45it/s]
 15%|█▌        | 9846/65536 [1:50:06<10:28:35,  1.48it/s]
 15%|█▌        | 9847/65536 [1:50:07<10:23:45,  1.49it/s]
 15%|█▌        | 9848/65536 [1:50:08<10:17:09,  1.50it/s]
 15%|█▌        | 9849/65536 [1:50:08<10:21:36,  1.49it/s]
 15%|█▌        | 9850/65536 [1:50:09<10:36:24,  1.46it/s]
 15%|█▌        | 9851/65536 [1:50:10<10:43:09,  1.44it/s]
 15%|█▌        | 9852/65536 [1:50:10<10:48:24,  1.43it/s]
 15%|█▌        | 9853/65536 [1:50:11<10:40:33,  1.45it/s]
 15%|█▌        | 9854/65536 [1:50:12<10:29:48,  1.47it/s]
 15%|█▌        | 9855/65536 [1:50:12<10:28:18,  1.48it/s]
 15%|█▌        | 9856/65536 [1:50:13<10:24:14,  1.49it/s]
 15%|█▌        | 9857/65536 [1:50:14<10:12:07,  1.52it/s]
 15%|█▌        | 9858/65536 [1:50:14<9:59:24,  1.55it/s] 
 15%|█▌        | 9859/65536 [1:50:15<10:02:45,  1.54it/s]
 15%|█▌        | 9860/65536 [1:50:16<10:05:33,  1.53it/s]
                                                         
{'loss': 0.9748, 'learning_rate': 8.669340026937675e-07, 'epoch': 608.64}

 15%|█▌        | 9860/65536 [1:50:16<10:05:33,  1.53it/s]
 15%|█▌        | 9861/65536 [1:50:16<10:15:37,  1.51it/s]
 15%|█▌        | 9862/65536 [1:50:17<10:16:38,  1.50it/s]
 15%|█▌        | 9863/65536 [1:50:18<10:06:08,  1.53it/s]
 15%|█▌        | 9864/65536 [1:50:18<10:23:02,  1.49it/s]
 15%|█▌        | 9865/65536 [1:50:19<9:59:19,  1.55it/s] 
 15%|█▌        | 9866/65536 [1:50:20<10:10:04,  1.52it/s]
 15%|█▌        | 9867/65536 [1:50:20<10:02:57,  1.54it/s]
 15%|█▌        | 9868/65536 [1:50:21<10:15:56,  1.51it/s]
 15%|█▌        | 9869/65536 [1:50:22<10:05:59,  1.53it/s]
 15%|█▌        | 9870/65536 [1:50:22<10:14:38,  1.51it/s]
 15%|█▌        | 9871/65536 [1:50:23<10:23:38,  1.49it/s]
 15%|█▌        | 9872/65536 [1:50:24<10:21:22,  1.49it/s]
 15%|█▌        | 9873/65536 [1:50:24<10:30:16,  1.47it/s]
 15%|█▌        | 9874/65536 [1:50:25<10:20:16,  1.50it/s]
 15%|█▌        | 9875/65536 [1:50:26<10:06:26,  1.53it/s]
 15%|█▌        | 9876/65536 [1:50:26<10:19:24,  1.50it/s]
 15%|█▌        | 9877/65536 [1:50:27<10:17:41,  1.50it/s]
 15%|█▌        | 9878/65536 [1:50:28<10:00:14,  1.55it/s]
 15%|█▌        | 9879/65536 [1:50:28<10:17:36,  1.50it/s]
 15%|█▌        | 9880/65536 [1:50:29<10:21:54,  1.49it/s]
                                                         
{'loss': 0.9989, 'learning_rate': 8.666585037345414e-07, 'epoch': 609.88}

 15%|█▌        | 9880/65536 [1:50:29<10:21:54,  1.49it/s]
 15%|█▌        | 9881/65536 [1:50:30<10:10:35,  1.52it/s]
 15%|█▌        | 9882/65536 [1:50:30<10:01:45,  1.54it/s]
 15%|█▌        | 9883/65536 [1:50:31<10:31:12,  1.47it/s]
 15%|█▌        | 9884/65536 [1:50:32<10:30:07,  1.47it/s]
 15%|█▌        | 9885/65536 [1:50:32<10:11:45,  1.52it/s]
 15%|█▌        | 9886/65536 [1:50:33<10:09:27,  1.52it/s]
 15%|█▌        | 9887/65536 [1:50:34<10:16:19,  1.50it/s]
 15%|█▌        | 9888/65536 [1:50:34<10:08:07,  1.53it/s]
 15%|█▌        | 9889/65536 [1:50:35<10:20:44,  1.49it/s]
 15%|█▌        | 9890/65536 [1:50:36<10:30:39,  1.47it/s]
 15%|█▌        | 9891/65536 [1:50:36<10:14:50,  1.51it/s]
 15%|█▌        | 9892/65536 [1:50:37<10:31:43,  1.47it/s]
 15%|█▌        | 9893/65536 [1:50:38<10:39:05,  1.45it/s]
 15%|█▌        | 9894/65536 [1:50:38<10:40:16,  1.45it/s]
 15%|█▌        | 9895/65536 [1:50:39<10:35:58,  1.46it/s]
 15%|█▌        | 9896/65536 [1:50:40<10:36:32,  1.46it/s]
 15%|█▌        | 9897/65536 [1:50:40<10:21:46,  1.49it/s]
 15%|█▌        | 9898/65536 [1:50:41<10:06:57,  1.53it/s]
 15%|█▌        | 9899/65536 [1:50:42<10:20:35,  1.49it/s]
 15%|█▌        | 9900/65536 [1:50:42<10:33:38,  1.46it/s]
                                                         
{'loss': 0.9904, 'learning_rate': 8.663830047753152e-07, 'epoch': 611.11}

 15%|█▌        | 9900/65536 [1:50:42<10:33:38,  1.46it/s]
 15%|█▌        | 9901/65536 [1:50:43<10:50:14,  1.43it/s]
 15%|█▌        | 9902/65536 [1:50:44<10:39:53,  1.45it/s]
 15%|█▌        | 9903/65536 [1:50:44<10:28:13,  1.48it/s]
 15%|█▌        | 9904/65536 [1:50:45<10:23:52,  1.49it/s]
 15%|█▌        | 9905/65536 [1:50:46<10:09:54,  1.52it/s]
 15%|█▌        | 9906/65536 [1:50:46<10:16:52,  1.50it/s]
 15%|█▌        | 9907/65536 [1:50:47<10:06:31,  1.53it/s]
 15%|█▌        | 9908/65536 [1:50:48<10:11:09,  1.52it/s]
 15%|█▌        | 9909/65536 [1:50:48<10:11:46,  1.52it/s]
 15%|█▌        | 9910/65536 [1:50:49<10:24:32,  1.48it/s]
 15%|█▌        | 9911/65536 [1:50:50<10:09:39,  1.52it/s]
 15%|█▌        | 9912/65536 [1:50:50<10:19:47,  1.50it/s]
 15%|█▌        | 9913/65536 [1:50:51<10:09:33,  1.52it/s]
 15%|█▌        | 9914/65536 [1:50:52<10:16:51,  1.50it/s]
 15%|█▌        | 9915/65536 [1:50:52<10:52:45,  1.42it/s]
 15%|█▌        | 9916/65536 [1:50:53<10:45:58,  1.44it/s]
 15%|█▌        | 9917/65536 [1:50:54<10:52:11,  1.42it/s]
 15%|█▌        | 9918/65536 [1:50:55<10:38:39,  1.45it/s]
 15%|█▌        | 9919/65536 [1:50:55<10:31:41,  1.47it/s]
 15%|█▌        | 9920/65536 [1:50:56<10:38:52,  1.45it/s]
                                                         
{'loss': 0.9763, 'learning_rate': 8.661075058160891e-07, 'epoch': 612.35}

 15%|█▌        | 9920/65536 [1:50:56<10:38:52,  1.45it/s]
 15%|█▌        | 9921/65536 [1:50:57<10:34:22,  1.46it/s]
 15%|█▌        | 9922/65536 [1:50:57<10:19:02,  1.50it/s]
 15%|█▌        | 9923/65536 [1:50:58<10:12:39,  1.51it/s]
 15%|█▌        | 9924/65536 [1:50:58<10:06:08,  1.53it/s]
 15%|█▌        | 9925/65536 [1:50:59<9:55:46,  1.56it/s] 
 15%|█▌        | 9926/65536 [1:51:00<9:55:06,  1.56it/s]
 15%|█▌        | 9927/65536 [1:51:00<10:01:06,  1.54it/s]
 15%|█▌        | 9928/65536 [1:51:01<10:00:11,  1.54it/s]
 15%|█▌        | 9929/65536 [1:51:02<10:05:17,  1.53it/s]
 15%|█▌        | 9930/65536 [1:51:02<10:33:52,  1.46it/s]
 15%|█▌        | 9931/65536 [1:51:03<10:33:36,  1.46it/s]
 15%|█▌        | 9932/65536 [1:51:04<10:28:32,  1.47it/s]
 15%|█▌        | 9933/65536 [1:51:04<10:22:24,  1.49it/s]
 15%|█▌        | 9934/65536 [1:51:05<10:23:07,  1.49it/s]
 15%|█▌        | 9935/65536 [1:51:06<10:07:13,  1.53it/s]
 15%|█▌        | 9936/65536 [1:51:06<10:13:24,  1.51it/s]
 15%|█▌        | 9937/65536 [1:51:07<10:15:00,  1.51it/s]
 15%|█▌        | 9938/65536 [1:51:08<10:09:18,  1.52it/s]
 15%|█▌        | 9939/65536 [1:51:08<10:00:19,  1.54it/s]
 15%|█▌        | 9940/65536 [1:51:09<10:07:09,  1.53it/s]
                                                         
{'loss': 1.0005, 'learning_rate': 8.65832006856863e-07, 'epoch': 613.58}

 15%|█▌        | 9940/65536 [1:51:09<10:07:09,  1.53it/s]
 15%|█▌        | 9941/65536 [1:51:10<10:14:28,  1.51it/s]
 15%|█▌        | 9942/65536 [1:51:10<10:11:25,  1.52it/s]
 15%|█▌        | 9943/65536 [1:51:11<10:24:34,  1.48it/s]
 15%|█▌        | 9944/65536 [1:51:12<10:45:57,  1.43it/s]
 15%|█▌        | 9945/65536 [1:51:13<10:33:49,  1.46it/s]
 15%|█▌        | 9946/65536 [1:51:13<10:11:13,  1.52it/s]
 15%|█▌        | 9947/65536 [1:51:14<10:22:39,  1.49it/s]
 15%|█▌        | 9948/65536 [1:51:14<10:27:15,  1.48it/s]
 15%|█▌        | 9949/65536 [1:51:15<10:18:41,  1.50it/s]
 15%|█▌        | 9950/65536 [1:51:16<10:22:34,  1.49it/s]
 15%|█▌        | 9951/65536 [1:51:17<10:31:23,  1.47it/s]
 15%|█▌        | 9952/65536 [1:51:17<10:20:36,  1.49it/s]
 15%|█▌        | 9953/65536 [1:51:18<10:10:16,  1.52it/s]
 15%|█▌        | 9954/65536 [1:51:18<10:04:35,  1.53it/s]
 15%|█▌        | 9955/65536 [1:51:19<10:02:32,  1.54it/s]
 15%|█▌        | 9956/65536 [1:51:20<10:06:02,  1.53it/s]
 15%|█▌        | 9957/65536 [1:51:20<9:49:16,  1.57it/s] 
 15%|█▌        | 9958/65536 [1:51:21<10:13:15,  1.51it/s]
 15%|█▌        | 9959/65536 [1:51:22<10:18:56,  1.50it/s]
 15%|█▌        | 9960/65536 [1:51:22<10:19:34,  1.49it/s]
                                                         
{'loss': 0.9869, 'learning_rate': 8.655565078976368e-07, 'epoch': 614.81}

 15%|█▌        | 9960/65536 [1:51:22<10:19:34,  1.49it/s]
 15%|█▌        | 9961/65536 [1:51:23<10:38:48,  1.45it/s]
 15%|█▌        | 9962/65536 [1:51:24<10:32:18,  1.46it/s]
 15%|█▌        | 9963/65536 [1:51:24<10:21:47,  1.49it/s]
 15%|█▌        | 9964/65536 [1:51:25<10:45:10,  1.44it/s]
 15%|█▌        | 9965/65536 [1:51:26<10:40:10,  1.45it/s]
 15%|█▌        | 9966/65536 [1:51:27<10:27:36,  1.48it/s]
 15%|█▌        | 9967/65536 [1:51:27<10:30:01,  1.47it/s]
 15%|█▌        | 9968/65536 [1:51:28<10:31:00,  1.47it/s]
 15%|█▌        | 9969/65536 [1:51:29<10:26:38,  1.48it/s]
 15%|█▌        | 9970/65536 [1:51:29<10:36:11,  1.46it/s]
 15%|█▌        | 9971/65536 [1:51:30<10:07:24,  1.52it/s]
 15%|█▌        | 9972/65536 [1:51:30<9:52:54,  1.56it/s] 
 15%|█▌        | 9973/65536 [1:51:31<10:06:16,  1.53it/s]
 15%|█▌        | 9974/65536 [1:51:32<10:27:49,  1.48it/s]
 15%|█▌        | 9975/65536 [1:51:33<10:14:12,  1.51it/s]
 15%|█▌        | 9976/65536 [1:51:33<10:18:36,  1.50it/s]
 15%|█▌        | 9977/65536 [1:51:34<10:12:12,  1.51it/s]
 15%|█▌        | 9978/65536 [1:51:35<10:14:50,  1.51it/s]
 15%|█▌        | 9979/65536 [1:51:35<10:07:51,  1.52it/s]
 15%|█▌        | 9980/65536 [1:51:36<10:24:05,  1.48it/s]
                                                         
{'loss': 0.9931, 'learning_rate': 8.652810089384107e-07, 'epoch': 616.05}

 15%|█▌        | 9980/65536 [1:51:36<10:24:05,  1.48it/s]
 15%|█▌        | 9981/65536 [1:51:37<10:22:48,  1.49it/s]
 15%|█▌        | 9982/65536 [1:51:37<10:32:00,  1.46it/s]
 15%|█▌        | 9983/65536 [1:51:38<10:21:34,  1.49it/s]
 15%|█▌        | 9984/65536 [1:51:39<10:17:34,  1.50it/s]
 15%|█▌        | 9985/65536 [1:51:39<10:26:31,  1.48it/s]
 15%|█▌        | 9986/65536 [1:51:40<10:22:16,  1.49it/s]
 15%|█▌        | 9987/65536 [1:51:41<10:08:36,  1.52it/s]
 15%|█▌        | 9988/65536 [1:51:41<10:07:03,  1.53it/s]
 15%|█▌        | 9989/65536 [1:51:42<10:13:40,  1.51it/s]
 15%|█▌        | 9990/65536 [1:51:43<10:30:54,  1.47it/s]
 15%|█▌        | 9991/65536 [1:51:43<10:27:30,  1.48it/s]
 15%|█▌        | 9992/65536 [1:51:44<10:34:31,  1.46it/s]
 15%|█▌        | 9993/65536 [1:51:45<10:20:39,  1.49it/s]
 15%|█▌        | 9994/65536 [1:51:45<10:22:03,  1.49it/s]
 15%|█▌        | 9995/65536 [1:51:46<10:07:06,  1.52it/s]
 15%|█▌        | 9996/65536 [1:51:47<10:20:08,  1.49it/s]
 15%|█▌        | 9997/65536 [1:51:47<10:22:02,  1.49it/s]
 15%|█▌        | 9998/65536 [1:51:48<10:23:56,  1.48it/s]
 15%|█▌        | 9999/65536 [1:51:49<10:18:58,  1.50it/s]
 15%|█▌        | 10000/65536 [1:51:49<10:20:55,  1.49it/s]
                                                          
{'loss': 0.9815, 'learning_rate': 8.650055099791844e-07, 'epoch': 617.28}

 15%|█▌        | 10000/65536 [1:51:49<10:20:55,  1.49it/s]Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}

 15%|█▌        | 10001/65536 [1:52:00<56:44:30,  3.68s/it]
 15%|█▌        | 10002/65536 [1:52:01<42:55:37,  2.78s/it]
 15%|█▌        | 10003/65536 [1:52:01<33:00:13,  2.14s/it]
 15%|█▌        | 10004/65536 [1:52:02<26:20:58,  1.71s/it]
 15%|█▌        | 10005/65536 [1:52:03<21:57:14,  1.42s/it]
 15%|█▌        | 10006/65536 [1:52:04<18:43:07,  1.21s/it]
 15%|█▌        | 10007/65536 [1:52:04<16:22:45,  1.06s/it]
 15%|█▌        | 10008/65536 [1:52:05<14:49:20,  1.04it/s]
 15%|█▌        | 10009/65536 [1:52:06<13:19:57,  1.16it/s]
 15%|█▌        | 10010/65536 [1:52:06<12:22:31,  1.25it/s]
 15%|█▌        | 10011/65536 [1:52:07<11:57:26,  1.29it/s]/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

 15%|█▌        | 10012/65536 [1:52:08<12:02:12,  1.28it/s]
 15%|█▌        | 10013/65536 [1:52:08<11:21:30,  1.36it/s]
 15%|█▌        | 10014/65536 [1:52:09<11:12:05,  1.38it/s]
 15%|█▌        | 10015/65536 [1:52:10<11:00:07,  1.40it/s]
 15%|█▌        | 10016/65536 [1:52:10<10:48:15,  1.43it/s]
 15%|█▌        | 10017/65536 [1:52:11<10:29:58,  1.47it/s]
 15%|█▌        | 10018/65536 [1:52:12<10:36:36,  1.45it/s]
 15%|█▌        | 10019/65536 [1:52:12<10:27:40,  1.47it/s]
 15%|█▌        | 10020/65536 [1:52:13<10:16:55,  1.50it/s]
                                                          
{'loss': 1.001, 'learning_rate': 8.647300110199584e-07, 'epoch': 618.52}

 15%|█▌        | 10020/65536 [1:52:13<10:16:55,  1.50it/s]
 15%|█▌        | 10021/65536 [1:52:14<10:35:15,  1.46it/s]
 15%|█▌        | 10022/65536 [1:52:14<10:35:19,  1.46it/s]
 15%|█▌        | 10023/65536 [1:52:15<10:38:32,  1.45it/s]
 15%|█▌        | 10024/65536 [1:52:16<10:40:36,  1.44it/s]
 15%|█▌        | 10025/65536 [1:52:17<10:42:08,  1.44it/s]
 15%|█▌        | 10026/65536 [1:52:17<10:45:35,  1.43it/s]
 15%|█▌        | 10027/65536 [1:52:18<10:30:36,  1.47it/s]
 15%|█▌        | 10028/65536 [1:52:19<10:53:25,  1.42it/s]
 15%|█▌        | 10029/65536 [1:52:19<10:40:35,  1.44it/s]
 15%|█▌        | 10030/65536 [1:52:20<10:34:35,  1.46it/s]
 15%|█▌        | 10031/65536 [1:52:21<10:48:55,  1.43it/s]
 15%|█▌        | 10032/65536 [1:52:21<10:42:24,  1.44it/s]
 15%|█▌        | 10033/65536 [1:52:22<10:48:32,  1.43it/s]
 15%|█▌        | 10034/65536 [1:52:23<10:46:36,  1.43it/s]
 15%|█▌        | 10035/65536 [1:52:24<10:34:07,  1.46it/s]
 15%|█▌        | 10036/65536 [1:52:24<10:38:07,  1.45it/s]
 15%|█▌        | 10037/65536 [1:52:25<10:18:47,  1.49it/s]
 15%|█▌        | 10038/65536 [1:52:26<10:27:06,  1.47it/s]
 15%|█▌        | 10039/65536 [1:52:26<10:45:01,  1.43it/s]
 15%|█▌        | 10040/65536 [1:52:27<10:46:03,  1.43it/s]
                                                          
{'loss': 0.9659, 'learning_rate': 8.644545120607322e-07, 'epoch': 619.75}

 15%|█▌        | 10040/65536 [1:52:27<10:46:03,  1.43it/s]
 15%|█▌        | 10041/65536 [1:52:28<11:01:16,  1.40it/s]
 15%|█▌        | 10042/65536 [1:52:28<10:54:45,  1.41it/s]
 15%|█▌        | 10043/65536 [1:52:29<10:59:31,  1.40it/s]
 15%|█▌        | 10044/65536 [1:52:30<11:06:46,  1.39it/s]
 15%|█▌        | 10045/65536 [1:52:31<11:12:40,  1.37it/s]
 15%|█▌        | 10046/65536 [1:52:31<10:39:38,  1.45it/s]
 15%|█▌        | 10047/65536 [1:52:32<10:25:48,  1.48it/s]
 15%|█▌        | 10048/65536 [1:52:33<10:22:45,  1.49it/s]
 15%|█▌        | 10049/65536 [1:52:33<10:23:04,  1.48it/s]
 15%|█▌        | 10050/65536 [1:52:34<10:24:33,  1.48it/s]
 15%|█▌        | 10051/65536 [1:52:35<10:30:06,  1.47it/s]
 15%|█▌        | 10052/65536 [1:52:35<10:49:26,  1.42it/s]
 15%|█▌        | 10053/65536 [1:52:36<11:00:03,  1.40it/s]
 15%|█▌        | 10054/65536 [1:52:37<10:56:55,  1.41it/s]
 15%|█▌        | 10055/65536 [1:52:37<10:41:58,  1.44it/s]
 15%|█▌        | 10056/65536 [1:52:38<10:42:29,  1.44it/s]
 15%|█▌        | 10057/65536 [1:52:39<10:33:22,  1.46it/s]
 15%|█▌        | 10058/65536 [1:52:39<10:35:07,  1.46it/s]
 15%|█▌        | 10059/65536 [1:52:40<10:42:32,  1.44it/s]
 15%|█▌        | 10060/65536 [1:52:41<10:43:03,  1.44it/s]
                                                          
{'loss': 0.997, 'learning_rate': 8.64179013101506e-07, 'epoch': 620.99}

 15%|█▌        | 10060/65536 [1:52:41<10:43:03,  1.44it/s]
 15%|█▌        | 10061/65536 [1:52:42<11:27:26,  1.34it/s]
 15%|█▌        | 10062/65536 [1:52:42<11:21:16,  1.36it/s]
 15%|█▌        | 10063/65536 [1:52:43<10:46:11,  1.43it/s]
 15%|█▌        | 10064/65536 [1:52:44<10:48:10,  1.43it/s]
 15%|█▌        | 10065/65536 [1:52:44<10:45:50,  1.43it/s]
 15%|█▌        | 10066/65536 [1:52:45<10:34:57,  1.46it/s]
 15%|█▌        | 10067/65536 [1:52:46<10:18:42,  1.49it/s]
 15%|█▌        | 10068/65536 [1:52:46<10:22:25,  1.49it/s]
 15%|█▌        | 10069/65536 [1:52:47<10:20:29,  1.49it/s]
 15%|█▌        | 10070/65536 [1:52:48<10:01:39,  1.54it/s]
 15%|█▌        | 10071/65536 [1:52:48<9:57:13,  1.55it/s] 
 15%|█▌        | 10072/65536 [1:52:49<10:04:11,  1.53it/s]
 15%|█▌        | 10073/65536 [1:52:50<10:06:09,  1.52it/s]
 15%|█▌        | 10074/65536 [1:52:50<10:07:11,  1.52it/s]
 15%|█▌        | 10075/65536 [1:52:51<10:03:31,  1.53it/s]
 15%|█▌        | 10076/65536 [1:52:52<10:17:42,  1.50it/s]
 15%|█▌        | 10077/65536 [1:52:52<10:46:03,  1.43it/s]
 15%|█▌        | 10078/65536 [1:52:53<10:43:58,  1.44it/s]
 15%|█▌        | 10079/65536 [1:52:54<10:32:30,  1.46it/s]
 15%|█▌        | 10080/65536 [1:52:54<10:23:07,  1.48it/s]
                                                          
{'loss': 1.0122, 'learning_rate': 8.639035141422799e-07, 'epoch': 622.22}

 15%|█▌        | 10080/65536 [1:52:54<10:23:07,  1.48it/s]
 15%|█▌        | 10081/65536 [1:52:55<10:24:27,  1.48it/s]
 15%|█▌        | 10082/65536 [1:52:56<10:34:29,  1.46it/s]
 15%|█▌        | 10083/65536 [1:52:57<10:36:40,  1.45it/s]
 15%|█▌        | 10084/65536 [1:52:57<10:18:53,  1.49it/s]
 15%|█▌        | 10085/65536 [1:52:58<10:22:42,  1.48it/s]
 15%|█▌        | 10086/65536 [1:52:59<10:18:44,  1.49it/s]
 15%|█▌        | 10087/65536 [1:52:59<10:39:08,  1.45it/s]
 15%|█▌        | 10088/65536 [1:53:00<10:51:14,  1.42it/s]
 15%|█▌        | 10089/65536 [1:53:01<10:43:54,  1.44it/s]
 15%|█▌        | 10090/65536 [1:53:01<10:21:08,  1.49it/s]
 15%|█▌        | 10091/65536 [1:53:02<10:18:27,  1.49it/s]
 15%|█▌        | 10092/65536 [1:53:03<10:43:57,  1.43it/s]
 15%|█▌        | 10093/65536 [1:53:03<11:03:24,  1.39it/s]
 15%|█▌        | 10094/65536 [1:53:04<11:05:04,  1.39it/s]
 15%|█▌        | 10095/65536 [1:53:05<10:59:40,  1.40it/s]
 15%|█▌        | 10096/65536 [1:53:06<10:59:38,  1.40it/s]
 15%|█▌        | 10097/65536 [1:53:06<10:58:41,  1.40it/s]
 15%|█▌        | 10098/65536 [1:53:07<11:05:07,  1.39it/s]
 15%|█▌        | 10099/65536 [1:53:08<11:07:27,  1.38it/s]
 15%|█▌        | 10100/65536 [1:53:08<10:47:23,  1.43it/s]
                                                          
{'loss': 0.9713, 'learning_rate': 8.636280151830536e-07, 'epoch': 623.46}

 15%|█▌        | 10100/65536 [1:53:08<10:47:23,  1.43it/s]
 15%|█▌        | 10101/65536 [1:53:09<10:36:13,  1.45it/s]
 15%|█▌        | 10102/65536 [1:53:10<10:46:03,  1.43it/s]
 15%|█▌        | 10103/65536 [1:53:10<10:36:53,  1.45it/s]
 15%|█▌        | 10104/65536 [1:53:11<10:15:21,  1.50it/s]
 15%|█▌        | 10105/65536 [1:53:12<10:15:20,  1.50it/s]
 15%|█▌        | 10106/65536 [1:53:12<10:24:02,  1.48it/s]
 15%|█▌        | 10107/65536 [1:53:13<10:24:10,  1.48it/s]
 15%|█▌        | 10108/65536 [1:53:14<10:23:37,  1.48it/s]
 15%|█▌        | 10109/65536 [1:53:15<11:04:07,  1.39it/s]
 15%|█▌        | 10110/65536 [1:53:15<11:11:49,  1.38it/s]
 15%|█▌        | 10111/65536 [1:53:16<11:13:40,  1.37it/s]
 15%|█▌        | 10112/65536 [1:53:17<10:52:37,  1.42it/s]
 15%|█▌        | 10113/65536 [1:53:17<10:44:34,  1.43it/s]
 15%|█▌        | 10114/65536 [1:53:18<10:36:17,  1.45it/s]
 15%|█▌        | 10115/65536 [1:53:19<10:11:49,  1.51it/s]
 15%|█▌        | 10116/65536 [1:53:19<10:22:59,  1.48it/s]
 15%|█▌        | 10117/65536 [1:53:20<10:09:45,  1.51it/s]
 15%|█▌        | 10118/65536 [1:53:21<10:09:58,  1.51it/s]
 15%|█▌        | 10119/65536 [1:53:21<10:35:15,  1.45it/s]
 15%|█▌        | 10120/65536 [1:53:22<10:25:24,  1.48it/s]
                                                          
{'loss': 1.0097, 'learning_rate': 8.633525162238275e-07, 'epoch': 624.69}

 15%|█▌        | 10120/65536 [1:53:22<10:25:24,  1.48it/s]
 15%|█▌        | 10121/65536 [1:53:23<10:32:17,  1.46it/s]
 15%|█▌        | 10122/65536 [1:53:23<10:22:31,  1.48it/s]
 15%|█▌        | 10123/65536 [1:53:24<10:18:09,  1.49it/s]
 15%|█▌        | 10124/65536 [1:53:25<10:23:03,  1.48it/s]
 15%|█▌        | 10125/65536 [1:53:26<10:29:33,  1.47it/s]
 15%|█▌        | 10126/65536 [1:53:26<10:38:41,  1.45it/s]
 15%|█▌        | 10127/65536 [1:53:27<10:42:07,  1.44it/s]
 15%|█▌        | 10128/65536 [1:53:28<10:46:24,  1.43it/s]
 15%|█▌        | 10129/65536 [1:53:28<10:34:10,  1.46it/s]
 15%|█▌        | 10130/65536 [1:53:29<10:19:48,  1.49it/s]
 15%|█▌        | 10131/65536 [1:53:30<10:31:47,  1.46it/s]
 15%|█▌        | 10132/65536 [1:53:30<10:30:04,  1.47it/s]
 15%|█▌        | 10133/65536 [1:53:31<10:21:47,  1.49it/s]
 15%|█▌        | 10134/65536 [1:53:32<10:17:18,  1.50it/s]
 15%|█▌        | 10135/65536 [1:53:32<10:19:18,  1.49it/s]
 15%|█▌        | 10136/65536 [1:53:33<9:59:35,  1.54it/s] 
 15%|█▌        | 10137/65536 [1:53:34<10:17:23,  1.50it/s]
 15%|█▌        | 10138/65536 [1:53:34<10:35:48,  1.45it/s]
 15%|█▌        | 10139/65536 [1:53:35<10:27:57,  1.47it/s]
 15%|█▌        | 10140/65536 [1:53:36<10:56:49,  1.41it/s]
                                                          
{'loss': 0.9927, 'learning_rate': 8.630770172646013e-07, 'epoch': 625.93}

 15%|█▌        | 10140/65536 [1:53:36<10:56:49,  1.41it/s]
 15%|█▌        | 10141/65536 [1:53:37<11:03:17,  1.39it/s]
 15%|█▌        | 10142/65536 [1:53:37<11:47:31,  1.30it/s]
 15%|█▌        | 10143/65536 [1:53:38<11:43:43,  1.31it/s]
 15%|█▌        | 10144/65536 [1:53:39<11:34:27,  1.33it/s]
 15%|█▌        | 10145/65536 [1:53:40<11:25:27,  1.35it/s]
 15%|█▌        | 10146/65536 [1:53:40<11:17:56,  1.36it/s]
 15%|█▌        | 10147/65536 [1:53:41<11:16:17,  1.37it/s]
 15%|█▌        | 10148/65536 [1:53:42<10:58:29,  1.40it/s]
 15%|█▌        | 10149/65536 [1:53:42<10:43:24,  1.43it/s]
 15%|█▌        | 10150/65536 [1:53:43<10:43:57,  1.43it/s]
 15%|█▌        | 10151/65536 [1:53:44<10:34:51,  1.45it/s]
 15%|█▌        | 10152/65536 [1:53:44<10:22:18,  1.48it/s]
 15%|█▌        | 10153/65536 [1:53:45<10:27:09,  1.47it/s]
 15%|█▌        | 10154/65536 [1:53:46<10:24:40,  1.48it/s]
 15%|█▌        | 10155/65536 [1:53:46<10:22:01,  1.48it/s]
 15%|█▌        | 10156/65536 [1:53:47<10:18:29,  1.49it/s]
 15%|█▌        | 10157/65536 [1:53:48<10:21:49,  1.48it/s]
 15%|█▌        | 10158/65536 [1:53:49<10:52:39,  1.41it/s]
 16%|█▌        | 10159/65536 [1:53:49<10:53:52,  1.41it/s]
 16%|█▌        | 10160/65536 [1:53:50<11:00:11,  1.40it/s]
                                                          
{'loss': 0.9709, 'learning_rate': 8.628015183053752e-07, 'epoch': 627.16}

 16%|█▌        | 10160/65536 [1:53:50<11:00:11,  1.40it/s]
 16%|█▌        | 10161/65536 [1:53:51<10:48:22,  1.42it/s]
 16%|█▌        | 10162/65536 [1:53:51<10:52:57,  1.41it/s]
 16%|█▌        | 10163/65536 [1:53:52<10:58:13,  1.40it/s]
 16%|█▌        | 10164/65536 [1:53:53<10:45:03,  1.43it/s]
 16%|█▌        | 10165/65536 [1:53:53<10:24:22,  1.48it/s]
 16%|█▌        | 10166/65536 [1:53:54<10:19:40,  1.49it/s]
 16%|█▌        | 10167/65536 [1:53:55<10:26:21,  1.47it/s]
 16%|█▌        | 10168/65536 [1:53:55<10:28:13,  1.47it/s]
 16%|█▌        | 10169/65536 [1:53:56<10:42:00,  1.44it/s]
 16%|█▌        | 10170/65536 [1:53:57<10:33:59,  1.46it/s]
 16%|█▌        | 10171/65536 [1:53:58<10:45:00,  1.43it/s]
 16%|█▌        | 10172/65536 [1:53:58<10:25:28,  1.48it/s]
 16%|█▌        | 10173/65536 [1:53:59<10:28:18,  1.47it/s]
 16%|█▌        | 10174/65536 [1:54:00<10:59:36,  1.40it/s]
 16%|█▌        | 10175/65536 [1:54:00<10:35:39,  1.45it/s]
 16%|█▌        | 10176/65536 [1:54:01<10:31:04,  1.46it/s]
 16%|█▌        | 10177/65536 [1:54:02<10:31:03,  1.46it/s]
 16%|█▌        | 10178/65536 [1:54:02<10:39:29,  1.44it/s]
 16%|█▌        | 10179/65536 [1:54:03<10:45:48,  1.43it/s]
 16%|█▌        | 10180/65536 [1:54:04<10:41:15,  1.44it/s]
                                                          
{'loss': 1.0084, 'learning_rate': 8.625260193461491e-07, 'epoch': 628.4}

 16%|█▌        | 10180/65536 [1:54:04<10:41:15,  1.44it/s]
 16%|█▌        | 10181/65536 [1:54:04<10:32:07,  1.46it/s]
 16%|█▌        | 10182/65536 [1:54:05<10:15:35,  1.50it/s]
 16%|█▌        | 10183/65536 [1:54:06<10:06:03,  1.52it/s]
 16%|█▌        | 10184/65536 [1:54:06<10:00:33,  1.54it/s]
 16%|█▌        | 10185/65536 [1:54:07<9:58:25,  1.54it/s] 
 16%|█▌        | 10186/65536 [1:54:08<10:11:43,  1.51it/s]
 16%|█▌        | 10187/65536 [1:54:08<10:27:29,  1.47it/s]
 16%|█▌        | 10188/65536 [1:54:09<10:36:13,  1.45it/s]
 16%|█▌        | 10189/65536 [1:54:10<10:22:55,  1.48it/s]
 16%|█▌        | 10190/65536 [1:54:11<10:52:14,  1.41it/s]
 16%|█▌        | 10191/65536 [1:54:11<10:44:20,  1.43it/s]
 16%|█▌        | 10192/65536 [1:54:12<10:17:27,  1.49it/s]
 16%|█▌        | 10193/65536 [1:54:12<10:10:36,  1.51it/s]
 16%|█▌        | 10194/65536 [1:54:13<10:16:30,  1.50it/s]
 16%|█▌        | 10195/65536 [1:54:14<10:26:51,  1.47it/s]
 16%|█▌        | 10196/65536 [1:54:15<10:23:33,  1.48it/s]
 16%|█▌        | 10197/65536 [1:54:15<10:37:38,  1.45it/s]
 16%|█▌        | 10198/65536 [1:54:16<10:39:41,  1.44it/s]
 16%|█▌        | 10199/65536 [1:54:17<10:32:28,  1.46it/s]
 16%|█▌        | 10200/65536 [1:54:17<10:42:22,  1.44it/s]
                                                          
{'loss': 0.9799, 'learning_rate': 8.622505203869229e-07, 'epoch': 629.63}

 16%|█▌        | 10200/65536 [1:54:17<10:42:22,  1.44it/s]
 16%|█▌        | 10201/65536 [1:54:18<10:32:42,  1.46it/s]
 16%|█▌        | 10202/65536 [1:54:19<10:17:59,  1.49it/s]
 16%|█▌        | 10203/65536 [1:54:19<10:10:09,  1.51it/s]
 16%|█▌        | 10204/65536 [1:54:20<10:01:21,  1.53it/s]
 16%|█▌        | 10205/65536 [1:54:21<10:08:30,  1.52it/s]
 16%|█▌        | 10206/65536 [1:54:21<10:08:26,  1.52it/s]
 16%|█▌        | 10207/65536 [1:54:22<10:34:49,  1.45it/s]
 16%|█▌        | 10208/65536 [1:54:23<10:34:29,  1.45it/s]
 16%|█▌        | 10209/65536 [1:54:23<10:57:16,  1.40it/s]
 16%|█▌        | 10210/65536 [1:54:24<10:33:46,  1.45it/s]
 16%|█▌        | 10211/65536 [1:54:25<10:19:29,  1.49it/s]
 16%|█▌        | 10212/65536 [1:54:25<10:27:04,  1.47it/s]
 16%|█▌        | 10213/65536 [1:54:26<10:22:01,  1.48it/s]
 16%|█▌        | 10214/65536 [1:54:27<10:29:36,  1.46it/s]
 16%|█▌        | 10215/65536 [1:54:27<10:29:03,  1.47it/s]
 16%|█▌        | 10216/65536 [1:54:28<10:29:55,  1.46it/s]
 16%|█▌        | 10217/65536 [1:54:29<10:19:55,  1.49it/s]
 16%|█▌        | 10218/65536 [1:54:29<10:11:44,  1.51it/s]
 16%|█▌        | 10219/65536 [1:54:30<10:12:33,  1.51it/s]
 16%|█▌        | 10220/65536 [1:54:31<10:21:47,  1.48it/s]
                                                          
{'loss': 0.968, 'learning_rate': 8.619750214276968e-07, 'epoch': 630.86}

 16%|█▌        | 10220/65536 [1:54:31<10:21:47,  1.48it/s]
 16%|█▌        | 10221/65536 [1:54:31<10:10:16,  1.51it/s]
 16%|█▌        | 10222/65536 [1:54:32<10:02:39,  1.53it/s]
 16%|█▌        | 10223/65536 [1:54:33<10:22:25,  1.48it/s]
 16%|█▌        | 10224/65536 [1:54:33<10:21:29,  1.48it/s]
 16%|█▌        | 10225/65536 [1:54:34<10:13:30,  1.50it/s]
 16%|█▌        | 10226/65536 [1:54:35<10:07:57,  1.52it/s]
 16%|█▌        | 10227/65536 [1:54:35<10:20:06,  1.49it/s]
 16%|█▌        | 10228/65536 [1:54:36<10:29:35,  1.46it/s]
 16%|█▌        | 10229/65536 [1:54:37<10:25:30,  1.47it/s]
 16%|█▌        | 10230/65536 [1:54:37<9:59:04,  1.54it/s] 
 16%|█▌        | 10231/65536 [1:54:38<10:10:12,  1.51it/s]
 16%|█▌        | 10232/65536 [1:54:39<10:08:00,  1.52it/s]
 16%|█▌        | 10233/65536 [1:54:39<10:17:01,  1.49it/s]
 16%|█▌        | 10234/65536 [1:54:40<10:28:05,  1.47it/s]
 16%|█▌        | 10235/65536 [1:54:41<10:30:56,  1.46it/s]
 16%|█▌        | 10236/65536 [1:54:42<10:27:46,  1.47it/s]
 16%|█▌        | 10237/65536 [1:54:42<10:13:29,  1.50it/s]
 16%|█▌        | 10238/65536 [1:54:43<10:14:04,  1.50it/s]
 16%|█▌        | 10239/65536 [1:54:44<10:56:34,  1.40it/s]
 16%|█▌        | 10240/65536 [1:54:44<10:38:08,  1.44it/s]
                                                          
{'loss': 0.9995, 'learning_rate': 8.616995224684706e-07, 'epoch': 632.1}

 16%|█▌        | 10240/65536 [1:54:44<10:38:08,  1.44it/s]
 16%|█▌        | 10241/65536 [1:54:45<10:27:44,  1.47it/s]
 16%|█▌        | 10242/65536 [1:54:46<10:16:36,  1.49it/s]
 16%|█▌        | 10243/65536 [1:54:46<10:24:05,  1.48it/s]
 16%|█▌        | 10244/65536 [1:54:47<10:32:12,  1.46it/s]
 16%|█▌        | 10245/65536 [1:54:48<10:22:50,  1.48it/s]
 16%|█▌        | 10246/65536 [1:54:48<10:05:53,  1.52it/s]
 16%|█▌        | 10247/65536 [1:54:49<10:06:46,  1.52it/s]
 16%|█▌        | 10248/65536 [1:54:50<10:08:52,  1.51it/s]
 16%|█▌        | 10249/65536 [1:54:50<10:13:17,  1.50it/s]
 16%|█▌        | 10250/65536 [1:54:51<10:08:26,  1.51it/s]
 16%|█▌        | 10251/65536 [1:54:52<9:58:28,  1.54it/s] 
 16%|█▌        | 10252/65536 [1:54:52<10:14:05,  1.50it/s]
 16%|█▌        | 10253/65536 [1:54:53<10:28:34,  1.47it/s]
 16%|█▌        | 10254/65536 [1:54:54<10:15:29,  1.50it/s]
 16%|█▌        | 10255/65536 [1:54:54<10:45:47,  1.43it/s]
 16%|█▌        | 10256/65536 [1:54:55<10:46:25,  1.43it/s]
 16%|█▌        | 10257/65536 [1:54:56<10:50:08,  1.42it/s]
 16%|█▌        | 10258/65536 [1:54:56<10:37:35,  1.44it/s]
 16%|█▌        | 10259/65536 [1:54:57<10:42:00,  1.43it/s]
 16%|█▌        | 10260/65536 [1:54:58<10:17:31,  1.49it/s]
                                                          
{'loss': 0.965, 'learning_rate': 8.614240235092445e-07, 'epoch': 633.33}

 16%|█▌        | 10260/65536 [1:54:58<10:17:31,  1.49it/s]
 16%|█▌        | 10261/65536 [1:54:58<10:20:14,  1.49it/s]
 16%|█▌        | 10262/65536 [1:54:59<10:09:37,  1.51it/s]
 16%|█▌        | 10263/65536 [1:55:00<10:05:09,  1.52it/s]
 16%|█▌        | 10264/65536 [1:55:00<10:04:03,  1.52it/s]
 16%|█▌        | 10265/65536 [1:55:01<9:58:54,  1.54it/s] 
 16%|█▌        | 10266/65536 [1:55:02<9:58:29,  1.54it/s]
 16%|█▌        | 10267/65536 [1:55:02<10:05:38,  1.52it/s]
 16%|█▌        | 10268/65536 [1:55:03<10:16:42,  1.49it/s]
 16%|█▌        | 10269/65536 [1:55:04<10:31:06,  1.46it/s]
 16%|█▌        | 10270/65536 [1:55:04<10:27:56,  1.47it/s]
 16%|█▌        | 10271/65536 [1:55:05<10:33:56,  1.45it/s]
 16%|█▌        | 10272/65536 [1:55:06<10:20:27,  1.48it/s]
 16%|█▌        | 10273/65536 [1:55:06<10:35:18,  1.45it/s]
 16%|█▌        | 10274/65536 [1:55:07<10:29:29,  1.46it/s]
 16%|█▌        | 10275/65536 [1:55:08<10:25:05,  1.47it/s]
 16%|█▌        | 10276/65536 [1:55:08<10:12:46,  1.50it/s]
 16%|█▌        | 10277/65536 [1:55:09<9:58:29,  1.54it/s] 
 16%|█▌        | 10278/65536 [1:55:10<10:01:08,  1.53it/s]
 16%|█▌        | 10279/65536 [1:55:10<9:50:21,  1.56it/s] 
 16%|█▌        | 10280/65536 [1:55:11<9:48:10,  1.57it/s]
                                                         
{'loss': 0.993, 'learning_rate': 8.611485245500185e-07, 'epoch': 634.57}

 16%|█▌        | 10280/65536 [1:55:11<9:48:10,  1.57it/s]
 16%|█▌        | 10281/65536 [1:55:12<10:08:07,  1.51it/s]
 16%|█▌        | 10282/65536 [1:55:12<10:12:21,  1.50it/s]
 16%|█▌        | 10283/65536 [1:55:13<10:17:17,  1.49it/s]
 16%|█▌        | 10284/65536 [1:55:14<10:26:24,  1.47it/s]
 16%|█▌        | 10285/65536 [1:55:14<10:12:47,  1.50it/s]
 16%|█▌        | 10286/65536 [1:55:15<10:28:25,  1.47it/s]
 16%|█▌        | 10287/65536 [1:55:16<10:30:21,  1.46it/s]
 16%|█▌        | 10288/65536 [1:55:17<10:54:34,  1.41it/s]
 16%|█▌        | 10289/65536 [1:55:17<10:36:35,  1.45it/s]
 16%|█▌        | 10290/65536 [1:55:18<10:43:05,  1.43it/s]
 16%|█▌        | 10291/65536 [1:55:19<10:30:23,  1.46it/s]
 16%|█▌        | 10292/65536 [1:55:19<10:12:01,  1.50it/s]
 16%|█▌        | 10293/65536 [1:55:20<10:21:16,  1.48it/s]
 16%|█▌        | 10294/65536 [1:55:21<10:11:17,  1.51it/s]
 16%|█▌        | 10295/65536 [1:55:21<10:06:23,  1.52it/s]
 16%|█▌        | 10296/65536 [1:55:22<9:55:13,  1.55it/s] 
 16%|█▌        | 10297/65536 [1:55:23<10:12:56,  1.50it/s]
 16%|█▌        | 10298/65536 [1:55:23<10:04:03,  1.52it/s]
 16%|█▌        | 10299/65536 [1:55:24<9:59:57,  1.53it/s] 
 16%|█▌        | 10300/65536 [1:55:24<10:06:36,  1.52it/s]
                                                          
{'loss': 0.9939, 'learning_rate': 8.608730255907922e-07, 'epoch': 635.8}

 16%|█▌        | 10300/65536 [1:55:24<10:06:36,  1.52it/s]
 16%|█▌        | 10301/65536 [1:55:25<10:00:35,  1.53it/s]
 16%|█▌        | 10302/65536 [1:55:26<9:55:21,  1.55it/s] 
 16%|█▌        | 10303/65536 [1:55:26<10:18:48,  1.49it/s]
 16%|█▌        | 10304/65536 [1:55:27<10:43:05,  1.43it/s]
 16%|█▌        | 10305/65536 [1:55:28<10:36:19,  1.45it/s]
 16%|█▌        | 10306/65536 [1:55:29<10:38:42,  1.44it/s]
 16%|█▌        | 10307/65536 [1:55:29<10:20:31,  1.48it/s]
 16%|█▌        | 10308/65536 [1:55:30<10:22:12,  1.48it/s]
 16%|█▌        | 10309/65536 [1:55:31<10:35:01,  1.45it/s]
 16%|█▌        | 10310/65536 [1:55:31<10:22:35,  1.48it/s]
 16%|█▌        | 10311/65536 [1:55:32<10:27:48,  1.47it/s]
 16%|█▌        | 10312/65536 [1:55:33<10:15:36,  1.50it/s]
 16%|█▌        | 10313/65536 [1:55:33<10:20:43,  1.48it/s]
 16%|█▌        | 10314/65536 [1:55:34<10:28:24,  1.46it/s]
 16%|█▌        | 10315/65536 [1:55:35<10:23:04,  1.48it/s]
 16%|█▌        | 10316/65536 [1:55:35<10:23:43,  1.48it/s]
 16%|█▌        | 10317/65536 [1:55:36<10:09:24,  1.51it/s]
 16%|█▌        | 10318/65536 [1:55:37<10:06:23,  1.52it/s]
 16%|█▌        | 10319/65536 [1:55:37<10:06:05,  1.52it/s]
 16%|█▌        | 10320/65536 [1:55:38<10:27:46,  1.47it/s]
                                                          
{'loss': 0.9811, 'learning_rate': 8.605975266315661e-07, 'epoch': 637.04}

 16%|█▌        | 10320/65536 [1:55:38<10:27:46,  1.47it/s]
 16%|█▌        | 10321/65536 [1:55:39<10:23:17,  1.48it/s]
 16%|█▌        | 10322/65536 [1:55:39<10:23:19,  1.48it/s]
 16%|█▌        | 10323/65536 [1:55:40<10:06:14,  1.52it/s]
 16%|█▌        | 10324/65536 [1:55:41<9:52:55,  1.55it/s] 
 16%|█▌        | 10325/65536 [1:55:41<9:58:49,  1.54it/s]
 16%|█▌        | 10326/65536 [1:55:42<10:05:51,  1.52it/s]
 16%|█▌        | 10327/65536 [1:55:43<10:27:48,  1.47it/s]
 16%|█▌        | 10328/65536 [1:55:43<10:14:05,  1.50it/s]
 16%|█▌        | 10329/65536 [1:55:44<10:03:32,  1.52it/s]
 16%|█▌        | 10330/65536 [1:55:45<10:18:13,  1.49it/s]
 16%|█▌        | 10331/65536 [1:55:45<10:06:24,  1.52it/s]
 16%|█▌        | 10332/65536 [1:55:46<10:08:47,  1.51it/s]
 16%|█▌        | 10333/65536 [1:55:47<10:10:04,  1.51it/s]
 16%|█▌        | 10334/65536 [1:55:47<10:19:26,  1.49it/s]
 16%|█▌        | 10335/65536 [1:55:48<10:40:05,  1.44it/s]
 16%|█▌        | 10336/65536 [1:55:49<10:54:59,  1.40it/s]
 16%|█▌        | 10337/65536 [1:55:49<10:26:31,  1.47it/s]
 16%|█▌        | 10338/65536 [1:55:50<10:27:32,  1.47it/s]
 16%|█▌        | 10339/65536 [1:55:51<10:02:39,  1.53it/s]
 16%|█▌        | 10340/65536 [1:55:51<10:19:44,  1.48it/s]
                                                          
{'loss': 0.9806, 'learning_rate': 8.603220276723399e-07, 'epoch': 638.27}

 16%|█▌        | 10340/65536 [1:55:51<10:19:44,  1.48it/s]
 16%|█▌        | 10341/65536 [1:55:52<10:24:12,  1.47it/s]
 16%|█▌        | 10342/65536 [1:55:53<10:27:39,  1.47it/s]
 16%|█▌        | 10343/65536 [1:55:53<10:11:18,  1.50it/s]
 16%|█▌        | 10344/65536 [1:55:54<10:32:49,  1.45it/s]
 16%|█▌        | 10345/65536 [1:55:55<10:35:47,  1.45it/s]
 16%|█▌        | 10346/65536 [1:55:56<10:43:24,  1.43it/s]
 16%|█▌        | 10347/65536 [1:55:56<10:20:03,  1.48it/s]
 16%|█▌        | 10348/65536 [1:55:57<10:08:06,  1.51it/s]
 16%|█▌        | 10349/65536 [1:55:57<10:10:50,  1.51it/s]
 16%|█▌        | 10350/65536 [1:55:58<9:56:50,  1.54it/s] 
 16%|█▌        | 10351/65536 [1:55:59<10:14:10,  1.50it/s]
 16%|█▌        | 10352/65536 [1:56:00<10:37:18,  1.44it/s]
 16%|█▌        | 10353/65536 [1:56:00<10:35:04,  1.45it/s]
 16%|█▌        | 10354/65536 [1:56:01<10:24:36,  1.47it/s]
 16%|█▌        | 10355/65536 [1:56:02<10:26:04,  1.47it/s]
 16%|█▌        | 10356/65536 [1:56:02<10:32:08,  1.45it/s]
 16%|█▌        | 10357/65536 [1:56:03<10:29:02,  1.46it/s]
 16%|█▌        | 10358/65536 [1:56:04<10:43:50,  1.43it/s]
 16%|█▌        | 10359/65536 [1:56:04<10:45:07,  1.43it/s]
 16%|█▌        | 10360/65536 [1:56:05<10:31:56,  1.46it/s]
                                                          
{'loss': 0.979, 'learning_rate': 8.600465287131137e-07, 'epoch': 639.51}

 16%|█▌        | 10360/65536 [1:56:05<10:31:56,  1.46it/s]
 16%|█▌        | 10361/65536 [1:56:06<10:11:44,  1.50it/s]
 16%|█▌        | 10362/65536 [1:56:06<10:05:51,  1.52it/s]
 16%|█▌        | 10363/65536 [1:56:07<10:02:42,  1.53it/s]
 16%|█▌        | 10364/65536 [1:56:08<9:50:38,  1.56it/s] 
 16%|█▌        | 10365/65536 [1:56:08<9:32:58,  1.60it/s]
 16%|█▌        | 10366/65536 [1:56:09<9:46:43,  1.57it/s]
 16%|█▌        | 10367/65536 [1:56:09<9:56:59,  1.54it/s]
 16%|█▌        | 10368/65536 [1:56:10<9:58:36,  1.54it/s]
 16%|█▌        | 10369/65536 [1:56:11<10:32:48,  1.45it/s]
 16%|█▌        | 10370/65536 [1:56:12<10:24:05,  1.47it/s]
 16%|█▌        | 10371/65536 [1:56:12<10:34:15,  1.45it/s]
 16%|█▌        | 10372/65536 [1:56:13<10:12:19,  1.50it/s]
 16%|█▌        | 10373/65536 [1:56:14<10:15:58,  1.49it/s]
 16%|█▌        | 10374/65536 [1:56:14<10:11:09,  1.50it/s]
 16%|█▌        | 10375/65536 [1:56:15<10:12:09,  1.50it/s]
 16%|█▌        | 10376/65536 [1:56:16<10:11:51,  1.50it/s]
 16%|█▌        | 10377/65536 [1:56:16<10:10:41,  1.51it/s]
 16%|█▌        | 10378/65536 [1:56:17<10:14:33,  1.50it/s]
 16%|█▌        | 10379/65536 [1:56:18<10:07:19,  1.51it/s]
 16%|█▌        | 10380/65536 [1:56:18<10:10:26,  1.51it/s]
                                                          
{'loss': 0.9902, 'learning_rate': 8.597710297538874e-07, 'epoch': 640.74}

 16%|█▌        | 10380/65536 [1:56:18<10:10:26,  1.51it/s]
 16%|█▌        | 10381/65536 [1:56:19<10:21:35,  1.48it/s]
 16%|█▌        | 10382/65536 [1:56:20<10:11:17,  1.50it/s]
 16%|█▌        | 10383/65536 [1:56:20<10:09:29,  1.51it/s]
 16%|█▌        | 10384/65536 [1:56:21<10:12:10,  1.50it/s]
 16%|█▌        | 10385/65536 [1:56:22<10:47:59,  1.42it/s]
 16%|█▌        | 10386/65536 [1:56:22<10:31:14,  1.46it/s]
 16%|█▌        | 10387/65536 [1:56:23<10:41:52,  1.43it/s]
 16%|█▌        | 10388/65536 [1:56:24<10:23:46,  1.47it/s]
 16%|█▌        | 10389/65536 [1:56:24<10:12:31,  1.50it/s]
 16%|█▌        | 10390/65536 [1:56:25<10:16:43,  1.49it/s]
 16%|█▌        | 10391/65536 [1:56:26<10:17:02,  1.49it/s]
 16%|█▌        | 10392/65536 [1:56:26<10:15:37,  1.49it/s]
 16%|█▌        | 10393/65536 [1:56:27<10:05:41,  1.52it/s]
 16%|█▌        | 10394/65536 [1:56:28<9:57:09,  1.54it/s] 
 16%|█▌        | 10395/65536 [1:56:28<9:56:32,  1.54it/s]
 16%|█▌        | 10396/65536 [1:56:29<10:26:36,  1.47it/s]
 16%|█▌        | 10397/65536 [1:56:30<10:06:51,  1.51it/s]
 16%|█▌        | 10398/65536 [1:56:30<10:14:34,  1.50it/s]
 16%|█▌        | 10399/65536 [1:56:31<10:01:07,  1.53it/s]
 16%|█▌        | 10400/65536 [1:56:32<10:12:20,  1.50it/s]
                                                          
{'loss': 0.9857, 'learning_rate': 8.594955307946614e-07, 'epoch': 641.98}

 16%|█▌        | 10400/65536 [1:56:32<10:12:20,  1.50it/s]
 16%|█▌        | 10401/65536 [1:56:32<10:33:34,  1.45it/s]
 16%|█▌        | 10402/65536 [1:56:33<10:28:48,  1.46it/s]
 16%|█▌        | 10403/65536 [1:56:34<10:49:42,  1.41it/s]
 16%|█▌        | 10404/65536 [1:56:34<10:31:32,  1.45it/s]
 16%|█▌        | 10405/65536 [1:56:35<10:22:17,  1.48it/s]
 16%|█▌        | 10406/65536 [1:56:36<10:21:14,  1.48it/s]
 16%|█▌        | 10407/65536 [1:56:36<10:10:20,  1.51it/s]
 16%|█▌        | 10408/65536 [1:56:37<10:10:40,  1.50it/s]
 16%|█▌        | 10409/65536 [1:56:38<10:09:22,  1.51it/s]
 16%|█▌        | 10410/65536 [1:56:38<9:55:35,  1.54it/s] 
 16%|█▌        | 10411/65536 [1:56:39<10:09:08,  1.51it/s]
 16%|█▌        | 10412/65536 [1:56:40<10:08:22,  1.51it/s]
 16%|█▌        | 10413/65536 [1:56:40<9:58:06,  1.54it/s] 
 16%|█▌        | 10414/65536 [1:56:41<10:06:09,  1.52it/s]
 16%|█▌        | 10415/65536 [1:56:42<10:10:53,  1.50it/s]
 16%|█▌        | 10416/65536 [1:56:42<10:05:16,  1.52it/s]
 16%|█▌        | 10417/65536 [1:56:43<10:26:48,  1.47it/s]
 16%|█▌        | 10418/65536 [1:56:44<10:16:49,  1.49it/s]
 16%|█▌        | 10419/65536 [1:56:44<10:16:58,  1.49it/s]
 16%|█▌        | 10420/65536 [1:56:45<10:13:12,  1.50it/s]
                                                          
{'loss': 0.9856, 'learning_rate': 8.592200318354353e-07, 'epoch': 643.21}

 16%|█▌        | 10420/65536 [1:56:45<10:13:12,  1.50it/s]
 16%|█▌        | 10421/65536 [1:56:46<10:32:20,  1.45it/s]
 16%|█▌        | 10422/65536 [1:56:46<10:36:06,  1.44it/s]
 16%|█▌        | 10423/65536 [1:56:47<10:36:55,  1.44it/s]
 16%|█▌        | 10424/65536 [1:56:48<10:26:45,  1.47it/s]
 16%|█▌        | 10425/65536 [1:56:49<10:31:25,  1.45it/s]
 16%|█▌        | 10426/65536 [1:56:49<10:20:14,  1.48it/s]
 16%|█▌        | 10427/65536 [1:56:50<10:12:38,  1.50it/s]
 16%|█▌        | 10428/65536 [1:56:51<10:12:53,  1.50it/s]
 16%|█▌        | 10429/65536 [1:56:51<10:36:04,  1.44it/s]
 16%|█▌        | 10430/65536 [1:56:52<10:19:57,  1.48it/s]
 16%|█▌        | 10431/65536 [1:56:53<10:12:54,  1.50it/s]
 16%|█▌        | 10432/65536 [1:56:53<10:12:05,  1.50it/s]
 16%|█▌        | 10433/65536 [1:56:54<10:26:04,  1.47it/s]
 16%|█▌        | 10434/65536 [1:56:55<10:14:37,  1.49it/s]
 16%|█▌        | 10435/65536 [1:56:55<10:25:41,  1.47it/s]
 16%|█▌        | 10436/65536 [1:56:56<10:19:06,  1.48it/s]
 16%|█▌        | 10437/65536 [1:56:57<10:26:41,  1.47it/s]
 16%|█▌        | 10438/65536 [1:56:57<10:22:58,  1.47it/s]
 16%|█▌        | 10439/65536 [1:56:58<10:10:58,  1.50it/s]
 16%|█▌        | 10440/65536 [1:56:59<10:18:35,  1.48it/s]
                                                          
{'loss': 0.9777, 'learning_rate': 8.589445328762091e-07, 'epoch': 644.44}

 16%|█▌        | 10440/65536 [1:56:59<10:18:35,  1.48it/s]
 16%|█▌        | 10441/65536 [1:56:59<10:22:51,  1.47it/s]
 16%|█▌        | 10442/65536 [1:57:00<10:29:00,  1.46it/s]
 16%|█▌        | 10443/65536 [1:57:01<10:25:34,  1.47it/s]
 16%|█▌        | 10444/65536 [1:57:01<10:06:19,  1.51it/s]
 16%|█▌        | 10445/65536 [1:57:02<10:09:50,  1.51it/s]
 16%|█▌        | 10446/65536 [1:57:03<10:02:52,  1.52it/s]
 16%|█▌        | 10447/65536 [1:57:03<9:57:03,  1.54it/s] 
 16%|█▌        | 10448/65536 [1:57:04<9:57:17,  1.54it/s]
 16%|█▌        | 10449/65536 [1:57:05<10:11:26,  1.50it/s]
 16%|█▌        | 10450/65536 [1:57:05<10:36:49,  1.44it/s]
 16%|█▌        | 10451/65536 [1:57:06<10:36:19,  1.44it/s]
 16%|█▌        | 10452/65536 [1:57:07<10:17:54,  1.49it/s]
 16%|█▌        | 10453/65536 [1:57:07<10:14:12,  1.49it/s]
 16%|█▌        | 10454/65536 [1:57:08<10:26:22,  1.47it/s]
 16%|█▌        | 10455/65536 [1:57:09<10:39:53,  1.43it/s]
 16%|█▌        | 10456/65536 [1:57:10<10:44:38,  1.42it/s]
 16%|█▌        | 10457/65536 [1:57:10<10:36:45,  1.44it/s]
 16%|█▌        | 10458/65536 [1:57:11<10:34:18,  1.45it/s]
 16%|█▌        | 10459/65536 [1:57:11<10:19:02,  1.48it/s]
 16%|█▌        | 10460/65536 [1:57:12<10:29:33,  1.46it/s]
                                                          
{'loss': 0.9434, 'learning_rate': 8.58669033916983e-07, 'epoch': 645.68}

 16%|█▌        | 10460/65536 [1:57:12<10:29:33,  1.46it/s]
 16%|█▌        | 10461/65536 [1:57:13<10:23:58,  1.47it/s]
 16%|█▌        | 10462/65536 [1:57:14<10:13:57,  1.50it/s]
 16%|█▌        | 10463/65536 [1:57:14<10:15:21,  1.49it/s]
 16%|█▌        | 10464/65536 [1:57:15<10:20:45,  1.48it/s]
 16%|█▌        | 10465/65536 [1:57:16<10:09:51,  1.51it/s]
 16%|█▌        | 10466/65536 [1:57:16<10:39:17,  1.44it/s]
 16%|█▌        | 10467/65536 [1:57:17<10:51:21,  1.41it/s]
 16%|█▌        | 10468/65536 [1:57:18<10:42:03,  1.43it/s]
 16%|█▌        | 10469/65536 [1:57:18<10:18:19,  1.48it/s]
 16%|█▌        | 10470/65536 [1:57:19<10:01:50,  1.52it/s]
 16%|█▌        | 10471/65536 [1:57:20<9:52:26,  1.55it/s] 
 16%|█▌        | 10472/65536 [1:57:20<10:01:52,  1.52it/s]
 16%|█▌        | 10473/65536 [1:57:21<9:53:48,  1.55it/s] 
 16%|█▌        | 10474/65536 [1:57:22<10:06:16,  1.51it/s]
 16%|█▌        | 10475/65536 [1:57:22<10:17:18,  1.49it/s]
 16%|█▌        | 10476/65536 [1:57:23<10:20:27,  1.48it/s]
 16%|█▌        | 10477/65536 [1:57:24<10:34:04,  1.45it/s]
 16%|█▌        | 10478/65536 [1:57:24<10:29:54,  1.46it/s]
 16%|█▌        | 10479/65536 [1:57:25<10:37:53,  1.44it/s]
 16%|█▌        | 10480/65536 [1:57:26<10:16:02,  1.49it/s]
                                                          
{'loss': 0.9661, 'learning_rate': 8.583935349577568e-07, 'epoch': 646.91}

 16%|█▌        | 10480/65536 [1:57:26<10:16:02,  1.49it/s]
 16%|█▌        | 10481/65536 [1:57:26<10:08:27,  1.51it/s]
 16%|█▌        | 10482/65536 [1:57:27<10:31:28,  1.45it/s]
 16%|█▌        | 10483/65536 [1:57:28<10:21:09,  1.48it/s]
 16%|█▌        | 10484/65536 [1:57:28<10:24:39,  1.47it/s]
 16%|█▌        | 10485/65536 [1:57:29<10:08:59,  1.51it/s]
 16%|█▌        | 10486/65536 [1:57:30<10:17:41,  1.49it/s]
 16%|█▌        | 10487/65536 [1:57:30<10:16:43,  1.49it/s]
 16%|█▌        | 10488/65536 [1:57:31<10:29:04,  1.46it/s]
 16%|█▌        | 10489/65536 [1:57:32<10:17:40,  1.49it/s]
 16%|█▌        | 10490/65536 [1:57:32<10:22:17,  1.47it/s]
 16%|█▌        | 10491/65536 [1:57:33<10:34:27,  1.45it/s]
 16%|█▌        | 10492/65536 [1:57:34<10:16:23,  1.49it/s]
 16%|█▌        | 10493/65536 [1:57:35<10:26:16,  1.46it/s]
 16%|█▌        | 10494/65536 [1:57:35<10:23:23,  1.47it/s]
 16%|█▌        | 10495/65536 [1:57:36<10:08:09,  1.51it/s]
 16%|█▌        | 10496/65536 [1:57:36<10:02:28,  1.52it/s]
 16%|█▌        | 10497/65536 [1:57:37<10:05:10,  1.52it/s]
 16%|█▌        | 10498/65536 [1:57:38<10:18:53,  1.48it/s]
 16%|█▌        | 10499/65536 [1:57:38<9:57:36,  1.53it/s] 
 16%|█▌        | 10500/65536 [1:57:39<9:57:57,  1.53it/s]
                                                         
{'loss': 0.9933, 'learning_rate': 8.581180359985307e-07, 'epoch': 648.15}

 16%|█▌        | 10500/65536 [1:57:39<9:57:57,  1.53it/s]
 16%|█▌        | 10501/65536 [1:57:40<9:54:56,  1.54it/s]
 16%|█▌        | 10502/65536 [1:57:40<10:10:43,  1.50it/s]
 16%|█▌        | 10503/65536 [1:57:41<9:56:56,  1.54it/s] 
 16%|█▌        | 10504/65536 [1:57:42<9:52:07,  1.55it/s]
 16%|█▌        | 10505/65536 [1:57:42<10:09:50,  1.50it/s]
 16%|█▌        | 10506/65536 [1:57:43<10:16:33,  1.49it/s]
 16%|█▌        | 10507/65536 [1:57:44<10:07:31,  1.51it/s]
 16%|█▌        | 10508/65536 [1:57:44<10:10:42,  1.50it/s]
 16%|█▌        | 10509/65536 [1:57:45<10:16:47,  1.49it/s]
 16%|█▌        | 10510/65536 [1:57:46<10:22:10,  1.47it/s]
 16%|█▌        | 10511/65536 [1:57:46<10:10:03,  1.50it/s]
 16%|█▌        | 10512/65536 [1:57:47<10:27:36,  1.46it/s]
 16%|█▌        | 10513/65536 [1:57:48<10:31:36,  1.45it/s]
 16%|█▌        | 10514/65536 [1:57:49<10:42:07,  1.43it/s]
 16%|█▌        | 10515/65536 [1:57:49<10:51:32,  1.41it/s]
 16%|█▌        | 10516/65536 [1:57:50<10:26:51,  1.46it/s]
 16%|█▌        | 10517/65536 [1:57:51<10:06:46,  1.51it/s]
 16%|█▌        | 10518/65536 [1:57:51<10:16:48,  1.49it/s]
 16%|█▌        | 10519/65536 [1:57:52<10:09:47,  1.50it/s]
 16%|█▌        | 10520/65536 [1:57:53<10:03:55,  1.52it/s]
                                                          
{'loss': 0.9837, 'learning_rate': 8.578425370393046e-07, 'epoch': 649.38}

 16%|█▌        | 10520/65536 [1:57:53<10:03:55,  1.52it/s]
 16%|█▌        | 10521/65536 [1:57:53<10:11:58,  1.50it/s]
 16%|█▌        | 10522/65536 [1:57:54<10:08:25,  1.51it/s]
 16%|█▌        | 10523/65536 [1:57:55<10:22:43,  1.47it/s]
 16%|█▌        | 10524/65536 [1:57:55<10:13:28,  1.49it/s]
 16%|█▌        | 10525/65536 [1:57:56<10:06:41,  1.51it/s]
 16%|█▌        | 10526/65536 [1:57:57<10:10:41,  1.50it/s]
 16%|█▌        | 10527/65536 [1:57:57<10:23:12,  1.47it/s]
 16%|█▌        | 10528/65536 [1:57:58<10:18:01,  1.48it/s]
 16%|█▌        | 10529/65536 [1:57:59<10:12:27,  1.50it/s]
 16%|█▌        | 10530/65536 [1:57:59<10:07:50,  1.51it/s]
 16%|█▌        | 10531/65536 [1:58:00<10:36:00,  1.44it/s]
 16%|█▌        | 10532/65536 [1:58:01<10:21:53,  1.47it/s]
 16%|█▌        | 10533/65536 [1:58:01<10:04:22,  1.52it/s]
 16%|█▌        | 10534/65536 [1:58:02<9:57:37,  1.53it/s] 
 16%|█▌        | 10535/65536 [1:58:03<9:57:03,  1.54it/s]
 16%|█▌        | 10536/65536 [1:58:03<9:55:48,  1.54it/s]
 16%|█▌        | 10537/65536 [1:58:04<9:57:08,  1.54it/s]
 16%|█▌        | 10538/65536 [1:58:05<10:18:08,  1.48it/s]
 16%|█▌        | 10539/65536 [1:58:05<10:08:20,  1.51it/s]
 16%|█▌        | 10540/65536 [1:58:06<10:07:07,  1.51it/s]
                                                          
{'loss': 0.9883, 'learning_rate': 8.575670380800783e-07, 'epoch': 650.62}

 16%|█▌        | 10540/65536 [1:58:06<10:07:07,  1.51it/s]
 16%|█▌        | 10541/65536 [1:58:07<10:26:23,  1.46it/s]
 16%|█▌        | 10542/65536 [1:58:07<10:31:57,  1.45it/s]
 16%|█▌        | 10543/65536 [1:58:08<10:15:40,  1.49it/s]
 16%|█▌        | 10544/65536 [1:58:09<10:11:47,  1.50it/s]
 16%|█▌        | 10545/65536 [1:58:09<10:03:45,  1.52it/s]
 16%|█▌        | 10546/65536 [1:58:10<10:15:01,  1.49it/s]
 16%|█▌        | 10547/65536 [1:58:11<10:43:02,  1.43it/s]
 16%|█▌        | 10548/65536 [1:58:11<10:29:10,  1.46it/s]
 16%|█▌        | 10549/65536 [1:58:12<10:35:17,  1.44it/s]
 16%|█▌        | 10550/65536 [1:58:13<10:30:22,  1.45it/s]
 16%|█▌        | 10551/65536 [1:58:13<10:15:44,  1.49it/s]
 16%|█▌        | 10552/65536 [1:58:14<10:21:30,  1.47it/s]
 16%|█▌        | 10553/65536 [1:58:15<10:25:02,  1.47it/s]
 16%|█▌        | 10554/65536 [1:58:15<10:28:18,  1.46it/s]
 16%|█▌        | 10555/65536 [1:58:16<10:19:05,  1.48it/s]
 16%|█▌        | 10556/65536 [1:58:17<10:10:30,  1.50it/s]
 16%|█▌        | 10557/65536 [1:58:17<10:02:40,  1.52it/s]
 16%|█▌        | 10558/65536 [1:58:18<10:07:55,  1.51it/s]
 16%|█▌        | 10559/65536 [1:58:19<10:06:45,  1.51it/s]
 16%|█▌        | 10560/65536 [1:58:19<10:01:59,  1.52it/s]
                                                          
{'loss': 0.9717, 'learning_rate': 8.572915391208522e-07, 'epoch': 651.85}

 16%|█▌        | 10560/65536 [1:58:19<10:01:59,  1.52it/s]
 16%|█▌        | 10561/65536 [1:58:20<9:59:41,  1.53it/s] 
 16%|█▌        | 10562/65536 [1:58:21<10:16:20,  1.49it/s]
 16%|█▌        | 10563/65536 [1:58:21<10:38:03,  1.44it/s]
 16%|█▌        | 10564/65536 [1:58:22<10:24:20,  1.47it/s]
 16%|█▌        | 10565/65536 [1:58:23<10:08:06,  1.51it/s]
 16%|█▌        | 10566/65536 [1:58:23<10:09:54,  1.50it/s]
 16%|█▌        | 10567/65536 [1:58:24<10:12:56,  1.49it/s]
 16%|█▌        | 10568/65536 [1:58:25<10:14:52,  1.49it/s]
 16%|█▌        | 10569/65536 [1:58:25<10:10:07,  1.50it/s]
 16%|█▌        | 10570/65536 [1:58:26<10:05:42,  1.51it/s]
 16%|█▌        | 10571/65536 [1:58:27<10:00:16,  1.53it/s]
 16%|█▌        | 10572/65536 [1:58:27<10:09:40,  1.50it/s]
 16%|█▌        | 10573/65536 [1:58:28<10:06:11,  1.51it/s]
 16%|█▌        | 10574/65536 [1:58:29<10:09:08,  1.50it/s]
 16%|█▌        | 10575/65536 [1:58:29<9:56:29,  1.54it/s] 
 16%|█▌        | 10576/65536 [1:58:30<10:12:39,  1.50it/s]
 16%|█▌        | 10577/65536 [1:58:31<10:34:38,  1.44it/s]
 16%|█▌        | 10578/65536 [1:58:31<10:23:08,  1.47it/s]
 16%|█▌        | 10579/65536 [1:58:32<10:41:28,  1.43it/s]
 16%|█▌        | 10580/65536 [1:58:33<10:25:26,  1.46it/s]
                                                          
{'loss': 0.9943, 'learning_rate': 8.57016040161626e-07, 'epoch': 653.09}

 16%|█▌        | 10580/65536 [1:58:33<10:25:26,  1.46it/s]
 16%|█▌        | 10581/65536 [1:58:34<10:27:55,  1.46it/s]
 16%|█▌        | 10582/65536 [1:58:34<10:23:29,  1.47it/s]
 16%|█▌        | 10583/65536 [1:58:35<10:31:34,  1.45it/s]
 16%|█▌        | 10584/65536 [1:58:36<10:46:52,  1.42it/s]
 16%|█▌        | 10585/65536 [1:58:36<10:28:37,  1.46it/s]
 16%|█▌        | 10586/65536 [1:58:37<10:20:02,  1.48it/s]
 16%|█▌        | 10587/65536 [1:58:38<10:20:56,  1.47it/s]
 16%|█▌        | 10588/65536 [1:58:38<10:00:27,  1.53it/s]
 16%|█▌        | 10589/65536 [1:58:39<10:16:07,  1.49it/s]
 16%|█▌        | 10590/65536 [1:58:40<10:15:38,  1.49it/s]
 16%|█▌        | 10591/65536 [1:58:40<10:14:05,  1.49it/s]
 16%|█▌        | 10592/65536 [1:58:41<10:23:30,  1.47it/s]
 16%|█▌        | 10593/65536 [1:58:42<10:19:33,  1.48it/s]
 16%|█▌        | 10594/65536 [1:58:42<10:06:51,  1.51it/s]
 16%|█▌        | 10595/65536 [1:58:43<10:35:09,  1.44it/s]
 16%|█▌        | 10596/65536 [1:58:44<10:36:57,  1.44it/s]
 16%|█▌        | 10597/65536 [1:58:44<10:28:47,  1.46it/s]
 16%|█▌        | 10598/65536 [1:58:45<10:28:14,  1.46it/s]
 16%|█▌        | 10599/65536 [1:58:46<10:34:31,  1.44it/s]
 16%|█▌        | 10600/65536 [1:58:46<10:22:29,  1.47it/s]
                                                          
{'loss': 0.9468, 'learning_rate': 8.567405412023999e-07, 'epoch': 654.32}

 16%|█▌        | 10600/65536 [1:58:46<10:22:29,  1.47it/s]
 16%|█▌        | 10601/65536 [1:58:47<10:06:58,  1.51it/s]
 16%|█▌        | 10602/65536 [1:58:48<10:10:45,  1.50it/s]
 16%|█▌        | 10603/65536 [1:58:48<9:55:14,  1.54it/s] 
 16%|█▌        | 10604/65536 [1:58:49<10:05:27,  1.51it/s]
 16%|█▌        | 10605/65536 [1:58:50<10:25:30,  1.46it/s]
 16%|█▌        | 10606/65536 [1:58:50<10:11:32,  1.50it/s]
 16%|█▌        | 10607/65536 [1:58:51<10:26:53,  1.46it/s]
 16%|█▌        | 10608/65536 [1:58:52<10:35:41,  1.44it/s]
 16%|█▌        | 10609/65536 [1:58:52<10:20:12,  1.48it/s]
 16%|█▌        | 10610/65536 [1:58:53<10:11:39,  1.50it/s]
 16%|█▌        | 10611/65536 [1:58:54<10:09:12,  1.50it/s]
 16%|█▌        | 10612/65536 [1:58:55<10:21:47,  1.47it/s]
 16%|█▌        | 10613/65536 [1:58:55<10:23:36,  1.47it/s]
 16%|█▌        | 10614/65536 [1:58:56<10:31:40,  1.45it/s]
 16%|█▌        | 10615/65536 [1:58:57<10:23:25,  1.47it/s]
 16%|█▌        | 10616/65536 [1:58:57<10:14:03,  1.49it/s]
 16%|█▌        | 10617/65536 [1:58:58<10:25:37,  1.46it/s]
 16%|█▌        | 10618/65536 [1:58:59<10:34:23,  1.44it/s]
 16%|█▌        | 10619/65536 [1:58:59<10:35:09,  1.44it/s]
 16%|█▌        | 10620/65536 [1:59:00<10:28:37,  1.46it/s]
                                                          
{'loss': 0.9679, 'learning_rate': 8.564650422431737e-07, 'epoch': 655.56}

 16%|█▌        | 10620/65536 [1:59:00<10:28:37,  1.46it/s]
 16%|█▌        | 10621/65536 [1:59:01<10:50:00,  1.41it/s]
 16%|█▌        | 10622/65536 [1:59:01<10:32:09,  1.45it/s]
 16%|█▌        | 10623/65536 [1:59:02<10:20:11,  1.48it/s]
 16%|█▌        | 10624/65536 [1:59:03<10:06:27,  1.51it/s]
 16%|█▌        | 10625/65536 [1:59:03<10:05:35,  1.51it/s]
 16%|█▌        | 10626/65536 [1:59:04<10:02:48,  1.52it/s]
 16%|█▌        | 10627/65536 [1:59:05<9:56:55,  1.53it/s] 
 16%|█▌        | 10628/65536 [1:59:05<10:41:30,  1.43it/s]
 16%|█▌        | 10629/65536 [1:59:06<10:37:15,  1.44it/s]
 16%|█▌        | 10630/65536 [1:59:07<10:42:00,  1.43it/s]
 16%|█▌        | 10631/65536 [1:59:08<10:28:30,  1.46it/s]
 16%|█▌        | 10632/65536 [1:59:08<10:16:17,  1.48it/s]
 16%|█▌        | 10633/65536 [1:59:09<10:04:21,  1.51it/s]
 16%|█▌        | 10634/65536 [1:59:09<10:07:16,  1.51it/s]
 16%|█▌        | 10635/65536 [1:59:10<9:53:08,  1.54it/s] 
 16%|█▌        | 10636/65536 [1:59:11<9:53:44,  1.54it/s]
 16%|█▌        | 10637/65536 [1:59:11<10:08:24,  1.50it/s]
 16%|█▌        | 10638/65536 [1:59:12<9:52:39,  1.54it/s] 
 16%|█▌        | 10639/65536 [1:59:13<9:58:45,  1.53it/s]
 16%|█▌        | 10640/65536 [1:59:13<10:00:23,  1.52it/s]
                                                          
{'loss': 0.9792, 'learning_rate': 8.561895432839475e-07, 'epoch': 656.79}

 16%|█▌        | 10640/65536 [1:59:13<10:00:23,  1.52it/s]
 16%|█▌        | 10641/65536 [1:59:14<9:52:30,  1.54it/s] 
 16%|█▌        | 10642/65536 [1:59:15<10:10:18,  1.50it/s]
 16%|█▌        | 10643/65536 [1:59:15<10:21:06,  1.47it/s]
 16%|█▌        | 10644/65536 [1:59:16<10:36:24,  1.44it/s]
 16%|█▌        | 10645/65536 [1:59:17<10:18:32,  1.48it/s]
 16%|█▌        | 10646/65536 [1:59:17<10:19:52,  1.48it/s]
 16%|█▌        | 10647/65536 [1:59:18<10:19:47,  1.48it/s]
 16%|█▌        | 10648/65536 [1:59:19<10:15:50,  1.49it/s]
 16%|█▌        | 10649/65536 [1:59:19<10:26:03,  1.46it/s]
 16%|█▋        | 10650/65536 [1:59:20<10:22:33,  1.47it/s]
 16%|█▋        | 10651/65536 [1:59:21<10:30:13,  1.45it/s]
 16%|█▋        | 10652/65536 [1:59:22<10:33:09,  1.44it/s]
 16%|█▋        | 10653/65536 [1:59:22<10:23:03,  1.47it/s]
 16%|█▋        | 10654/65536 [1:59:23<10:18:01,  1.48it/s]
 16%|█▋        | 10655/65536 [1:59:24<10:07:53,  1.50it/s]
 16%|█▋        | 10656/65536 [1:59:24<10:12:23,  1.49it/s]
 16%|█▋        | 10657/65536 [1:59:25<10:30:29,  1.45it/s]
 16%|█▋        | 10658/65536 [1:59:26<10:25:02,  1.46it/s]
 16%|█▋        | 10659/65536 [1:59:26<10:11:04,  1.50it/s]
 16%|█▋        | 10660/65536 [1:59:27<10:33:24,  1.44it/s]
                                                          
{'loss': 0.9659, 'learning_rate': 8.559140443247214e-07, 'epoch': 658.02}

 16%|█▋        | 10660/65536 [1:59:27<10:33:24,  1.44it/s]
 16%|█▋        | 10661/65536 [1:59:28<10:16:57,  1.48it/s]
 16%|█▋        | 10662/65536 [1:59:28<10:13:15,  1.49it/s]
 16%|█▋        | 10663/65536 [1:59:29<9:49:46,  1.55it/s] 
 16%|█▋        | 10664/65536 [1:59:30<10:09:14,  1.50it/s]
 16%|█▋        | 10665/65536 [1:59:30<10:17:28,  1.48it/s]
 16%|█▋        | 10666/65536 [1:59:31<10:32:25,  1.45it/s]
 16%|█▋        | 10667/65536 [1:59:32<10:28:03,  1.46it/s]
 16%|█▋        | 10668/65536 [1:59:32<10:31:34,  1.45it/s]
 16%|█▋        | 10669/65536 [1:59:33<10:20:42,  1.47it/s]
 16%|█▋        | 10670/65536 [1:59:34<10:21:52,  1.47it/s]
 16%|█▋        | 10671/65536 [1:59:34<10:18:03,  1.48it/s]
 16%|█▋        | 10672/65536 [1:59:35<10:17:24,  1.48it/s]
 16%|█▋        | 10673/65536 [1:59:36<10:14:02,  1.49it/s]
 16%|█▋        | 10674/65536 [1:59:36<10:27:39,  1.46it/s]
 16%|█▋        | 10675/65536 [1:59:37<10:14:12,  1.49it/s]
 16%|█▋        | 10676/65536 [1:59:38<10:15:53,  1.48it/s]
 16%|█▋        | 10677/65536 [1:59:38<10:14:36,  1.49it/s]
 16%|█▋        | 10678/65536 [1:59:39<10:21:17,  1.47it/s]
 16%|█▋        | 10679/65536 [1:59:40<10:28:42,  1.45it/s]
 16%|█▋        | 10680/65536 [1:59:40<10:16:41,  1.48it/s]
                                                          
{'loss': 0.9647, 'learning_rate': 8.556385453654952e-07, 'epoch': 659.26}

 16%|█▋        | 10680/65536 [1:59:40<10:16:41,  1.48it/s]
 16%|█▋        | 10681/65536 [1:59:41<10:04:58,  1.51it/s]
 16%|█▋        | 10682/65536 [1:59:42<10:06:22,  1.51it/s]
 16%|█▋        | 10683/65536 [1:59:42<10:16:07,  1.48it/s]
 16%|█▋        | 10684/65536 [1:59:43<10:15:58,  1.48it/s]
 16%|█▋        | 10685/65536 [1:59:44<10:26:33,  1.46it/s]
 16%|█▋        | 10686/65536 [1:59:45<10:18:44,  1.48it/s]
 16%|█▋        | 10687/65536 [1:59:45<10:30:31,  1.45it/s]
 16%|█▋        | 10688/65536 [1:59:46<10:19:20,  1.48it/s]
 16%|█▋        | 10689/65536 [1:59:47<10:07:09,  1.51it/s]
 16%|█▋        | 10690/65536 [1:59:47<10:20:14,  1.47it/s]
 16%|█▋        | 10691/65536 [1:59:48<10:10:04,  1.50it/s]
 16%|█▋        | 10692/65536 [1:59:49<10:10:41,  1.50it/s]
 16%|█▋        | 10693/65536 [1:59:49<10:35:58,  1.44it/s]
 16%|█▋        | 10694/65536 [1:59:50<10:23:11,  1.47it/s]
 16%|█▋        | 10695/65536 [1:59:51<10:09:04,  1.50it/s]
 16%|█▋        | 10696/65536 [1:59:51<10:21:02,  1.47it/s]
 16%|█▋        | 10697/65536 [1:59:52<10:07:30,  1.50it/s]
 16%|█▋        | 10698/65536 [1:59:53<10:04:28,  1.51it/s]
 16%|█▋        | 10699/65536 [1:59:53<10:08:11,  1.50it/s]
 16%|█▋        | 10700/65536 [1:59:54<10:34:42,  1.44it/s]
                                                          
{'loss': 0.9691, 'learning_rate': 8.553630464062691e-07, 'epoch': 660.49}

 16%|█▋        | 10700/65536 [1:59:54<10:34:42,  1.44it/s]
 16%|█▋        | 10701/65536 [1:59:55<10:31:46,  1.45it/s]
 16%|█▋        | 10702/65536 [1:59:55<10:32:42,  1.44it/s]
 16%|█▋        | 10703/65536 [1:59:56<10:42:02,  1.42it/s]
 16%|█▋        | 10704/65536 [1:59:57<10:30:06,  1.45it/s]
 16%|█▋        | 10705/65536 [1:59:57<10:32:58,  1.44it/s]
 16%|█▋        | 10706/65536 [1:59:58<10:22:12,  1.47it/s]
 16%|█▋        | 10707/65536 [1:59:59<10:10:14,  1.50it/s]
 16%|█▋        | 10708/65536 [1:59:59<9:53:04,  1.54it/s] 
 16%|█▋        | 10709/65536 [2:00:00<10:27:23,  1.46it/s]
 16%|█▋        | 10710/65536 [2:00:01<10:24:36,  1.46it/s]
 16%|█▋        | 10711/65536 [2:00:02<10:30:01,  1.45it/s]
 16%|█▋        | 10712/65536 [2:00:02<10:17:20,  1.48it/s]
 16%|█▋        | 10713/65536 [2:00:03<10:28:52,  1.45it/s]
 16%|█▋        | 10714/65536 [2:00:04<10:10:51,  1.50it/s]
 16%|█▋        | 10715/65536 [2:00:04<10:15:18,  1.48it/s]
 16%|█▋        | 10716/65536 [2:00:05<10:09:57,  1.50it/s]
 16%|█▋        | 10717/65536 [2:00:06<10:13:24,  1.49it/s]
 16%|█▋        | 10718/65536 [2:00:06<9:55:07,  1.54it/s] 
 16%|█▋        | 10719/65536 [2:00:07<9:59:24,  1.52it/s]
 16%|█▋        | 10720/65536 [2:00:07<9:59:25,  1.52it/s]
                                                         
{'loss': 0.9585, 'learning_rate': 8.550875474470429e-07, 'epoch': 661.73}

 16%|█▋        | 10720/65536 [2:00:07<9:59:25,  1.52it/s]
 16%|█▋        | 10721/65536 [2:00:08<10:00:49,  1.52it/s]
 16%|█▋        | 10722/65536 [2:00:09<10:32:30,  1.44it/s]
 16%|█▋        | 10723/65536 [2:00:10<10:15:34,  1.48it/s]
 16%|█▋        | 10724/65536 [2:00:10<10:08:24,  1.50it/s]
 16%|█▋        | 10725/65536 [2:00:11<10:23:05,  1.47it/s]
 16%|█▋        | 10726/65536 [2:00:12<10:24:19,  1.46it/s]
 16%|█▋        | 10727/65536 [2:00:12<10:17:20,  1.48it/s]
 16%|█▋        | 10728/65536 [2:00:13<10:30:07,  1.45it/s]
 16%|█▋        | 10729/65536 [2:00:14<10:22:10,  1.47it/s]
 16%|█▋        | 10730/65536 [2:00:14<10:48:38,  1.41it/s]
 16%|█▋        | 10731/65536 [2:00:15<10:43:44,  1.42it/s]
 16%|█▋        | 10732/65536 [2:00:16<10:36:26,  1.44it/s]
 16%|█▋        | 10733/65536 [2:00:16<10:20:18,  1.47it/s]
 16%|█▋        | 10734/65536 [2:00:17<10:09:50,  1.50it/s]
 16%|█▋        | 10735/65536 [2:00:18<10:14:43,  1.49it/s]
 16%|█▋        | 10736/65536 [2:00:18<9:56:16,  1.53it/s] 
 16%|█▋        | 10737/65536 [2:00:19<9:49:20,  1.55it/s]
 16%|█▋        | 10738/65536 [2:00:20<9:49:20,  1.55it/s]
 16%|█▋        | 10739/65536 [2:00:20<9:40:32,  1.57it/s]
 16%|█▋        | 10740/65536 [2:00:21<9:48:26,  1.55it/s]
                                                         
{'loss': 0.972, 'learning_rate': 8.548120484878168e-07, 'epoch': 662.96}

 16%|█▋        | 10740/65536 [2:00:21<9:48:26,  1.55it/s]
 16%|█▋        | 10741/65536 [2:00:22<10:23:17,  1.47it/s]
 16%|█▋        | 10742/65536 [2:00:22<10:24:33,  1.46it/s]
 16%|█▋        | 10743/65536 [2:00:23<10:12:56,  1.49it/s]
 16%|█▋        | 10744/65536 [2:00:24<10:10:36,  1.50it/s]
 16%|█▋        | 10745/65536 [2:00:24<10:19:25,  1.47it/s]
 16%|█▋        | 10746/65536 [2:00:25<10:00:59,  1.52it/s]
 16%|█▋        | 10747/65536 [2:00:26<10:04:33,  1.51it/s]
 16%|█▋        | 10748/65536 [2:00:26<9:59:33,  1.52it/s] 
 16%|█▋        | 10749/65536 [2:00:27<10:03:37,  1.51it/s]
 16%|█▋        | 10750/65536 [2:00:28<10:14:56,  1.48it/s]
 16%|█▋        | 10751/65536 [2:00:28<10:25:58,  1.46it/s]
 16%|█▋        | 10752/65536 [2:00:29<10:31:08,  1.45it/s]
 16%|█▋        | 10753/65536 [2:00:30<10:05:36,  1.51it/s]
 16%|█▋        | 10754/65536 [2:00:30<10:12:41,  1.49it/s]
 16%|█▋        | 10755/65536 [2:00:31<10:11:52,  1.49it/s]
 16%|█▋        | 10756/65536 [2:00:32<10:14:41,  1.49it/s]
 16%|█▋        | 10757/65536 [2:00:32<10:38:25,  1.43it/s]
 16%|█▋        | 10758/65536 [2:00:33<10:13:50,  1.49it/s]
 16%|█▋        | 10759/65536 [2:00:34<10:10:43,  1.49it/s]
 16%|█▋        | 10760/65536 [2:00:34<10:14:46,  1.48it/s]
                                                          
{'loss': 0.9695, 'learning_rate': 8.545365495285906e-07, 'epoch': 664.2}

 16%|█▋        | 10760/65536 [2:00:34<10:14:46,  1.48it/s]
 16%|█▋        | 10761/65536 [2:00:35<10:03:08,  1.51it/s]
 16%|█▋        | 10762/65536 [2:00:36<9:59:06,  1.52it/s] 
 16%|█▋        | 10763/65536 [2:00:36<10:07:17,  1.50it/s]
 16%|█▋        | 10764/65536 [2:00:37<10:10:31,  1.50it/s]
 16%|█▋        | 10765/65536 [2:00:38<10:12:35,  1.49it/s]
 16%|█▋        | 10766/65536 [2:00:38<10:15:52,  1.48it/s]
 16%|█▋        | 10767/65536 [2:00:39<10:16:32,  1.48it/s]
 16%|█▋        | 10768/65536 [2:00:40<10:23:45,  1.46it/s]
 16%|█▋        | 10769/65536 [2:00:41<10:28:07,  1.45it/s]
 16%|█▋        | 10770/65536 [2:00:41<10:38:42,  1.43it/s]
 16%|█▋        | 10771/65536 [2:00:42<10:35:40,  1.44it/s]
 16%|█▋        | 10772/65536 [2:00:43<10:22:25,  1.47it/s]
 16%|█▋        | 10773/65536 [2:00:43<10:14:13,  1.49it/s]
 16%|█▋        | 10774/65536 [2:00:44<10:46:03,  1.41it/s]
 16%|█▋        | 10775/65536 [2:00:45<10:29:06,  1.45it/s]
 16%|█▋        | 10776/65536 [2:00:45<10:30:26,  1.45it/s]
 16%|█▋        | 10777/65536 [2:00:46<10:19:03,  1.47it/s]
 16%|█▋        | 10778/65536 [2:00:47<10:21:33,  1.47it/s]
 16%|█▋        | 10779/65536 [2:00:47<10:01:27,  1.52it/s]
 16%|█▋        | 10780/65536 [2:00:48<10:03:01,  1.51it/s]
                                                          
{'loss': 0.9548, 'learning_rate': 8.542610505693645e-07, 'epoch': 665.43}

 16%|█▋        | 10780/65536 [2:00:48<10:03:01,  1.51it/s]
 16%|█▋        | 10781/65536 [2:00:49<9:57:22,  1.53it/s] 
 16%|█▋        | 10782/65536 [2:00:49<10:01:11,  1.52it/s]
 16%|█▋        | 10783/65536 [2:00:50<10:06:14,  1.51it/s]
 16%|█▋        | 10784/65536 [2:00:51<10:16:08,  1.48it/s]
 16%|█▋        | 10785/65536 [2:00:51<10:26:05,  1.46it/s]
 16%|█▋        | 10786/65536 [2:00:52<10:19:58,  1.47it/s]
 16%|█▋        | 10787/65536 [2:00:53<10:03:53,  1.51it/s]
 16%|█▋        | 10788/65536 [2:00:53<10:25:11,  1.46it/s]
 16%|█▋        | 10789/65536 [2:00:54<10:20:00,  1.47it/s]
 16%|█▋        | 10790/65536 [2:00:55<10:41:42,  1.42it/s]
 16%|█▋        | 10791/65536 [2:00:55<10:32:44,  1.44it/s]
 16%|█▋        | 10792/65536 [2:00:56<10:23:57,  1.46it/s]
 16%|█▋        | 10793/65536 [2:00:57<10:03:17,  1.51it/s]
 16%|█▋        | 10794/65536 [2:00:57<10:12:11,  1.49it/s]
 16%|█▋        | 10795/65536 [2:00:58<10:06:15,  1.50it/s]
 16%|█▋        | 10796/65536 [2:00:59<10:19:55,  1.47it/s]
 16%|█▋        | 10797/65536 [2:00:59<10:12:14,  1.49it/s]
 16%|█▋        | 10798/65536 [2:01:00<9:58:03,  1.53it/s] 
 16%|█▋        | 10799/65536 [2:01:01<9:51:57,  1.54it/s]
 16%|█▋        | 10800/65536 [2:01:01<10:05:41,  1.51it/s]
                                                          
{'loss': 0.9692, 'learning_rate': 8.539855516101383e-07, 'epoch': 666.67}

 16%|█▋        | 10800/65536 [2:01:01<10:05:41,  1.51it/s]
 16%|█▋        | 10801/65536 [2:01:02<10:28:43,  1.45it/s]
 16%|█▋        | 10802/65536 [2:01:03<10:25:05,  1.46it/s]
 16%|█▋        | 10803/65536 [2:01:03<10:06:25,  1.50it/s]
 16%|█▋        | 10804/65536 [2:01:04<10:28:08,  1.45it/s]
 16%|█▋        | 10805/65536 [2:01:05<10:23:12,  1.46it/s]
 16%|█▋        | 10806/65536 [2:01:06<10:26:38,  1.46it/s]
 16%|█▋        | 10807/65536 [2:01:06<10:23:46,  1.46it/s]
 16%|█▋        | 10808/65536 [2:01:07<10:11:31,  1.49it/s]
 16%|█▋        | 10809/65536 [2:01:08<10:27:58,  1.45it/s]
 16%|█▋        | 10810/65536 [2:01:08<10:19:39,  1.47it/s]
 16%|█▋        | 10811/65536 [2:01:09<10:05:59,  1.51it/s]
 16%|█▋        | 10812/65536 [2:01:10<10:10:43,  1.49it/s]
 16%|█▋        | 10813/65536 [2:01:10<10:08:45,  1.50it/s]
 17%|█▋        | 10814/65536 [2:01:11<10:10:02,  1.50it/s]
 17%|█▋        | 10815/65536 [2:01:12<10:01:02,  1.52it/s]
 17%|█▋        | 10816/65536 [2:01:12<10:02:38,  1.51it/s]
 17%|█▋        | 10817/65536 [2:01:13<10:22:21,  1.47it/s]
 17%|█▋        | 10818/65536 [2:01:14<10:41:30,  1.42it/s]
 17%|█▋        | 10819/65536 [2:01:14<10:11:28,  1.49it/s]
 17%|█▋        | 10820/65536 [2:01:15<10:10:35,  1.49it/s]
                                                          
{'loss': 0.9724, 'learning_rate': 8.537100526509121e-07, 'epoch': 667.9}

 17%|█▋        | 10820/65536 [2:01:15<10:10:35,  1.49it/s]
 17%|█▋        | 10821/65536 [2:01:16<9:59:31,  1.52it/s] 
 17%|█▋        | 10822/65536 [2:01:16<10:12:26,  1.49it/s]
 17%|█▋        | 10823/65536 [2:01:17<10:28:39,  1.45it/s]
 17%|█▋        | 10824/65536 [2:01:18<10:29:25,  1.45it/s]
 17%|█▋        | 10825/65536 [2:01:18<10:13:22,  1.49it/s]
 17%|█▋        | 10826/65536 [2:01:19<10:18:54,  1.47it/s]
 17%|█▋        | 10827/65536 [2:01:20<9:57:55,  1.52it/s] 
 17%|█▋        | 10828/65536 [2:01:20<9:48:24,  1.55it/s]
 17%|█▋        | 10829/65536 [2:01:21<9:48:16,  1.55it/s]
 17%|█▋        | 10830/65536 [2:01:22<10:02:21,  1.51it/s]
 17%|█▋        | 10831/65536 [2:01:22<9:57:30,  1.53it/s] 
 17%|█▋        | 10832/65536 [2:01:23<10:17:19,  1.48it/s]
 17%|█▋        | 10833/65536 [2:01:24<10:17:20,  1.48it/s]
 17%|█▋        | 10834/65536 [2:01:24<10:20:34,  1.47it/s]
 17%|█▋        | 10835/65536 [2:01:25<10:32:27,  1.44it/s]
 17%|█▋        | 10836/65536 [2:01:26<10:26:22,  1.46it/s]
 17%|█▋        | 10837/65536 [2:01:26<10:16:05,  1.48it/s]
 17%|█▋        | 10838/65536 [2:01:27<10:37:13,  1.43it/s]
 17%|█▋        | 10839/65536 [2:01:28<10:41:36,  1.42it/s]
 17%|█▋        | 10840/65536 [2:01:29<10:29:45,  1.45it/s]
                                                          
{'loss': 0.9676, 'learning_rate': 8.53434553691686e-07, 'epoch': 669.14}

 17%|█▋        | 10840/65536 [2:01:29<10:29:45,  1.45it/s]
 17%|█▋        | 10841/65536 [2:01:29<10:29:06,  1.45it/s]
 17%|█▋        | 10842/65536 [2:01:30<10:24:21,  1.46it/s]
 17%|█▋        | 10843/65536 [2:01:31<10:17:34,  1.48it/s]
 17%|█▋        | 10844/65536 [2:01:31<10:11:13,  1.49it/s]
 17%|█▋        | 10845/65536 [2:01:32<9:54:38,  1.53it/s] 
 17%|█▋        | 10846/65536 [2:01:32<9:54:24,  1.53it/s]
 17%|█▋        | 10847/65536 [2:01:33<10:02:53,  1.51it/s]
 17%|█▋        | 10848/65536 [2:01:34<9:59:42,  1.52it/s] 
 17%|█▋        | 10849/65536 [2:01:34<10:12:30,  1.49it/s]
 17%|█▋        | 10850/65536 [2:01:35<10:05:37,  1.50it/s]
 17%|█▋        | 10851/65536 [2:01:36<10:08:42,  1.50it/s]
 17%|█▋        | 10852/65536 [2:01:37<10:23:51,  1.46it/s]
 17%|█▋        | 10853/65536 [2:01:37<10:05:27,  1.51it/s]
 17%|█▋        | 10854/65536 [2:01:38<10:04:10,  1.51it/s]
 17%|█▋        | 10855/65536 [2:01:39<10:13:52,  1.48it/s]
 17%|█▋        | 10856/65536 [2:01:39<10:17:59,  1.47it/s]
 17%|█▋        | 10857/65536 [2:01:40<10:17:10,  1.48it/s]
 17%|█▋        | 10858/65536 [2:01:41<10:22:55,  1.46it/s]
 17%|█▋        | 10859/65536 [2:01:41<10:10:17,  1.49it/s]
 17%|█▋        | 10860/65536 [2:01:42<10:15:38,  1.48it/s]
                                                          
{'loss': 0.9881, 'learning_rate': 8.531590547324598e-07, 'epoch': 670.37}

 17%|█▋        | 10860/65536 [2:01:42<10:15:38,  1.48it/s]
 17%|█▋        | 10861/65536 [2:01:43<10:09:03,  1.50it/s]
 17%|█▋        | 10862/65536 [2:01:43<9:55:56,  1.53it/s] 
 17%|█▋        | 10863/65536 [2:01:44<9:57:01,  1.53it/s]
 17%|█▋        | 10864/65536 [2:01:44<9:57:49,  1.52it/s]
 17%|█▋        | 10865/65536 [2:01:45<10:18:43,  1.47it/s]
 17%|█▋        | 10866/65536 [2:01:46<10:23:32,  1.46it/s]
 17%|█▋        | 10867/65536 [2:01:47<10:05:58,  1.50it/s]
 17%|█▋        | 10868/65536 [2:01:47<10:05:41,  1.50it/s]
 17%|█▋        | 10869/65536 [2:01:48<10:20:05,  1.47it/s]
 17%|█▋        | 10870/65536 [2:01:49<10:24:58,  1.46it/s]
 17%|█▋        | 10871/65536 [2:01:49<10:43:13,  1.42it/s]
 17%|█▋        | 10872/65536 [2:01:50<10:52:22,  1.40it/s]
 17%|█▋        | 10873/65536 [2:01:51<10:35:34,  1.43it/s]
 17%|█▋        | 10874/65536 [2:01:51<10:29:33,  1.45it/s]
 17%|█▋        | 10875/65536 [2:01:52<10:24:02,  1.46it/s]
 17%|█▋        | 10876/65536 [2:01:53<10:08:24,  1.50it/s]
 17%|█▋        | 10877/65536 [2:01:53<10:12:47,  1.49it/s]
 17%|█▋        | 10878/65536 [2:01:54<9:54:38,  1.53it/s] 
 17%|█▋        | 10879/65536 [2:01:55<9:56:17,  1.53it/s]
 17%|█▋        | 10880/65536 [2:01:55<10:07:01,  1.50it/s]
                                                          
{'loss': 0.9491, 'learning_rate': 8.528835557732337e-07, 'epoch': 671.6}

 17%|█▋        | 10880/65536 [2:01:55<10:07:01,  1.50it/s]
 17%|█▋        | 10881/65536 [2:01:56<10:01:08,  1.52it/s]
 17%|█▋        | 10882/65536 [2:01:57<10:11:41,  1.49it/s]
 17%|█▋        | 10883/65536 [2:01:57<10:21:52,  1.46it/s]
 17%|█▋        | 10884/65536 [2:01:58<10:25:26,  1.46it/s]
 17%|█▋        | 10885/65536 [2:01:59<10:20:36,  1.47it/s]
 17%|█▋        | 10886/65536 [2:01:59<10:03:22,  1.51it/s]
 17%|█▋        | 10887/65536 [2:02:00<10:25:01,  1.46it/s]
 17%|█▋        | 10888/65536 [2:02:01<10:20:07,  1.47it/s]
 17%|█▋        | 10889/65536 [2:02:01<10:13:35,  1.48it/s]
 17%|█▋        | 10890/65536 [2:02:02<10:25:48,  1.46it/s]
 17%|█▋        | 10891/65536 [2:02:03<10:08:05,  1.50it/s]
 17%|█▋        | 10892/65536 [2:02:03<10:00:46,  1.52it/s]
 17%|█▋        | 10893/65536 [2:02:04<9:54:59,  1.53it/s] 
 17%|█▋        | 10894/65536 [2:02:05<10:00:44,  1.52it/s]
 17%|█▋        | 10895/65536 [2:02:05<10:10:58,  1.49it/s]
 17%|█▋        | 10896/65536 [2:02:06<10:03:36,  1.51it/s]
 17%|█▋        | 10897/65536 [2:02:07<9:47:18,  1.55it/s] 
 17%|█▋        | 10898/65536 [2:02:07<9:59:00,  1.52it/s]
 17%|█▋        | 10899/65536 [2:02:08<10:20:23,  1.47it/s]
 17%|█▋        | 10900/65536 [2:02:09<10:10:25,  1.49it/s]
                                                          
{'loss': 0.9808, 'learning_rate': 8.526080568140074e-07, 'epoch': 672.84}

 17%|█▋        | 10900/65536 [2:02:09<10:10:25,  1.49it/s]
 17%|█▋        | 10901/65536 [2:02:10<10:23:47,  1.46it/s]
 17%|█▋        | 10902/65536 [2:02:10<10:18:58,  1.47it/s]
 17%|█▋        | 10903/65536 [2:02:11<10:33:31,  1.44it/s]
 17%|█▋        | 10904/65536 [2:02:12<10:19:24,  1.47it/s]
 17%|█▋        | 10905/65536 [2:02:12<10:13:46,  1.48it/s]
 17%|█▋        | 10906/65536 [2:02:13<10:24:17,  1.46it/s]
 17%|█▋        | 10907/65536 [2:02:14<10:11:58,  1.49it/s]
 17%|█▋        | 10908/65536 [2:02:14<9:56:02,  1.53it/s] 
 17%|█▋        | 10909/65536 [2:02:15<10:06:43,  1.50it/s]
 17%|█▋        | 10910/65536 [2:02:16<10:00:11,  1.52it/s]
 17%|█▋        | 10911/65536 [2:02:16<10:24:23,  1.46it/s]
 17%|█▋        | 10912/65536 [2:02:17<10:07:43,  1.50it/s]
 17%|█▋        | 10913/65536 [2:02:18<10:06:37,  1.50it/s]
 17%|█▋        | 10914/65536 [2:02:18<9:54:28,  1.53it/s] 
 17%|█▋        | 10915/65536 [2:02:19<9:53:10,  1.53it/s]
 17%|█▋        | 10916/65536 [2:02:20<10:14:01,  1.48it/s]
 17%|█▋        | 10917/65536 [2:02:20<9:53:12,  1.53it/s] 
 17%|█▋        | 10918/65536 [2:02:21<9:53:31,  1.53it/s]
 17%|█▋        | 10919/65536 [2:02:22<10:24:08,  1.46it/s]
 17%|█▋        | 10920/65536 [2:02:22<10:17:06,  1.48it/s]
                                                          
{'loss': 0.9948, 'learning_rate': 8.523325578547813e-07, 'epoch': 674.07}

 17%|█▋        | 10920/65536 [2:02:22<10:17:06,  1.48it/s]
 17%|█▋        | 10921/65536 [2:02:23<10:08:45,  1.50it/s]
 17%|█▋        | 10922/65536 [2:02:23<9:54:14,  1.53it/s] 
 17%|█▋        | 10923/65536 [2:02:24<9:57:57,  1.52it/s]
 17%|█▋        | 10924/65536 [2:02:25<10:19:18,  1.47it/s]
 17%|█▋        | 10925/65536 [2:02:26<10:16:40,  1.48it/s]
 17%|█▋        | 10926/65536 [2:02:26<10:15:42,  1.48it/s]
 17%|█▋        | 10927/65536 [2:02:27<10:26:57,  1.45it/s]
 17%|█▋        | 10928/65536 [2:02:28<10:36:55,  1.43it/s]
 17%|█▋        | 10929/65536 [2:02:28<10:27:19,  1.45it/s]
 17%|█▋        | 10930/65536 [2:02:29<10:22:24,  1.46it/s]
 17%|█▋        | 10931/65536 [2:02:30<10:22:03,  1.46it/s]
 17%|█▋        | 10932/65536 [2:02:30<10:24:43,  1.46it/s]
 17%|█▋        | 10933/65536 [2:02:31<10:13:07,  1.48it/s]
 17%|█▋        | 10934/65536 [2:02:32<9:59:26,  1.52it/s] 
 17%|█▋        | 10935/65536 [2:02:32<10:04:34,  1.51it/s]
 17%|█▋        | 10936/65536 [2:02:33<10:36:06,  1.43it/s]
 17%|█▋        | 10937/65536 [2:02:34<10:13:06,  1.48it/s]
 17%|█▋        | 10938/65536 [2:02:34<10:15:06,  1.48it/s]
 17%|█▋        | 10939/65536 [2:02:35<10:39:34,  1.42it/s]
 17%|█▋        | 10940/65536 [2:02:36<10:31:10,  1.44it/s]
                                                          
{'loss': 0.9582, 'learning_rate': 8.520570588955552e-07, 'epoch': 675.31}

 17%|█▋        | 10940/65536 [2:02:36<10:31:10,  1.44it/s]
 17%|█▋        | 10941/65536 [2:02:37<10:24:10,  1.46it/s]
 17%|█▋        | 10942/65536 [2:02:37<10:13:41,  1.48it/s]
 17%|█▋        | 10943/65536 [2:02:38<10:07:04,  1.50it/s]
 17%|█▋        | 10944/65536 [2:02:38<9:47:06,  1.55it/s] 
 17%|█▋        | 10945/65536 [2:02:39<9:49:39,  1.54it/s]
 17%|█▋        | 10946/65536 [2:02:40<9:45:49,  1.55it/s]
 17%|█▋        | 10947/65536 [2:02:40<9:53:24,  1.53it/s]
 17%|█▋        | 10948/65536 [2:02:41<9:58:12,  1.52it/s]
 17%|█▋        | 10949/65536 [2:02:42<10:03:16,  1.51it/s]
 17%|█▋        | 10950/65536 [2:02:42<9:59:55,  1.52it/s] 
 17%|█▋        | 10951/65536 [2:02:43<10:00:50,  1.51it/s]
 17%|█▋        | 10952/65536 [2:02:44<10:37:19,  1.43it/s]
 17%|█▋        | 10953/65536 [2:02:44<10:23:12,  1.46it/s]
 17%|█▋        | 10954/65536 [2:02:45<10:18:12,  1.47it/s]
 17%|█▋        | 10955/65536 [2:02:46<10:27:48,  1.45it/s]
 17%|█▋        | 10956/65536 [2:02:47<10:17:52,  1.47it/s]
 17%|█▋        | 10957/65536 [2:02:47<10:14:47,  1.48it/s]
 17%|█▋        | 10958/65536 [2:02:48<10:06:00,  1.50it/s]
 17%|█▋        | 10959/65536 [2:02:48<9:55:25,  1.53it/s] 
 17%|█▋        | 10960/65536 [2:02:49<9:51:31,  1.54it/s]
                                                         
{'loss': 0.9833, 'learning_rate': 8.51781559936329e-07, 'epoch': 676.54}

 17%|█▋        | 10960/65536 [2:02:49<9:51:31,  1.54it/s]
 17%|█▋        | 10961/65536 [2:02:50<10:04:26,  1.50it/s]
 17%|█▋        | 10962/65536 [2:02:50<10:14:39,  1.48it/s]
 17%|█▋        | 10963/65536 [2:02:51<10:25:12,  1.45it/s]
 17%|█▋        | 10964/65536 [2:02:52<10:11:32,  1.49it/s]
 17%|█▋        | 10965/65536 [2:02:52<9:59:12,  1.52it/s] 
 17%|█▋        | 10966/65536 [2:02:53<9:53:44,  1.53it/s]
 17%|█▋        | 10967/65536 [2:02:54<9:55:51,  1.53it/s]
 17%|█▋        | 10968/65536 [2:02:55<10:34:05,  1.43it/s]
 17%|█▋        | 10969/65536 [2:02:55<10:19:36,  1.47it/s]
 17%|█▋        | 10970/65536 [2:02:56<10:20:51,  1.46it/s]
 17%|█▋        | 10971/65536 [2:02:57<10:12:50,  1.48it/s]
 17%|█▋        | 10972/65536 [2:02:57<10:18:15,  1.47it/s]
 17%|█▋        | 10973/65536 [2:02:58<10:24:08,  1.46it/s]
 17%|█▋        | 10974/65536 [2:02:59<10:12:50,  1.48it/s]
 17%|█▋        | 10975/65536 [2:02:59<10:18:57,  1.47it/s]
 17%|█▋        | 10976/65536 [2:03:00<10:09:10,  1.49it/s]
 17%|█▋        | 10977/65536 [2:03:01<10:14:50,  1.48it/s]
 17%|█▋        | 10978/65536 [2:03:01<10:15:09,  1.48it/s]
 17%|█▋        | 10979/65536 [2:03:02<10:05:25,  1.50it/s]
 17%|█▋        | 10980/65536 [2:03:03<10:17:59,  1.47it/s]
                                                          
{'loss': 0.9528, 'learning_rate': 8.515060609771029e-07, 'epoch': 677.78}

 17%|█▋        | 10980/65536 [2:03:03<10:17:59,  1.47it/s]
 17%|█▋        | 10981/65536 [2:03:03<10:17:39,  1.47it/s]
 17%|█▋        | 10982/65536 [2:03:04<10:15:51,  1.48it/s]
 17%|█▋        | 10983/65536 [2:03:05<10:02:05,  1.51it/s]
 17%|█▋        | 10984/65536 [2:03:05<10:27:54,  1.45it/s]
 17%|█▋        | 10985/65536 [2:03:06<10:09:36,  1.49it/s]
 17%|█▋        | 10986/65536 [2:03:07<10:16:23,  1.47it/s]
 17%|█▋        | 10987/65536 [2:03:07<10:14:59,  1.48it/s]
 17%|█▋        | 10988/65536 [2:03:08<10:02:04,  1.51it/s]
 17%|█▋        | 10989/65536 [2:03:09<10:13:40,  1.48it/s]
 17%|█▋        | 10990/65536 [2:03:09<10:06:37,  1.50it/s]
 17%|█▋        | 10991/65536 [2:03:10<9:55:13,  1.53it/s] 
 17%|█▋        | 10992/65536 [2:03:11<10:07:25,  1.50it/s]
 17%|█▋        | 10993/65536 [2:03:11<10:27:16,  1.45it/s]
 17%|█▋        | 10994/65536 [2:03:12<10:29:06,  1.44it/s]
 17%|█▋        | 10995/65536 [2:03:13<10:21:01,  1.46it/s]
 17%|█▋        | 10996/65536 [2:03:13<10:20:34,  1.46it/s]
 17%|█▋        | 10997/65536 [2:03:14<10:16:07,  1.48it/s]
 17%|█▋        | 10998/65536 [2:03:15<10:04:49,  1.50it/s]
 17%|█▋        | 10999/65536 [2:03:15<10:01:32,  1.51it/s]
 17%|█▋        | 11000/65536 [2:03:16<10:18:00,  1.47it/s]
                                                          
{'loss': 0.9779, 'learning_rate': 8.512305620178768e-07, 'epoch': 679.01}

 17%|█▋        | 11000/65536 [2:03:16<10:18:00,  1.47it/s]
 17%|█▋        | 11001/65536 [2:03:17<10:06:21,  1.50it/s]
 17%|█▋        | 11002/65536 [2:03:17<10:03:14,  1.51it/s]
 17%|█▋        | 11003/65536 [2:03:18<9:51:06,  1.54it/s] 
 17%|█▋        | 11004/65536 [2:03:19<9:45:24,  1.55it/s]
 17%|█▋        | 11005/65536 [2:03:19<9:39:08,  1.57it/s]
 17%|█▋        | 11006/65536 [2:03:20<10:02:59,  1.51it/s]
 17%|█▋        | 11007/65536 [2:03:21<9:50:38,  1.54it/s] 
 17%|█▋        | 11008/65536 [2:03:21<10:05:51,  1.50it/s]
 17%|█▋        | 11009/65536 [2:03:22<10:05:05,  1.50it/s]
 17%|█▋        | 11010/65536 [2:03:23<10:16:08,  1.47it/s]
 17%|█▋        | 11011/65536 [2:03:23<10:05:08,  1.50it/s]
 17%|█▋        | 11012/65536 [2:03:24<10:02:15,  1.51it/s]
 17%|█▋        | 11013/65536 [2:03:25<10:23:14,  1.46it/s]
 17%|█▋        | 11014/65536 [2:03:25<10:20:23,  1.46it/s]
 17%|█▋        | 11015/65536 [2:03:26<10:10:32,  1.49it/s]
 17%|█▋        | 11016/65536 [2:03:27<10:08:34,  1.49it/s]
 17%|█▋        | 11017/65536 [2:03:27<10:27:16,  1.45it/s]
 17%|█▋        | 11018/65536 [2:03:28<10:27:26,  1.45it/s]
 17%|█▋        | 11019/65536 [2:03:29<10:20:50,  1.46it/s]
 17%|█▋        | 11020/65536 [2:03:29<10:12:08,  1.48it/s]
                                                          
{'loss': 0.9711, 'learning_rate': 8.509550630586507e-07, 'epoch': 680.25}

 17%|█▋        | 11020/65536 [2:03:29<10:12:08,  1.48it/s]
 17%|█▋        | 11021/65536 [2:03:30<10:22:39,  1.46it/s]
 17%|█▋        | 11022/65536 [2:03:31<10:09:44,  1.49it/s]
 17%|█▋        | 11023/65536 [2:03:32<10:22:25,  1.46it/s]
 17%|█▋        | 11024/65536 [2:03:32<10:15:29,  1.48it/s]
 17%|█▋        | 11025/65536 [2:03:33<10:11:35,  1.49it/s]
 17%|█▋        | 11026/65536 [2:03:34<10:21:49,  1.46it/s]
 17%|█▋        | 11027/65536 [2:03:34<10:37:51,  1.42it/s]
 17%|█▋        | 11028/65536 [2:03:35<10:13:24,  1.48it/s]
 17%|█▋        | 11029/65536 [2:03:36<10:10:36,  1.49it/s]
 17%|█▋        | 11030/65536 [2:03:36<9:59:30,  1.52it/s] 
 17%|█▋        | 11031/65536 [2:03:37<9:56:47,  1.52it/s]
 17%|█▋        | 11032/65536 [2:03:38<9:55:28,  1.53it/s]
 17%|█▋        | 11033/65536 [2:03:38<10:25:57,  1.45it/s]
 17%|█▋        | 11034/65536 [2:03:39<10:22:04,  1.46it/s]
 17%|█▋        | 11035/65536 [2:03:40<10:50:27,  1.40it/s]
 17%|█▋        | 11036/65536 [2:03:40<10:25:30,  1.45it/s]
 17%|█▋        | 11037/65536 [2:03:41<10:19:28,  1.47it/s]
 17%|█▋        | 11038/65536 [2:03:42<10:15:46,  1.48it/s]
 17%|█▋        | 11039/65536 [2:03:42<10:06:34,  1.50it/s]
 17%|█▋        | 11040/65536 [2:03:43<10:00:40,  1.51it/s]
                                                          
{'loss': 0.9633, 'learning_rate': 8.506795640994246e-07, 'epoch': 681.48}

 17%|█▋        | 11040/65536 [2:03:43<10:00:40,  1.51it/s]
 17%|█▋        | 11041/65536 [2:03:44<10:07:51,  1.49it/s]
 17%|█▋        | 11042/65536 [2:03:44<10:09:34,  1.49it/s]
 17%|█▋        | 11043/65536 [2:03:45<10:05:52,  1.50it/s]
 17%|█▋        | 11044/65536 [2:03:46<9:58:07,  1.52it/s] 
 17%|█▋        | 11045/65536 [2:03:46<9:49:37,  1.54it/s]
 17%|█▋        | 11046/65536 [2:03:47<9:59:36,  1.51it/s]
 17%|█▋        | 11047/65536 [2:03:48<10:08:03,  1.49it/s]
 17%|█▋        | 11048/65536 [2:03:48<10:05:53,  1.50it/s]
 17%|█▋        | 11049/65536 [2:03:49<10:27:47,  1.45it/s]
 17%|█▋        | 11050/65536 [2:03:50<10:35:15,  1.43it/s]
 17%|█▋        | 11051/65536 [2:03:50<10:06:54,  1.50it/s]
 17%|█▋        | 11052/65536 [2:03:51<9:51:41,  1.53it/s] 
 17%|█▋        | 11053/65536 [2:03:52<9:58:16,  1.52it/s]
 17%|█▋        | 11054/65536 [2:03:52<10:10:26,  1.49it/s]
 17%|█▋        | 11055/65536 [2:03:53<10:12:08,  1.48it/s]
 17%|█▋        | 11056/65536 [2:03:54<10:03:36,  1.50it/s]
 17%|█▋        | 11057/65536 [2:03:54<10:05:26,  1.50it/s]
 17%|█▋        | 11058/65536 [2:03:55<10:10:47,  1.49it/s]
 17%|█▋        | 11059/65536 [2:03:56<10:06:02,  1.50it/s]
 17%|█▋        | 11060/65536 [2:03:56<10:06:14,  1.50it/s]
                                                          
{'loss': 0.9759, 'learning_rate': 8.504040651401984e-07, 'epoch': 682.72}

 17%|█▋        | 11060/65536 [2:03:56<10:06:14,  1.50it/s]
 17%|█▋        | 11061/65536 [2:03:57<10:06:21,  1.50it/s]
 17%|█▋        | 11062/65536 [2:03:58<9:56:33,  1.52it/s] 
 17%|█▋        | 11063/65536 [2:03:58<10:04:26,  1.50it/s]
 17%|█▋        | 11064/65536 [2:03:59<10:18:55,  1.47it/s]
 17%|█▋        | 11065/65536 [2:04:00<10:28:01,  1.45it/s]
 17%|█▋        | 11066/65536 [2:04:01<10:27:42,  1.45it/s]
 17%|█▋        | 11067/65536 [2:04:01<10:33:40,  1.43it/s]
 17%|█▋        | 11068/65536 [2:04:02<10:26:26,  1.45it/s]
 17%|█▋        | 11069/65536 [2:04:03<10:15:07,  1.48it/s]
 17%|█▋        | 11070/65536 [2:04:03<10:12:22,  1.48it/s]
 17%|█▋        | 11071/65536 [2:04:04<9:55:47,  1.52it/s] 
 17%|█▋        | 11072/65536 [2:04:04<9:46:32,  1.55it/s]
 17%|█▋        | 11073/65536 [2:04:05<10:01:11,  1.51it/s]
 17%|█▋        | 11074/65536 [2:04:06<10:04:46,  1.50it/s]
 17%|█▋        | 11075/65536 [2:04:06<9:58:05,  1.52it/s] 
 17%|█▋        | 11076/65536 [2:04:07<9:52:09,  1.53it/s]
 17%|█▋        | 11077/65536 [2:04:08<9:51:03,  1.54it/s]
 17%|█▋        | 11078/65536 [2:04:08<9:56:04,  1.52it/s]
 17%|█▋        | 11079/65536 [2:04:09<9:53:23,  1.53it/s]
 17%|█▋        | 11080/65536 [2:04:10<9:57:01,  1.52it/s]
                                                         
{'loss': 0.9906, 'learning_rate': 8.501285661809722e-07, 'epoch': 683.95}

 17%|█▋        | 11080/65536 [2:04:10<9:57:01,  1.52it/s]
 17%|█▋        | 11081/65536 [2:04:11<10:31:02,  1.44it/s]
 17%|█▋        | 11082/65536 [2:04:11<10:09:33,  1.49it/s]
 17%|█▋        | 11083/65536 [2:04:12<10:07:38,  1.49it/s]
 17%|█▋        | 11084/65536 [2:04:12<10:11:30,  1.48it/s]
 17%|█▋        | 11085/65536 [2:04:13<10:04:08,  1.50it/s]
 17%|█▋        | 11086/65536 [2:04:14<10:09:21,  1.49it/s]
 17%|█▋        | 11087/65536 [2:04:14<9:55:56,  1.52it/s] 
 17%|█▋        | 11088/65536 [2:04:15<9:51:45,  1.53it/s]
 17%|█▋        | 11089/65536 [2:04:16<10:23:57,  1.45it/s]
 17%|█▋        | 11090/65536 [2:04:17<10:17:14,  1.47it/s]
 17%|█▋        | 11091/65536 [2:04:17<10:10:49,  1.49it/s]
 17%|█▋        | 11092/65536 [2:04:18<10:01:09,  1.51it/s]
 17%|█▋        | 11093/65536 [2:04:19<10:07:48,  1.49it/s]
 17%|█▋        | 11094/65536 [2:04:19<10:01:34,  1.51it/s]
 17%|█▋        | 11095/65536 [2:04:20<10:11:59,  1.48it/s]
 17%|█▋        | 11096/65536 [2:04:21<10:07:46,  1.49it/s]
 17%|█▋        | 11097/65536 [2:04:21<10:08:58,  1.49it/s]
 17%|█▋        | 11098/65536 [2:04:22<10:30:52,  1.44it/s]
 17%|█▋        | 11099/65536 [2:04:23<10:06:52,  1.49it/s]
 17%|█▋        | 11100/65536 [2:04:23<10:07:52,  1.49it/s]
                                                          
{'loss': 0.9805, 'learning_rate': 8.49853067221746e-07, 'epoch': 685.19}

 17%|█▋        | 11100/65536 [2:04:23<10:07:52,  1.49it/s]
 17%|█▋        | 11101/65536 [2:04:24<10:28:55,  1.44it/s]
 17%|█▋        | 11102/65536 [2:04:25<10:16:21,  1.47it/s]
 17%|█▋        | 11103/65536 [2:04:25<10:22:32,  1.46it/s]
 17%|█▋        | 11104/65536 [2:04:26<10:00:13,  1.51it/s]
 17%|█▋        | 11105/65536 [2:04:27<10:00:15,  1.51it/s]
 17%|█▋        | 11106/65536 [2:04:27<10:02:29,  1.51it/s]
 17%|█▋        | 11107/65536 [2:04:28<10:11:10,  1.48it/s]
 17%|█▋        | 11108/65536 [2:04:29<10:10:21,  1.49it/s]
 17%|█▋        | 11109/65536 [2:04:29<9:58:51,  1.51it/s] 
 17%|█▋        | 11110/65536 [2:04:30<10:06:13,  1.50it/s]
 17%|█▋        | 11111/65536 [2:04:31<10:08:02,  1.49it/s]
 17%|█▋        | 11112/65536 [2:04:31<10:11:35,  1.48it/s]
 17%|█▋        | 11113/65536 [2:04:32<9:53:40,  1.53it/s] 
 17%|█▋        | 11114/65536 [2:04:33<10:45:49,  1.40it/s]
 17%|█▋        | 11115/65536 [2:04:33<10:22:08,  1.46it/s]
 17%|█▋        | 11116/65536 [2:04:34<10:05:40,  1.50it/s]
 17%|█▋        | 11117/65536 [2:04:35<10:02:45,  1.50it/s]
 17%|█▋        | 11118/65536 [2:04:35<9:54:32,  1.53it/s] 
 17%|█▋        | 11119/65536 [2:04:36<9:57:03,  1.52it/s]
 17%|█▋        | 11120/65536 [2:04:37<9:55:49,  1.52it/s]
                                                         
{'loss': 0.9763, 'learning_rate': 8.495775682625199e-07, 'epoch': 686.42}

 17%|█▋        | 11120/65536 [2:04:37<9:55:49,  1.52it/s]
 17%|█▋        | 11121/65536 [2:04:37<9:46:08,  1.55it/s]
 17%|█▋        | 11122/65536 [2:04:38<9:39:28,  1.57it/s]
 17%|█▋        | 11123/65536 [2:04:39<9:52:37,  1.53it/s]
 17%|█▋        | 11124/65536 [2:04:39<10:09:09,  1.49it/s]
 17%|█▋        | 11125/65536 [2:04:40<9:59:31,  1.51it/s] 
 17%|█▋        | 11126/65536 [2:04:41<10:15:13,  1.47it/s]
 17%|█▋        | 11127/65536 [2:04:41<10:06:03,  1.50it/s]
 17%|█▋        | 11128/65536 [2:04:42<10:03:02,  1.50it/s]
 17%|█▋        | 11129/65536 [2:04:43<10:08:53,  1.49it/s]
 17%|█▋        | 11130/65536 [2:04:43<10:27:49,  1.44it/s]
 17%|█▋        | 11131/65536 [2:04:44<10:13:30,  1.48it/s]
 17%|█▋        | 11132/65536 [2:04:45<9:57:33,  1.52it/s] 
 17%|█▋        | 11133/65536 [2:04:45<10:05:15,  1.50it/s]
 17%|█▋        | 11134/65536 [2:04:46<9:53:53,  1.53it/s] 
 17%|█▋        | 11135/65536 [2:04:47<9:58:42,  1.51it/s]
 17%|█▋        | 11136/65536 [2:04:47<10:08:37,  1.49it/s]
 17%|█▋        | 11137/65536 [2:04:48<10:04:25,  1.50it/s]
 17%|█▋        | 11138/65536 [2:04:49<10:01:02,  1.51it/s]
 17%|█▋        | 11139/65536 [2:04:49<9:46:10,  1.55it/s] 
 17%|█▋        | 11140/65536 [2:04:50<9:54:34,  1.52it/s]
                                                         
{'loss': 0.9719, 'learning_rate': 8.493020693032938e-07, 'epoch': 687.65}

 17%|█▋        | 11140/65536 [2:04:50<9:54:34,  1.52it/s]
 17%|█▋        | 11141/65536 [2:04:51<9:50:35,  1.54it/s]
 17%|█▋        | 11142/65536 [2:04:51<10:02:56,  1.50it/s]
 17%|█▋        | 11143/65536 [2:04:52<9:58:18,  1.52it/s] 
 17%|█▋        | 11144/65536 [2:04:53<10:13:48,  1.48it/s]
 17%|█▋        | 11145/65536 [2:04:53<10:34:36,  1.43it/s]
 17%|█▋        | 11146/65536 [2:04:54<10:59:17,  1.37it/s]
 17%|█▋        | 11147/65536 [2:04:55<10:46:10,  1.40it/s]
 17%|█▋        | 11148/65536 [2:04:55<10:36:43,  1.42it/s]
 17%|█▋        | 11149/65536 [2:04:56<10:08:11,  1.49it/s]
 17%|█▋        | 11150/65536 [2:04:57<10:05:12,  1.50it/s]
 17%|█▋        | 11151/65536 [2:04:57<10:12:46,  1.48it/s]
 17%|█▋        | 11152/65536 [2:04:58<10:02:23,  1.50it/s]
 17%|█▋        | 11153/65536 [2:04:59<9:52:01,  1.53it/s] 
 17%|█▋        | 11154/65536 [2:04:59<10:06:54,  1.49it/s]
 17%|█▋        | 11155/65536 [2:05:00<10:14:50,  1.47it/s]
 17%|█▋        | 11156/65536 [2:05:01<10:16:46,  1.47it/s]
 17%|█▋        | 11157/65536 [2:05:01<10:10:00,  1.49it/s]
 17%|█▋        | 11158/65536 [2:05:02<10:01:39,  1.51it/s]
 17%|█▋        | 11159/65536 [2:05:03<9:52:07,  1.53it/s] 
 17%|█▋        | 11160/65536 [2:05:03<9:51:58,  1.53it/s]
                                                         
{'loss': 0.9586, 'learning_rate': 8.490265703440676e-07, 'epoch': 688.89}

 17%|█▋        | 11160/65536 [2:05:03<9:51:58,  1.53it/s]
 17%|█▋        | 11161/65536 [2:05:04<10:22:57,  1.45it/s]
 17%|█▋        | 11162/65536 [2:05:05<10:43:09,  1.41it/s]
 17%|█▋        | 11163/65536 [2:05:06<10:48:33,  1.40it/s]
 17%|█▋        | 11164/65536 [2:05:06<10:41:18,  1.41it/s]
 17%|█▋        | 11165/65536 [2:05:07<10:36:37,  1.42it/s]
 17%|█▋        | 11166/65536 [2:05:08<10:30:05,  1.44it/s]
 17%|█▋        | 11167/65536 [2:05:08<10:22:13,  1.46it/s]
 17%|█▋        | 11168/65536 [2:05:09<10:23:49,  1.45it/s]
 17%|█▋        | 11169/65536 [2:05:10<10:17:02,  1.47it/s]
 17%|█▋        | 11170/65536 [2:05:10<9:56:53,  1.52it/s] 
 17%|█▋        | 11171/65536 [2:05:11<10:02:14,  1.50it/s]
 17%|█▋        | 11172/65536 [2:05:12<9:55:30,  1.52it/s] 
 17%|█▋        | 11173/65536 [2:05:12<9:51:20,  1.53it/s]
 17%|█▋        | 11174/65536 [2:05:13<9:45:32,  1.55it/s]
 17%|█▋        | 11175/65536 [2:05:14<9:45:12,  1.55it/s]
 17%|█▋        | 11176/65536 [2:05:14<10:00:56,  1.51it/s]
 17%|█▋        | 11177/65536 [2:05:15<9:52:39,  1.53it/s] 
 17%|█▋        | 11178/65536 [2:05:16<9:52:01,  1.53it/s]
 17%|█▋        | 11179/65536 [2:05:16<10:17:00,  1.47it/s]
 17%|█▋        | 11180/65536 [2:05:17<10:01:57,  1.50it/s]
                                                          
{'loss': 0.984, 'learning_rate': 8.487510713848414e-07, 'epoch': 690.12}

 17%|█▋        | 11180/65536 [2:05:17<10:01:57,  1.50it/s]
 17%|█▋        | 11181/65536 [2:05:18<9:57:03,  1.52it/s] 
 17%|█▋        | 11182/65536 [2:05:18<10:01:23,  1.51it/s]
 17%|█▋        | 11183/65536 [2:05:19<10:02:30,  1.50it/s]
 17%|█▋        | 11184/65536 [2:05:20<10:11:31,  1.48it/s]
 17%|█▋        | 11185/65536 [2:05:20<9:56:35,  1.52it/s] 
 17%|█▋        | 11186/65536 [2:05:21<9:52:03,  1.53it/s]
 17%|█▋        | 11187/65536 [2:05:22<10:08:47,  1.49it/s]
 17%|█▋        | 11188/65536 [2:05:22<10:04:59,  1.50it/s]
 17%|█▋        | 11189/65536 [2:05:23<10:16:51,  1.47it/s]
 17%|█▋        | 11190/65536 [2:05:24<10:26:11,  1.45it/s]
 17%|█▋        | 11191/65536 [2:05:24<10:03:41,  1.50it/s]
 17%|█▋        | 11192/65536 [2:05:25<10:07:50,  1.49it/s]
 17%|█▋        | 11193/65536 [2:05:26<10:06:14,  1.49it/s]
 17%|█▋        | 11194/65536 [2:05:26<9:59:22,  1.51it/s] 
 17%|█▋        | 11195/65536 [2:05:27<10:27:01,  1.44it/s]
 17%|█▋        | 11196/65536 [2:05:28<10:22:58,  1.45it/s]
 17%|█▋        | 11197/65536 [2:05:28<10:23:27,  1.45it/s]
 17%|█▋        | 11198/65536 [2:05:29<10:11:13,  1.48it/s]
 17%|█▋        | 11199/65536 [2:05:30<10:08:23,  1.49it/s]
 17%|█▋        | 11200/65536 [2:05:30<9:52:08,  1.53it/s] 
                                                         
{'loss': 0.9626, 'learning_rate': 8.484755724256152e-07, 'epoch': 691.36}

 17%|█▋        | 11200/65536 [2:05:30<9:52:08,  1.53it/s]
 17%|█▋        | 11201/65536 [2:05:31<9:49:18,  1.54it/s]
 17%|█▋        | 11202/65536 [2:05:32<9:44:26,  1.55it/s]
 17%|█▋        | 11203/65536 [2:05:32<9:51:17,  1.53it/s]
 17%|█▋        | 11204/65536 [2:05:33<9:46:25,  1.54it/s]
 17%|█▋        | 11205/65536 [2:05:34<10:00:48,  1.51it/s]
 17%|█▋        | 11206/65536 [2:05:34<9:58:45,  1.51it/s] 
 17%|█▋        | 11207/65536 [2:05:35<10:03:31,  1.50it/s]
 17%|█▋        | 11208/65536 [2:05:36<10:27:05,  1.44it/s]
 17%|█▋        | 11209/65536 [2:05:36<10:12:50,  1.48it/s]
 17%|█▋        | 11210/65536 [2:05:37<10:13:04,  1.48it/s]
 17%|█▋        | 11211/65536 [2:05:38<10:39:39,  1.42it/s]
 17%|█▋        | 11212/65536 [2:05:39<10:43:09,  1.41it/s]
 17%|█▋        | 11213/65536 [2:05:39<10:29:20,  1.44it/s]
 17%|█▋        | 11214/65536 [2:05:40<10:15:24,  1.47it/s]
 17%|█▋        | 11215/65536 [2:05:40<10:14:17,  1.47it/s]
 17%|█▋        | 11216/65536 [2:05:41<10:09:03,  1.49it/s]
 17%|█▋        | 11217/65536 [2:05:42<9:57:57,  1.51it/s] 
 17%|█▋        | 11218/65536 [2:05:42<10:04:55,  1.50it/s]
 17%|█▋        | 11219/65536 [2:05:43<10:23:18,  1.45it/s]
 17%|█▋        | 11220/65536 [2:05:44<9:53:25,  1.53it/s] 
                                                         
{'loss': 0.9656, 'learning_rate': 8.482000734663891e-07, 'epoch': 692.59}

 17%|█▋        | 11220/65536 [2:05:44<9:53:25,  1.53it/s]
 17%|█▋        | 11221/65536 [2:05:44<10:05:27,  1.50it/s]
 17%|█▋        | 11222/65536 [2:05:45<9:55:34,  1.52it/s] 
 17%|█▋        | 11223/65536 [2:05:46<9:46:41,  1.54it/s]
 17%|█▋        | 11224/65536 [2:05:46<9:50:09,  1.53it/s]
 17%|█▋        | 11225/65536 [2:05:47<10:15:00,  1.47it/s]
 17%|█▋        | 11226/65536 [2:05:48<10:09:04,  1.49it/s]
 17%|█▋        | 11227/65536 [2:05:49<10:25:14,  1.45it/s]
 17%|█▋        | 11228/65536 [2:05:49<10:09:13,  1.49it/s]
 17%|█▋        | 11229/65536 [2:05:50<10:10:38,  1.48it/s]
 17%|█▋        | 11230/65536 [2:05:51<10:24:57,  1.45it/s]
 17%|█▋        | 11231/65536 [2:05:51<10:38:29,  1.42it/s]
 17%|█▋        | 11232/65536 [2:05:52<10:18:32,  1.46it/s]
 17%|█▋        | 11233/65536 [2:05:53<10:21:33,  1.46it/s]
 17%|█▋        | 11234/65536 [2:05:53<10:22:36,  1.45it/s]
 17%|█▋        | 11235/65536 [2:05:54<10:17:13,  1.47it/s]
 17%|█▋        | 11236/65536 [2:05:55<10:11:52,  1.48it/s]
 17%|█▋        | 11237/65536 [2:05:55<10:16:12,  1.47it/s]
 17%|█▋        | 11238/65536 [2:05:56<10:20:21,  1.46it/s]
 17%|█▋        | 11239/65536 [2:05:57<10:12:23,  1.48it/s]
 17%|█▋        | 11240/65536 [2:05:57<10:10:50,  1.48it/s]
                                                          
{'loss': 0.9453, 'learning_rate': 8.479245745071629e-07, 'epoch': 693.83}

 17%|█▋        | 11240/65536 [2:05:57<10:10:50,  1.48it/s]
 17%|█▋        | 11241/65536 [2:05:58<10:01:36,  1.50it/s]
 17%|█▋        | 11242/65536 [2:05:59<9:48:23,  1.54it/s] 
 17%|█▋        | 11243/65536 [2:05:59<10:11:23,  1.48it/s]
 17%|█▋        | 11244/65536 [2:06:00<10:06:25,  1.49it/s]
 17%|█▋        | 11245/65536 [2:06:01<10:08:56,  1.49it/s]
 17%|█▋        | 11246/65536 [2:06:01<9:59:14,  1.51it/s] 
 17%|█▋        | 11247/65536 [2:06:02<9:57:36,  1.51it/s]
 17%|█▋        | 11248/65536 [2:06:03<10:08:40,  1.49it/s]
 17%|█▋        | 11249/65536 [2:06:03<10:05:27,  1.49it/s]
 17%|█▋        | 11250/65536 [2:06:04<10:04:22,  1.50it/s]
 17%|█▋        | 11251/65536 [2:06:05<10:16:44,  1.47it/s]
 17%|█▋        | 11252/65536 [2:06:05<10:18:35,  1.46it/s]
 17%|█▋        | 11253/65536 [2:06:06<10:09:34,  1.48it/s]
 17%|█▋        | 11254/65536 [2:06:07<10:03:55,  1.50it/s]
 17%|█▋        | 11255/65536 [2:06:07<9:57:12,  1.51it/s] 
 17%|█▋        | 11256/65536 [2:06:08<9:59:47,  1.51it/s]
 17%|█▋        | 11257/65536 [2:06:09<9:52:21,  1.53it/s]
 17%|█▋        | 11258/65536 [2:06:09<10:01:36,  1.50it/s]
 17%|█▋        | 11259/65536 [2:06:10<10:02:46,  1.50it/s]
 17%|█▋        | 11260/65536 [2:06:11<10:37:15,  1.42it/s]
                                                          
{'loss': 0.9683, 'learning_rate': 8.476490755479368e-07, 'epoch': 695.06}

 17%|█▋        | 11260/65536 [2:06:11<10:37:15,  1.42it/s]
 17%|█▋        | 11261/65536 [2:06:11<10:27:50,  1.44it/s]
 17%|█▋        | 11262/65536 [2:06:12<10:20:55,  1.46it/s]
 17%|█▋        | 11263/65536 [2:06:13<10:09:09,  1.48it/s]
 17%|█▋        | 11264/65536 [2:06:13<10:09:06,  1.49it/s]
 17%|█▋        | 11265/65536 [2:06:14<9:47:48,  1.54it/s] 
 17%|█▋        | 11266/65536 [2:06:15<9:50:10,  1.53it/s]
 17%|█▋        | 11267/65536 [2:06:15<9:57:22,  1.51it/s]
 17%|█▋        | 11268/65536 [2:06:16<9:52:51,  1.53it/s]
 17%|█▋        | 11269/65536 [2:06:17<10:00:23,  1.51it/s]
 17%|█▋        | 11270/65536 [2:06:17<9:51:02,  1.53it/s] 
 17%|█▋        | 11271/65536 [2:06:18<9:47:56,  1.54it/s]
 17%|█▋        | 11272/65536 [2:06:19<9:47:12,  1.54it/s]
 17%|█▋        | 11273/65536 [2:06:19<10:12:21,  1.48it/s]
 17%|█▋        | 11274/65536 [2:06:20<10:02:02,  1.50it/s]
 17%|█▋        | 11275/65536 [2:06:21<9:50:44,  1.53it/s] 
 17%|█▋        | 11276/65536 [2:06:21<10:21:07,  1.46it/s]
 17%|█▋        | 11277/65536 [2:06:22<10:25:57,  1.44it/s]
 17%|█▋        | 11278/65536 [2:06:23<10:22:00,  1.45it/s]
 17%|█▋        | 11279/65536 [2:06:23<10:10:15,  1.48it/s]
 17%|█▋        | 11280/65536 [2:06:24<10:19:13,  1.46it/s]
                                                          
{'loss': 0.9651, 'learning_rate': 8.473735765887107e-07, 'epoch': 696.3}

 17%|█▋        | 11280/65536 [2:06:24<10:19:13,  1.46it/s]
 17%|█▋        | 11281/65536 [2:06:25<10:26:05,  1.44it/s]
 17%|█▋        | 11282/65536 [2:06:26<10:30:37,  1.43it/s]
 17%|█▋        | 11283/65536 [2:06:26<10:15:47,  1.47it/s]
 17%|█▋        | 11284/65536 [2:06:27<10:25:12,  1.45it/s]
 17%|█▋        | 11285/65536 [2:06:28<10:14:55,  1.47it/s]
 17%|█▋        | 11286/65536 [2:06:28<10:01:07,  1.50it/s]
 17%|█▋        | 11287/65536 [2:06:29<9:59:51,  1.51it/s] 
 17%|█▋        | 11288/65536 [2:06:30<9:49:53,  1.53it/s]
 17%|█▋        | 11289/65536 [2:06:30<9:50:49,  1.53it/s]
 17%|█▋        | 11290/65536 [2:06:31<10:06:19,  1.49it/s]
 17%|█▋        | 11291/65536 [2:06:32<9:58:16,  1.51it/s] 
 17%|█▋        | 11292/65536 [2:06:32<10:10:53,  1.48it/s]
 17%|█▋        | 11293/65536 [2:06:33<9:58:14,  1.51it/s] 
 17%|█▋        | 11294/65536 [2:06:34<9:57:20,  1.51it/s]
 17%|█▋        | 11295/65536 [2:06:34<10:22:09,  1.45it/s]
 17%|█▋        | 11296/65536 [2:06:35<10:19:52,  1.46it/s]
 17%|█▋        | 11297/65536 [2:06:36<10:25:23,  1.45it/s]
 17%|█▋        | 11298/65536 [2:06:36<10:25:57,  1.44it/s]
 17%|█▋        | 11299/65536 [2:06:37<10:18:43,  1.46it/s]
 17%|█▋        | 11300/65536 [2:06:38<10:17:25,  1.46it/s]
                                                          
{'loss': 0.9603, 'learning_rate': 8.470980776294845e-07, 'epoch': 697.53}

 17%|█▋        | 11300/65536 [2:06:38<10:17:25,  1.46it/s]
 17%|█▋        | 11301/65536 [2:06:38<10:21:25,  1.45it/s]
 17%|█▋        | 11302/65536 [2:06:39<10:20:19,  1.46it/s]
 17%|█▋        | 11303/65536 [2:06:40<10:21:46,  1.45it/s]
 17%|█▋        | 11304/65536 [2:06:40<10:17:53,  1.46it/s]
 17%|█▋        | 11305/65536 [2:06:41<10:17:57,  1.46it/s]
 17%|█▋        | 11306/65536 [2:06:42<9:58:07,  1.51it/s] 
 17%|█▋        | 11307/65536 [2:06:42<9:42:01,  1.55it/s]
 17%|█▋        | 11308/65536 [2:06:43<10:11:36,  1.48it/s]
 17%|█▋        | 11309/65536 [2:06:44<10:03:57,  1.50it/s]
 17%|█▋        | 11310/65536 [2:06:44<10:01:46,  1.50it/s]
 17%|█▋        | 11311/65536 [2:06:45<9:59:05,  1.51it/s] 
 17%|█▋        | 11312/65536 [2:06:46<9:54:03,  1.52it/s]
 17%|█▋        | 11313/65536 [2:06:46<9:45:06,  1.54it/s]
 17%|█▋        | 11314/65536 [2:06:47<9:42:02,  1.55it/s]
 17%|█▋        | 11315/65536 [2:06:48<9:55:25,  1.52it/s]
 17%|█▋        | 11316/65536 [2:06:48<10:00:34,  1.50it/s]
 17%|█▋        | 11317/65536 [2:06:49<10:02:38,  1.50it/s]
 17%|█▋        | 11318/65536 [2:06:50<9:56:24,  1.52it/s] 
 17%|█▋        | 11319/65536 [2:06:50<10:14:33,  1.47it/s]
 17%|█▋        | 11320/65536 [2:06:51<10:08:58,  1.48it/s]
                                                          
{'loss': 0.9622, 'learning_rate': 8.468225786702584e-07, 'epoch': 698.77}

 17%|█▋        | 11320/65536 [2:06:51<10:08:58,  1.48it/s]
 17%|█▋        | 11321/65536 [2:06:52<10:25:49,  1.44it/s]
 17%|█▋        | 11322/65536 [2:06:52<10:17:12,  1.46it/s]
 17%|█▋        | 11323/65536 [2:06:53<10:13:41,  1.47it/s]
 17%|█▋        | 11324/65536 [2:06:54<10:32:18,  1.43it/s]
 17%|█▋        | 11325/65536 [2:06:55<10:41:04,  1.41it/s]
 17%|█▋        | 11326/65536 [2:06:55<10:28:25,  1.44it/s]
 17%|█▋        | 11327/65536 [2:06:56<10:36:53,  1.42it/s]
 17%|█▋        | 11328/65536 [2:06:57<10:18:37,  1.46it/s]
 17%|█▋        | 11329/65536 [2:06:57<10:21:21,  1.45it/s]
 17%|█▋        | 11330/65536 [2:06:58<9:58:56,  1.51it/s] 
 17%|█▋        | 11331/65536 [2:06:59<9:52:14,  1.53it/s]
 17%|█▋        | 11332/65536 [2:06:59<9:47:58,  1.54it/s]
 17%|█▋        | 11333/65536 [2:07:00<9:41:49,  1.55it/s]
 17%|█▋        | 11334/65536 [2:07:00<9:47:49,  1.54it/s]
 17%|█▋        | 11335/65536 [2:07:01<10:06:33,  1.49it/s]
 17%|█▋        | 11336/65536 [2:07:02<10:04:01,  1.50it/s]
 17%|█▋        | 11337/65536 [2:07:03<10:15:58,  1.47it/s]
 17%|█▋        | 11338/65536 [2:07:03<10:23:07,  1.45it/s]
 17%|█▋        | 11339/65536 [2:07:04<10:05:54,  1.49it/s]
 17%|█▋        | 11340/65536 [2:07:05<9:53:38,  1.52it/s] 
                                                         
{'loss': 0.9612, 'learning_rate': 8.465470797110321e-07, 'epoch': 700.0}

 17%|█▋        | 11340/65536 [2:07:05<9:53:38,  1.52it/s]
 17%|█▋        | 11341/65536 [2:07:05<10:06:23,  1.49it/s]
 17%|█▋        | 11342/65536 [2:07:06<10:08:15,  1.48it/s]
 17%|█▋        | 11343/65536 [2:07:07<10:14:31,  1.47it/s]
 17%|█▋        | 11344/65536 [2:07:07<10:09:07,  1.48it/s]
 17%|█▋        | 11345/65536 [2:07:08<10:01:24,  1.50it/s]
 17%|█▋        | 11346/65536 [2:07:09<10:09:14,  1.48it/s]
 17%|█▋        | 11347/65536 [2:07:09<10:08:02,  1.49it/s]
 17%|█▋        | 11348/65536 [2:07:10<10:08:44,  1.48it/s]
 17%|█▋        | 11349/65536 [2:07:11<9:57:04,  1.51it/s] 
 17%|█▋        | 11350/65536 [2:07:11<10:02:51,  1.50it/s]
 17%|█▋        | 11351/65536 [2:07:12<9:58:53,  1.51it/s] 
 17%|█▋        | 11352/65536 [2:07:13<10:02:02,  1.50it/s]
 17%|█▋        | 11353/65536 [2:07:13<10:00:44,  1.50it/s]
 17%|█▋        | 11354/65536 [2:07:14<10:01:08,  1.50it/s]
 17%|█▋        | 11355/65536 [2:07:15<10:06:21,  1.49it/s]
 17%|█▋        | 11356/65536 [2:07:15<10:14:59,  1.47it/s]
 17%|█▋        | 11357/65536 [2:07:16<10:32:13,  1.43it/s]
 17%|█▋        | 11358/65536 [2:07:17<10:24:43,  1.45it/s]
 17%|█▋        | 11359/65536 [2:07:17<10:25:21,  1.44it/s]
 17%|█▋        | 11360/65536 [2:07:18<10:24:39,  1.45it/s]
                                                          
{'loss': 0.9397, 'learning_rate': 8.462715807518059e-07, 'epoch': 701.23}

 17%|█▋        | 11360/65536 [2:07:18<10:24:39,  1.45it/s]
 17%|█▋        | 11361/65536 [2:07:19<10:19:20,  1.46it/s]
 17%|█▋        | 11362/65536 [2:07:19<9:51:19,  1.53it/s] 
 17%|█▋        | 11363/65536 [2:07:20<9:58:08,  1.51it/s]
 17%|█▋        | 11364/65536 [2:07:21<10:10:17,  1.48it/s]
 17%|█▋        | 11365/65536 [2:07:21<10:08:37,  1.48it/s]
 17%|█▋        | 11366/65536 [2:07:22<10:07:04,  1.49it/s]
 17%|█▋        | 11367/65536 [2:07:23<10:11:22,  1.48it/s]
 17%|█▋        | 11368/65536 [2:07:23<9:53:11,  1.52it/s] 
 17%|█▋        | 11369/65536 [2:07:24<9:59:19,  1.51it/s]
 17%|█▋        | 11370/65536 [2:07:25<10:03:31,  1.50it/s]
 17%|█▋        | 11371/65536 [2:07:25<10:20:26,  1.46it/s]
 17%|█▋        | 11372/65536 [2:07:26<10:05:41,  1.49it/s]
 17%|█▋        | 11373/65536 [2:07:27<10:23:56,  1.45it/s]
 17%|█▋        | 11374/65536 [2:07:28<10:14:11,  1.47it/s]
 17%|█▋        | 11375/65536 [2:07:28<10:03:00,  1.50it/s]
 17%|█▋        | 11376/65536 [2:07:29<10:01:25,  1.50it/s]
 17%|█▋        | 11377/65536 [2:07:29<10:00:12,  1.50it/s]
 17%|█▋        | 11378/65536 [2:07:30<10:06:35,  1.49it/s]
 17%|█▋        | 11379/65536 [2:07:31<9:52:11,  1.52it/s] 
 17%|█▋        | 11380/65536 [2:07:31<9:52:21,  1.52it/s]
                                                         
{'loss': 0.9623, 'learning_rate': 8.459960817925798e-07, 'epoch': 702.47}

 17%|█▋        | 11380/65536 [2:07:31<9:52:21,  1.52it/s]
 17%|█▋        | 11381/65536 [2:07:32<9:54:04,  1.52it/s]
 17%|█▋        | 11382/65536 [2:07:33<10:02:02,  1.50it/s]
 17%|█▋        | 11383/65536 [2:07:33<9:59:44,  1.50it/s] 
 17%|█▋        | 11384/65536 [2:07:34<10:15:51,  1.47it/s]
 17%|█▋        | 11385/65536 [2:07:35<10:11:35,  1.48it/s]
 17%|█▋        | 11386/65536 [2:07:36<10:10:00,  1.48it/s]
 17%|█▋        | 11387/65536 [2:07:36<10:09:22,  1.48it/s]
 17%|█▋        | 11388/65536 [2:07:37<10:14:48,  1.47it/s]
 17%|█▋        | 11389/65536 [2:07:38<10:40:32,  1.41it/s]
 17%|█▋        | 11390/65536 [2:07:38<10:33:16,  1.43it/s]
 17%|█▋        | 11391/65536 [2:07:39<10:19:08,  1.46it/s]
 17%|█▋        | 11392/65536 [2:07:40<10:14:53,  1.47it/s]
 17%|█▋        | 11393/65536 [2:07:40<10:20:37,  1.45it/s]
 17%|█▋        | 11394/65536 [2:07:41<10:17:18,  1.46it/s]
 17%|█▋        | 11395/65536 [2:07:42<10:06:47,  1.49it/s]
 17%|█▋        | 11396/65536 [2:07:42<10:12:44,  1.47it/s]
 17%|█▋        | 11397/65536 [2:07:43<9:54:10,  1.52it/s] 
 17%|█▋        | 11398/65536 [2:07:44<9:58:02,  1.51it/s]
 17%|█▋        | 11399/65536 [2:07:44<9:52:09,  1.52it/s]
 17%|█▋        | 11400/65536 [2:07:45<9:44:39,  1.54it/s]
                                                         
{'loss': 0.9665, 'learning_rate': 8.457205828333537e-07, 'epoch': 703.7}

 17%|█▋        | 11400/65536 [2:07:45<9:44:39,  1.54it/s]
 17%|█▋        | 11401/65536 [2:07:46<9:44:59,  1.54it/s]
 17%|█▋        | 11402/65536 [2:07:46<9:44:37,  1.54it/s]
 17%|█▋        | 11403/65536 [2:07:47<10:04:23,  1.49it/s]
 17%|█▋        | 11404/65536 [2:07:48<9:59:31,  1.50it/s] 
 17%|█▋        | 11405/65536 [2:07:48<10:21:29,  1.45it/s]
 17%|█▋        | 11406/65536 [2:07:49<10:31:23,  1.43it/s]
 17%|█▋        | 11407/65536 [2:07:50<10:31:57,  1.43it/s]
 17%|█▋        | 11408/65536 [2:07:50<10:14:51,  1.47it/s]
 17%|█▋        | 11409/65536 [2:07:51<10:11:04,  1.48it/s]
 17%|█▋        | 11410/65536 [2:07:52<10:24:25,  1.44it/s]
 17%|█▋        | 11411/65536 [2:07:52<10:09:25,  1.48it/s]
 17%|█▋        | 11412/65536 [2:07:53<10:05:29,  1.49it/s]
 17%|█▋        | 11413/65536 [2:07:54<9:57:50,  1.51it/s] 
 17%|█▋        | 11414/65536 [2:07:54<9:48:00,  1.53it/s]
 17%|█▋        | 11415/65536 [2:07:55<9:59:06,  1.51it/s]
 17%|█▋        | 11416/65536 [2:07:56<9:56:45,  1.51it/s]
 17%|█▋        | 11417/65536 [2:07:56<9:54:21,  1.52it/s]
 17%|█▋        | 11418/65536 [2:07:57<9:46:50,  1.54it/s]
 17%|█▋        | 11419/65536 [2:07:58<10:12:05,  1.47it/s]
 17%|█▋        | 11420/65536 [2:07:58<9:59:39,  1.50it/s] 
                                                         
{'loss': 0.9713, 'learning_rate': 8.454450838741276e-07, 'epoch': 704.94}

 17%|█▋        | 11420/65536 [2:07:58<9:59:39,  1.50it/s]
 17%|█▋        | 11421/65536 [2:07:59<9:44:18,  1.54it/s]
 17%|█▋        | 11422/65536 [2:08:00<10:02:12,  1.50it/s]
 17%|█▋        | 11423/65536 [2:08:00<10:09:51,  1.48it/s]
 17%|█▋        | 11424/65536 [2:08:01<10:08:52,  1.48it/s]
 17%|█▋        | 11425/65536 [2:08:02<10:08:42,  1.48it/s]
 17%|█▋        | 11426/65536 [2:08:02<10:03:28,  1.49it/s]
 17%|█▋        | 11427/65536 [2:08:03<9:57:56,  1.51it/s] 
 17%|█▋        | 11428/65536 [2:08:04<10:07:33,  1.48it/s]
 17%|█▋        | 11429/65536 [2:08:04<9:56:39,  1.51it/s] 
 17%|█▋        | 11430/65536 [2:08:05<10:15:18,  1.47it/s]
 17%|█▋        | 11431/65536 [2:08:06<10:31:44,  1.43it/s]
 17%|█▋        | 11432/65536 [2:08:07<10:20:49,  1.45it/s]
 17%|█▋        | 11433/65536 [2:08:07<10:03:02,  1.50it/s]
 17%|█▋        | 11434/65536 [2:08:08<9:57:17,  1.51it/s] 
 17%|█▋        | 11435/65536 [2:08:08<9:47:26,  1.53it/s]
 17%|█▋        | 11436/65536 [2:08:09<9:53:05,  1.52it/s]
 17%|█▋        | 11437/65536 [2:08:10<9:52:22,  1.52it/s]
 17%|█▋        | 11438/65536 [2:08:11<10:32:02,  1.43it/s]
 17%|█▋        | 11439/65536 [2:08:11<10:31:41,  1.43it/s]
 17%|█▋        | 11440/65536 [2:08:12<10:22:03,  1.45it/s]
                                                          
{'loss': 0.9664, 'learning_rate': 8.451695849149013e-07, 'epoch': 706.17}

 17%|█▋        | 11440/65536 [2:08:12<10:22:03,  1.45it/s]
 17%|█▋        | 11441/65536 [2:08:13<10:12:47,  1.47it/s]
 17%|█▋        | 11442/65536 [2:08:13<10:07:49,  1.48it/s]
 17%|█▋        | 11443/65536 [2:08:14<9:40:44,  1.55it/s] 
 17%|█▋        | 11444/65536 [2:08:14<9:48:59,  1.53it/s]
 17%|█▋        | 11445/65536 [2:08:15<9:46:02,  1.54it/s]
 17%|█▋        | 11446/65536 [2:08:16<9:47:47,  1.53it/s]
 17%|█▋        | 11447/65536 [2:08:16<9:53:58,  1.52it/s]
 17%|█▋        | 11448/65536 [2:08:17<9:55:48,  1.51it/s]
 17%|█▋        | 11449/65536 [2:08:18<10:21:40,  1.45it/s]
 17%|█▋        | 11450/65536 [2:08:18<10:01:53,  1.50it/s]
 17%|█▋        | 11451/65536 [2:08:19<9:58:44,  1.51it/s] 
 17%|█▋        | 11452/65536 [2:08:20<10:09:37,  1.48it/s]
 17%|█▋        | 11453/65536 [2:08:20<9:55:19,  1.51it/s] 
 17%|█▋        | 11454/65536 [2:08:21<10:18:40,  1.46it/s]
 17%|█▋        | 11455/65536 [2:08:22<10:22:10,  1.45it/s]
 17%|█▋        | 11456/65536 [2:08:23<10:00:50,  1.50it/s]
 17%|█▋        | 11457/65536 [2:08:23<9:48:14,  1.53it/s] 
 17%|█▋        | 11458/65536 [2:08:24<9:46:23,  1.54it/s]
 17%|█▋        | 11459/65536 [2:08:24<9:46:26,  1.54it/s]
 17%|█▋        | 11460/65536 [2:08:25<9:55:07,  1.51it/s]
                                                         
{'loss': 0.9692, 'learning_rate': 8.448940859556752e-07, 'epoch': 707.41}

 17%|█▋        | 11460/65536 [2:08:25<9:55:07,  1.51it/s]
 17%|█▋        | 11461/65536 [2:08:26<9:51:08,  1.52it/s]
 17%|█▋        | 11462/65536 [2:08:26<10:00:30,  1.50it/s]
 17%|█▋        | 11463/65536 [2:08:27<10:03:24,  1.49it/s]
 17%|█▋        | 11464/65536 [2:08:28<10:04:56,  1.49it/s]
 17%|█▋        | 11465/65536 [2:08:29<10:15:41,  1.46it/s]
 17%|█▋        | 11466/65536 [2:08:29<10:11:22,  1.47it/s]
 17%|█▋        | 11467/65536 [2:08:30<10:04:39,  1.49it/s]
 17%|█▋        | 11468/65536 [2:08:31<10:06:07,  1.49it/s]
 18%|█▊        | 11469/65536 [2:08:31<10:22:51,  1.45it/s]
 18%|█▊        | 11470/65536 [2:08:32<10:25:36,  1.44it/s]
 18%|█▊        | 11471/65536 [2:08:33<10:17:23,  1.46it/s]
 18%|█▊        | 11472/65536 [2:08:33<10:18:41,  1.46it/s]
 18%|█▊        | 11473/65536 [2:08:34<10:06:09,  1.49it/s]
 18%|█▊        | 11474/65536 [2:08:35<9:53:25,  1.52it/s] 
 18%|█▊        | 11475/65536 [2:08:35<9:46:01,  1.54it/s]
 18%|█▊        | 11476/65536 [2:08:36<10:15:34,  1.46it/s]
 18%|█▊        | 11477/65536 [2:08:37<10:06:46,  1.48it/s]
 18%|█▊        | 11478/65536 [2:08:37<10:07:22,  1.48it/s]
 18%|█▊        | 11479/65536 [2:08:38<10:10:57,  1.47it/s]
 18%|█▊        | 11480/65536 [2:08:39<10:08:35,  1.48it/s]
                                                          
{'loss': 0.9523, 'learning_rate': 8.44618586996449e-07, 'epoch': 708.64}

 18%|█▊        | 11480/65536 [2:08:39<10:08:35,  1.48it/s]
 18%|█▊        | 11481/65536 [2:08:39<9:52:55,  1.52it/s] 
 18%|█▊        | 11482/65536 [2:08:40<9:55:44,  1.51it/s]
 18%|█▊        | 11483/65536 [2:08:41<9:55:08,  1.51it/s]
 18%|█▊        | 11484/65536 [2:08:41<9:49:51,  1.53it/s]
 18%|█▊        | 11485/65536 [2:08:42<10:03:48,  1.49it/s]
 18%|█▊        | 11486/65536 [2:08:43<10:24:06,  1.44it/s]
 18%|█▊        | 11487/65536 [2:08:43<10:14:49,  1.47it/s]
 18%|█▊        | 11488/65536 [2:08:44<10:05:53,  1.49it/s]
 18%|█▊        | 11489/65536 [2:08:45<10:01:40,  1.50it/s]
 18%|█▊        | 11490/65536 [2:08:45<9:53:50,  1.52it/s] 
 18%|█▊        | 11491/65536 [2:08:46<9:57:01,  1.51it/s]
 18%|█▊        | 11492/65536 [2:08:47<10:18:04,  1.46it/s]
 18%|█▊        | 11493/65536 [2:08:47<10:05:51,  1.49it/s]
 18%|█▊        | 11494/65536 [2:08:48<10:09:17,  1.48it/s]
 18%|█▊        | 11495/65536 [2:08:49<9:52:37,  1.52it/s] 
 18%|█▊        | 11496/65536 [2:08:49<9:55:32,  1.51it/s]
 18%|█▊        | 11497/65536 [2:08:50<10:04:12,  1.49it/s]
 18%|█▊        | 11498/65536 [2:08:51<10:08:51,  1.48it/s]
 18%|█▊        | 11499/65536 [2:08:51<10:05:57,  1.49it/s]
 18%|█▊        | 11500/65536 [2:08:52<9:50:19,  1.53it/s] 
                                                         
{'loss': 0.9727, 'learning_rate': 8.443430880372229e-07, 'epoch': 709.88}

 18%|█▊        | 11500/65536 [2:08:52<9:50:19,  1.53it/s]
 18%|█▊        | 11501/65536 [2:08:53<9:50:48,  1.52it/s]
 18%|█▊        | 11502/65536 [2:08:53<9:51:36,  1.52it/s]
 18%|█▊        | 11503/65536 [2:08:54<10:12:34,  1.47it/s]
 18%|█▊        | 11504/65536 [2:08:55<10:01:07,  1.50it/s]
 18%|█▊        | 11505/65536 [2:08:55<10:28:09,  1.43it/s]
 18%|█▊        | 11506/65536 [2:08:56<10:19:48,  1.45it/s]
 18%|█▊        | 11507/65536 [2:08:57<10:08:57,  1.48it/s]
 18%|█▊        | 11508/65536 [2:08:57<10:17:46,  1.46it/s]
 18%|█▊        | 11509/65536 [2:08:58<10:00:12,  1.50it/s]
 18%|█▊        | 11510/65536 [2:08:59<9:54:03,  1.52it/s] 
 18%|█▊        | 11511/65536 [2:08:59<9:54:56,  1.51it/s]
 18%|█▊        | 11512/65536 [2:09:00<9:58:50,  1.50it/s]
 18%|█▊        | 11513/65536 [2:09:01<9:43:46,  1.54it/s]
 18%|█▊        | 11514/65536 [2:09:01<9:53:53,  1.52it/s]
 18%|█▊        | 11515/65536 [2:09:02<9:41:21,  1.55it/s]
 18%|█▊        | 11516/65536 [2:09:03<9:48:45,  1.53it/s]
 18%|█▊        | 11517/65536 [2:09:03<9:58:14,  1.50it/s]
 18%|█▊        | 11518/65536 [2:09:04<9:57:48,  1.51it/s]
 18%|█▊        | 11519/65536 [2:09:05<10:34:05,  1.42it/s]
 18%|█▊        | 11520/65536 [2:09:05<10:16:02,  1.46it/s]
                                                          
{'loss': 0.9815, 'learning_rate': 8.440675890779968e-07, 'epoch': 711.11}

 18%|█▊        | 11520/65536 [2:09:05<10:16:02,  1.46it/s]
 18%|█▊        | 11521/65536 [2:09:06<10:01:38,  1.50it/s]
 18%|█▊        | 11522/65536 [2:09:07<10:05:44,  1.49it/s]
 18%|█▊        | 11523/65536 [2:09:07<9:51:35,  1.52it/s] 
 18%|█▊        | 11524/65536 [2:09:08<10:00:13,  1.50it/s]
 18%|█▊        | 11525/65536 [2:09:09<9:53:44,  1.52it/s] 
 18%|█▊        | 11526/65536 [2:09:09<9:56:31,  1.51it/s]
 18%|█▊        | 11527/65536 [2:09:10<10:21:58,  1.45it/s]
 18%|█▊        | 11528/65536 [2:09:11<10:12:26,  1.47it/s]
 18%|█▊        | 11529/65536 [2:09:11<10:08:43,  1.48it/s]
 18%|█▊        | 11530/65536 [2:09:12<10:12:41,  1.47it/s]
 18%|█▊        | 11531/65536 [2:09:13<10:09:08,  1.48it/s]
 18%|█▊        | 11532/65536 [2:09:14<10:15:29,  1.46it/s]
 18%|█▊        | 11533/65536 [2:09:14<10:06:19,  1.48it/s]
 18%|█▊        | 11534/65536 [2:09:15<9:53:05,  1.52it/s] 
 18%|█▊        | 11535/65536 [2:09:16<10:14:29,  1.46it/s]
 18%|█▊        | 11536/65536 [2:09:16<10:16:18,  1.46it/s]
 18%|█▊        | 11537/65536 [2:09:17<10:16:16,  1.46it/s]
 18%|█▊        | 11538/65536 [2:09:18<10:13:59,  1.47it/s]
 18%|█▊        | 11539/65536 [2:09:18<10:03:39,  1.49it/s]
 18%|█▊        | 11540/65536 [2:09:19<10:01:15,  1.50it/s]
                                                          
{'loss': 0.9598, 'learning_rate': 8.437920901187706e-07, 'epoch': 712.35}

 18%|█▊        | 11540/65536 [2:09:19<10:01:15,  1.50it/s]
 18%|█▊        | 11541/65536 [2:09:20<10:05:33,  1.49it/s]
 18%|█▊        | 11542/65536 [2:09:20<9:52:53,  1.52it/s] 
 18%|█▊        | 11543/65536 [2:09:21<9:44:50,  1.54it/s]
 18%|█▊        | 11544/65536 [2:09:21<9:31:51,  1.57it/s]
 18%|█▊        | 11545/65536 [2:09:22<9:38:45,  1.55it/s]
 18%|█▊        | 11546/65536 [2:09:23<9:55:24,  1.51it/s]
 18%|█▊        | 11547/65536 [2:09:23<9:52:04,  1.52it/s]
 18%|█▊        | 11548/65536 [2:09:24<9:55:17,  1.51it/s]
 18%|█▊        | 11549/65536 [2:09:25<9:54:55,  1.51it/s]
 18%|█▊        | 11550/65536 [2:09:25<9:58:16,  1.50it/s]
 18%|█▊        | 11551/65536 [2:09:26<10:02:48,  1.49it/s]
 18%|█▊        | 11552/65536 [2:09:27<10:01:54,  1.49it/s]
 18%|█▊        | 11553/65536 [2:09:27<9:53:26,  1.52it/s] 
 18%|█▊        | 11554/65536 [2:09:28<9:40:55,  1.55it/s]
 18%|█▊        | 11555/65536 [2:09:29<9:58:56,  1.50it/s]
 18%|█▊        | 11556/65536 [2:09:29<10:03:57,  1.49it/s]
 18%|█▊        | 11557/65536 [2:09:30<9:58:28,  1.50it/s] 
 18%|█▊        | 11558/65536 [2:09:31<9:54:39,  1.51it/s]
 18%|█▊        | 11559/65536 [2:09:31<9:57:57,  1.50it/s]
 18%|█▊        | 11560/65536 [2:09:32<9:52:10,  1.52it/s]
                                                         
{'loss': 0.9862, 'learning_rate': 8.435165911595445e-07, 'epoch': 713.58}

 18%|█▊        | 11560/65536 [2:09:32<9:52:10,  1.52it/s]
 18%|█▊        | 11561/65536 [2:09:33<10:04:15,  1.49it/s]
 18%|█▊        | 11562/65536 [2:09:33<9:57:57,  1.50it/s] 
 18%|█▊        | 11563/65536 [2:09:34<9:49:49,  1.53it/s]
 18%|█▊        | 11564/65536 [2:09:35<9:59:15,  1.50it/s]
 18%|█▊        | 11565/65536 [2:09:35<10:19:36,  1.45it/s]
 18%|█▊        | 11566/65536 [2:09:36<10:00:02,  1.50it/s]
 18%|█▊        | 11567/65536 [2:09:37<10:20:21,  1.45it/s]
 18%|█▊        | 11568/65536 [2:09:37<10:07:23,  1.48it/s]
 18%|█▊        | 11569/65536 [2:09:38<10:16:32,  1.46it/s]
 18%|█▊        | 11570/65536 [2:09:39<10:01:19,  1.50it/s]
 18%|█▊        | 11571/65536 [2:09:40<10:07:25,  1.48it/s]
 18%|█▊        | 11572/65536 [2:09:40<10:09:46,  1.47it/s]
 18%|█▊        | 11573/65536 [2:09:41<10:08:39,  1.48it/s]
 18%|█▊        | 11574/65536 [2:09:41<9:52:45,  1.52it/s] 
 18%|█▊        | 11575/65536 [2:09:42<10:01:42,  1.49it/s]
 18%|█▊        | 11576/65536 [2:09:43<9:59:25,  1.50it/s] 
 18%|█▊        | 11577/65536 [2:09:43<9:54:23,  1.51it/s]
 18%|█▊        | 11578/65536 [2:09:44<10:10:56,  1.47it/s]
 18%|█▊        | 11579/65536 [2:09:45<10:22:03,  1.45it/s]
 18%|█▊        | 11580/65536 [2:09:46<10:15:46,  1.46it/s]
                                                          
{'loss': 0.9634, 'learning_rate': 8.432410922003183e-07, 'epoch': 714.81}

 18%|█▊        | 11580/65536 [2:09:46<10:15:46,  1.46it/s]
 18%|█▊        | 11581/65536 [2:09:46<10:06:54,  1.48it/s]
 18%|█▊        | 11582/65536 [2:09:47<10:15:49,  1.46it/s]
 18%|█▊        | 11583/65536 [2:09:48<10:15:36,  1.46it/s]
 18%|█▊        | 11584/65536 [2:09:48<10:20:45,  1.45it/s]
 18%|█▊        | 11585/65536 [2:09:49<10:16:49,  1.46it/s]
 18%|█▊        | 11586/65536 [2:09:50<10:24:43,  1.44it/s]
 18%|█▊        | 11587/65536 [2:09:50<10:15:23,  1.46it/s]
 18%|█▊        | 11588/65536 [2:09:51<10:17:17,  1.46it/s]
 18%|█▊        | 11589/65536 [2:09:52<10:23:13,  1.44it/s]
 18%|█▊        | 11590/65536 [2:09:52<10:03:46,  1.49it/s]
 18%|█▊        | 11591/65536 [2:09:53<10:14:06,  1.46it/s]
 18%|█▊        | 11592/65536 [2:09:54<10:03:34,  1.49it/s]
 18%|█▊        | 11593/65536 [2:09:54<10:02:04,  1.49it/s]
 18%|█▊        | 11594/65536 [2:09:55<10:18:55,  1.45it/s]
 18%|█▊        | 11595/65536 [2:09:56<10:17:58,  1.45it/s]
 18%|█▊        | 11596/65536 [2:09:56<10:04:13,  1.49it/s]
 18%|█▊        | 11597/65536 [2:09:57<10:07:31,  1.48it/s]
 18%|█▊        | 11598/65536 [2:09:58<9:55:26,  1.51it/s] 
 18%|█▊        | 11599/65536 [2:09:58<9:45:56,  1.53it/s]
 18%|█▊        | 11600/65536 [2:09:59<10:30:11,  1.43it/s]
                                                          
{'loss': 0.9412, 'learning_rate': 8.429655932410922e-07, 'epoch': 716.05}

 18%|█▊        | 11600/65536 [2:09:59<10:30:11,  1.43it/s]
 18%|█▊        | 11601/65536 [2:10:00<10:06:51,  1.48it/s]
 18%|█▊        | 11602/65536 [2:10:01<10:02:18,  1.49it/s]
 18%|█▊        | 11603/65536 [2:10:01<10:00:08,  1.50it/s]
 18%|█▊        | 11604/65536 [2:10:02<10:05:05,  1.49it/s]
 18%|█▊        | 11605/65536 [2:10:03<10:11:45,  1.47it/s]
 18%|█▊        | 11606/65536 [2:10:03<10:05:00,  1.49it/s]
 18%|█▊        | 11607/65536 [2:10:04<10:05:15,  1.49it/s]
 18%|█▊        | 11608/65536 [2:10:05<10:05:23,  1.48it/s]
 18%|█▊        | 11609/65536 [2:10:05<9:59:27,  1.50it/s] 
 18%|█▊        | 11610/65536 [2:10:06<9:51:17,  1.52it/s]
 18%|█▊        | 11611/65536 [2:10:06<9:31:28,  1.57it/s]
 18%|█▊        | 11612/65536 [2:10:07<9:29:11,  1.58it/s]
 18%|█▊        | 11613/65536 [2:10:08<9:40:51,  1.55it/s]
 18%|█▊        | 11614/65536 [2:10:08<9:58:18,  1.50it/s]
 18%|█▊        | 11615/65536 [2:10:09<9:54:49,  1.51it/s]
 18%|█▊        | 11616/65536 [2:10:10<10:17:49,  1.45it/s]
 18%|█▊        | 11617/65536 [2:10:10<9:58:11,  1.50it/s] 
 18%|█▊        | 11618/65536 [2:10:11<9:47:22,  1.53it/s]
 18%|█▊        | 11619/65536 [2:10:12<9:57:15,  1.50it/s]
 18%|█▊        | 11620/65536 [2:10:12<10:05:57,  1.48it/s]
                                                          
{'loss': 0.9685, 'learning_rate': 8.426900942818659e-07, 'epoch': 717.28}

 18%|█▊        | 11620/65536 [2:10:12<10:05:57,  1.48it/s]
 18%|█▊        | 11621/65536 [2:10:13<10:16:44,  1.46it/s]
 18%|█▊        | 11622/65536 [2:10:14<10:05:22,  1.48it/s]
 18%|█▊        | 11623/65536 [2:10:14<9:56:08,  1.51it/s] 
 18%|█▊        | 11624/65536 [2:10:15<10:15:56,  1.46it/s]
 18%|█▊        | 11625/65536 [2:10:16<10:10:35,  1.47it/s]
 18%|█▊        | 11626/65536 [2:10:17<9:58:39,  1.50it/s] 
 18%|█▊        | 11627/65536 [2:10:17<10:05:01,  1.49it/s]
 18%|█▊        | 11628/65536 [2:10:18<10:14:44,  1.46it/s]
 18%|█▊        | 11629/65536 [2:10:19<10:12:51,  1.47it/s]
 18%|█▊        | 11630/65536 [2:10:19<10:01:59,  1.49it/s]
 18%|█▊        | 11631/65536 [2:10:20<9:50:34,  1.52it/s] 
 18%|█▊        | 11632/65536 [2:10:21<10:19:27,  1.45it/s]
 18%|█▊        | 11633/65536 [2:10:21<10:00:18,  1.50it/s]
 18%|█▊        | 11634/65536 [2:10:22<10:06:11,  1.48it/s]
 18%|█▊        | 11635/65536 [2:10:23<10:17:46,  1.45it/s]
 18%|█▊        | 11636/65536 [2:10:23<10:08:49,  1.48it/s]
 18%|█▊        | 11637/65536 [2:10:24<10:03:29,  1.49it/s]
 18%|█▊        | 11638/65536 [2:10:25<9:50:22,  1.52it/s] 
 18%|█▊        | 11639/65536 [2:10:25<9:56:50,  1.51it/s]
 18%|█▊        | 11640/65536 [2:10:26<10:01:18,  1.49it/s]
                                                          
{'loss': 0.9414, 'learning_rate': 8.424145953226398e-07, 'epoch': 718.52}

 18%|█▊        | 11640/65536 [2:10:26<10:01:18,  1.49it/s]
 18%|█▊        | 11641/65536 [2:10:27<9:48:00,  1.53it/s] 
 18%|█▊        | 11642/65536 [2:10:27<9:47:36,  1.53it/s]
 18%|█▊        | 11643/65536 [2:10:28<9:42:46,  1.54it/s]
 18%|█▊        | 11644/65536 [2:10:29<9:45:14,  1.53it/s]
 18%|█▊        | 11645/65536 [2:10:29<9:42:06,  1.54it/s]
 18%|█▊        | 11646/65536 [2:10:30<9:53:15,  1.51it/s]
 18%|█▊        | 11647/65536 [2:10:31<10:00:06,  1.50it/s]
 18%|█▊        | 11648/65536 [2:10:31<10:28:39,  1.43it/s]
 18%|█▊        | 11649/65536 [2:10:32<10:19:31,  1.45it/s]
 18%|█▊        | 11650/65536 [2:10:33<10:07:02,  1.48it/s]
 18%|█▊        | 11651/65536 [2:10:33<10:05:59,  1.48it/s]
 18%|█▊        | 11652/65536 [2:10:34<10:00:22,  1.50it/s]
 18%|█▊        | 11653/65536 [2:10:35<10:11:37,  1.47it/s]
 18%|█▊        | 11654/65536 [2:10:35<10:01:24,  1.49it/s]
 18%|█▊        | 11655/65536 [2:10:36<10:06:33,  1.48it/s]
 18%|█▊        | 11656/65536 [2:10:37<9:55:09,  1.51it/s] 
 18%|█▊        | 11657/65536 [2:10:37<9:56:13,  1.51it/s]
 18%|█▊        | 11658/65536 [2:10:38<9:49:19,  1.52it/s]
 18%|█▊        | 11659/65536 [2:10:39<9:45:16,  1.53it/s]
 18%|█▊        | 11660/65536 [2:10:39<9:39:58,  1.55it/s]
                                                         
{'loss': 0.981, 'learning_rate': 8.421390963634137e-07, 'epoch': 719.75}

 18%|█▊        | 11660/65536 [2:10:39<9:39:58,  1.55it/s]
 18%|█▊        | 11661/65536 [2:10:40<10:08:12,  1.48it/s]
 18%|█▊        | 11662/65536 [2:10:41<9:52:16,  1.52it/s] 
 18%|█▊        | 11663/65536 [2:10:41<10:04:17,  1.49it/s]
 18%|█▊        | 11664/65536 [2:10:42<10:10:10,  1.47it/s]
 18%|█▊        | 11665/65536 [2:10:43<10:29:28,  1.43it/s]
 18%|█▊        | 11666/65536 [2:10:43<10:13:05,  1.46it/s]
 18%|█▊        | 11667/65536 [2:10:44<10:05:59,  1.48it/s]
 18%|█▊        | 11668/65536 [2:10:45<10:16:50,  1.46it/s]
 18%|█▊        | 11669/65536 [2:10:45<10:17:14,  1.45it/s]
 18%|█▊        | 11670/65536 [2:10:46<10:17:31,  1.45it/s]
 18%|█▊        | 11671/65536 [2:10:47<10:08:10,  1.48it/s]
 18%|█▊        | 11672/65536 [2:10:47<9:59:05,  1.50it/s] 
 18%|█▊        | 11673/65536 [2:10:48<10:01:47,  1.49it/s]
 18%|█▊        | 11674/65536 [2:10:49<9:56:12,  1.51it/s] 
 18%|█▊        | 11675/65536 [2:10:49<10:01:56,  1.49it/s]
 18%|█▊        | 11676/65536 [2:10:50<10:05:56,  1.48it/s]
 18%|█▊        | 11677/65536 [2:10:51<9:50:20,  1.52it/s] 
 18%|█▊        | 11678/65536 [2:10:51<9:51:12,  1.52it/s]
 18%|█▊        | 11679/65536 [2:10:52<9:43:40,  1.54it/s]
 18%|█▊        | 11680/65536 [2:10:53<9:55:55,  1.51it/s]
                                                         
{'loss': 0.9537, 'learning_rate': 8.418635974041875e-07, 'epoch': 720.99}

 18%|█▊        | 11680/65536 [2:10:53<9:55:55,  1.51it/s]
 18%|█▊        | 11681/65536 [2:10:53<10:21:34,  1.44it/s]
 18%|█▊        | 11682/65536 [2:10:54<10:13:50,  1.46it/s]
 18%|█▊        | 11683/65536 [2:10:55<10:18:17,  1.45it/s]
 18%|█▊        | 11684/65536 [2:10:56<10:14:28,  1.46it/s]
 18%|█▊        | 11685/65536 [2:10:56<10:06:26,  1.48it/s]
 18%|█▊        | 11686/65536 [2:10:57<10:05:30,  1.48it/s]
 18%|█▊        | 11687/65536 [2:10:57<9:52:41,  1.51it/s] 
 18%|█▊        | 11688/65536 [2:10:58<9:57:43,  1.50it/s]
 18%|█▊        | 11689/65536 [2:10:59<10:04:47,  1.48it/s]
 18%|█▊        | 11690/65536 [2:10:59<10:00:37,  1.49it/s]
 18%|█▊        | 11691/65536 [2:11:00<10:30:58,  1.42it/s]
 18%|█▊        | 11692/65536 [2:11:01<10:18:23,  1.45it/s]
 18%|█▊        | 11693/65536 [2:11:02<10:12:12,  1.47it/s]
 18%|█▊        | 11694/65536 [2:11:02<10:08:21,  1.48it/s]
 18%|█▊        | 11695/65536 [2:11:03<10:07:57,  1.48it/s]
 18%|█▊        | 11696/65536 [2:11:04<9:54:00,  1.51it/s] 
 18%|█▊        | 11697/65536 [2:11:04<10:19:55,  1.45it/s]
 18%|█▊        | 11698/65536 [2:11:05<10:14:43,  1.46it/s]
 18%|█▊        | 11699/65536 [2:11:06<10:02:32,  1.49it/s]
 18%|█▊        | 11700/65536 [2:11:06<9:59:30,  1.50it/s] 
                                                         
{'loss': 0.9613, 'learning_rate': 8.415880984449614e-07, 'epoch': 722.22}

 18%|█▊        | 11700/65536 [2:11:06<9:59:30,  1.50it/s]
 18%|█▊        | 11701/65536 [2:11:07<9:57:37,  1.50it/s]
 18%|█▊        | 11702/65536 [2:11:08<9:51:23,  1.52it/s]
 18%|█▊        | 11703/65536 [2:11:08<9:53:36,  1.51it/s]
 18%|█▊        | 11704/65536 [2:11:09<9:55:32,  1.51it/s]
 18%|█▊        | 11705/65536 [2:11:10<10:05:00,  1.48it/s]
 18%|█▊        | 11706/65536 [2:11:10<9:55:45,  1.51it/s] 
 18%|█▊        | 11707/65536 [2:11:11<9:54:06,  1.51it/s]
 18%|█▊        | 11708/65536 [2:11:12<9:45:35,  1.53it/s]
 18%|█▊        | 11709/65536 [2:11:12<9:53:06,  1.51it/s]
 18%|█▊        | 11710/65536 [2:11:13<9:47:08,  1.53it/s]
 18%|█▊        | 11711/65536 [2:11:14<10:02:13,  1.49it/s]
 18%|█▊        | 11712/65536 [2:11:14<10:03:03,  1.49it/s]
 18%|█▊        | 11713/65536 [2:11:15<10:45:59,  1.39it/s]
 18%|█▊        | 11714/65536 [2:11:16<10:23:46,  1.44it/s]
 18%|█▊        | 11715/65536 [2:11:16<10:20:16,  1.45it/s]
 18%|█▊        | 11716/65536 [2:11:17<10:11:30,  1.47it/s]
 18%|█▊        | 11717/65536 [2:11:18<9:57:19,  1.50it/s] 
 18%|█▊        | 11718/65536 [2:11:18<9:40:45,  1.54it/s]
 18%|█▊        | 11719/65536 [2:11:19<9:31:37,  1.57it/s]
 18%|█▊        | 11720/65536 [2:11:20<9:46:38,  1.53it/s]
                                                         
{'loss': 0.9666, 'learning_rate': 8.413125994857352e-07, 'epoch': 723.46}

 18%|█▊        | 11720/65536 [2:11:20<9:46:38,  1.53it/s]
 18%|█▊        | 11721/65536 [2:11:20<9:51:34,  1.52it/s]
 18%|█▊        | 11722/65536 [2:11:21<9:48:12,  1.52it/s]
 18%|█▊        | 11723/65536 [2:11:22<10:13:35,  1.46it/s]
 18%|█▊        | 11724/65536 [2:11:22<10:06:42,  1.48it/s]
 18%|█▊        | 11725/65536 [2:11:23<10:03:40,  1.49it/s]
 18%|█▊        | 11726/65536 [2:11:24<10:04:03,  1.48it/s]
 18%|█▊        | 11727/65536 [2:11:24<9:59:15,  1.50it/s] 
 18%|█▊        | 11728/65536 [2:11:25<10:10:41,  1.47it/s]
 18%|█▊        | 11729/65536 [2:11:26<10:35:03,  1.41it/s]
 18%|█▊        | 11730/65536 [2:11:27<10:27:26,  1.43it/s]
 18%|█▊        | 11731/65536 [2:11:27<10:27:12,  1.43it/s]
 18%|█▊        | 11732/65536 [2:11:28<10:29:22,  1.42it/s]
 18%|█▊        | 11733/65536 [2:11:29<10:19:02,  1.45it/s]
 18%|█▊        | 11734/65536 [2:11:29<9:57:13,  1.50it/s] 
 18%|█▊        | 11735/65536 [2:11:30<9:54:16,  1.51it/s]
 18%|█▊        | 11736/65536 [2:11:30<9:51:19,  1.52it/s]
 18%|█▊        | 11737/65536 [2:11:31<10:04:33,  1.48it/s]
 18%|█▊        | 11738/65536 [2:11:32<9:58:16,  1.50it/s] 
 18%|█▊        | 11739/65536 [2:11:33<9:59:20,  1.50it/s]
 18%|█▊        | 11740/65536 [2:11:33<9:52:45,  1.51it/s]
                                                         
{'loss': 0.9413, 'learning_rate': 8.410371005265091e-07, 'epoch': 724.69}

 18%|█▊        | 11740/65536 [2:11:33<9:52:45,  1.51it/s]
 18%|█▊        | 11741/65536 [2:11:34<9:56:22,  1.50it/s]
 18%|█▊        | 11742/65536 [2:11:34<9:49:43,  1.52it/s]
 18%|█▊        | 11743/65536 [2:11:35<10:07:35,  1.48it/s]
 18%|█▊        | 11744/65536 [2:11:36<10:08:34,  1.47it/s]
 18%|█▊        | 11745/65536 [2:11:37<10:07:06,  1.48it/s]
 18%|█▊        | 11746/65536 [2:11:37<10:11:44,  1.47it/s]
 18%|█▊        | 11747/65536 [2:11:38<10:02:27,  1.49it/s]
 18%|█▊        | 11748/65536 [2:11:39<10:03:30,  1.49it/s]
 18%|█▊        | 11749/65536 [2:11:39<10:05:23,  1.48it/s]
 18%|█▊        | 11750/65536 [2:11:40<9:55:55,  1.50it/s] 
 18%|█▊        | 11751/65536 [2:11:41<10:15:32,  1.46it/s]
 18%|█▊        | 11752/65536 [2:11:41<10:15:07,  1.46it/s]
 18%|█▊        | 11753/65536 [2:11:42<9:56:38,  1.50it/s] 
 18%|█▊        | 11754/65536 [2:11:43<9:57:44,  1.50it/s]
 18%|█▊        | 11755/65536 [2:11:43<10:02:13,  1.49it/s]
 18%|█▊        | 11756/65536 [2:11:44<10:08:38,  1.47it/s]
 18%|█▊        | 11757/65536 [2:11:45<10:02:42,  1.49it/s]
 18%|█▊        | 11758/65536 [2:11:45<9:59:45,  1.49it/s] 
 18%|█▊        | 11759/65536 [2:11:46<10:01:17,  1.49it/s]
 18%|█▊        | 11760/65536 [2:11:47<10:04:40,  1.48it/s]
                                                          
{'loss': 0.9492, 'learning_rate': 8.40761601567283e-07, 'epoch': 725.93}

 18%|█▊        | 11760/65536 [2:11:47<10:04:40,  1.48it/s]
 18%|█▊        | 11761/65536 [2:11:47<10:12:02,  1.46it/s]
 18%|█▊        | 11762/65536 [2:11:48<10:35:53,  1.41it/s]
 18%|█▊        | 11763/65536 [2:11:49<10:53:30,  1.37it/s]
 18%|█▊        | 11764/65536 [2:11:50<10:53:49,  1.37it/s]
 18%|█▊        | 11765/65536 [2:11:50<10:40:54,  1.40it/s]
 18%|█▊        | 11766/65536 [2:11:51<10:13:18,  1.46it/s]
 18%|█▊        | 11767/65536 [2:11:52<9:54:52,  1.51it/s] 
 18%|█▊        | 11768/65536 [2:11:52<10:16:49,  1.45it/s]
 18%|█▊        | 11769/65536 [2:11:53<10:12:18,  1.46it/s]
 18%|█▊        | 11770/65536 [2:11:54<10:02:17,  1.49it/s]
 18%|█▊        | 11771/65536 [2:11:54<9:55:46,  1.50it/s] 
 18%|█▊        | 11772/65536 [2:11:55<9:47:23,  1.53it/s]
 18%|█▊        | 11773/65536 [2:11:56<9:51:12,  1.52it/s]
 18%|█▊        | 11774/65536 [2:11:56<9:51:04,  1.52it/s]
 18%|█▊        | 11775/65536 [2:11:57<9:42:41,  1.54it/s]
 18%|█▊        | 11776/65536 [2:11:58<9:51:14,  1.52it/s]
 18%|█▊        | 11777/65536 [2:11:58<9:40:11,  1.54it/s]
 18%|█▊        | 11778/65536 [2:11:59<10:06:58,  1.48it/s]
 18%|█▊        | 11779/65536 [2:12:00<9:55:29,  1.50it/s] 
 18%|█▊        | 11780/65536 [2:12:00<9:59:51,  1.49it/s]
                                                         
{'loss': 0.9677, 'learning_rate': 8.404861026080568e-07, 'epoch': 727.16}

 18%|█▊        | 11780/65536 [2:12:00<9:59:51,  1.49it/s]
 18%|█▊        | 11781/65536 [2:12:01<10:16:04,  1.45it/s]
 18%|█▊        | 11782/65536 [2:12:02<10:09:58,  1.47it/s]
 18%|█▊        | 11783/65536 [2:12:02<10:09:13,  1.47it/s]
 18%|█▊        | 11784/65536 [2:12:03<10:16:31,  1.45it/s]
 18%|█▊        | 11785/65536 [2:12:04<10:08:49,  1.47it/s]
 18%|█▊        | 11786/65536 [2:12:04<10:04:36,  1.48it/s]
 18%|█▊        | 11787/65536 [2:12:05<10:16:59,  1.45it/s]
 18%|█▊        | 11788/65536 [2:12:06<9:59:18,  1.49it/s] 
 18%|█▊        | 11789/65536 [2:12:06<10:10:34,  1.47it/s]
 18%|█▊        | 11790/65536 [2:12:07<10:16:12,  1.45it/s]
 18%|█▊        | 11791/65536 [2:12:08<10:07:41,  1.47it/s]
 18%|█▊        | 11792/65536 [2:12:08<10:02:34,  1.49it/s]
 18%|█▊        | 11793/65536 [2:12:09<9:46:32,  1.53it/s] 
 18%|█▊        | 11794/65536 [2:12:10<10:03:32,  1.48it/s]
 18%|█▊        | 11795/65536 [2:12:10<9:58:25,  1.50it/s] 
 18%|█▊        | 11796/65536 [2:12:11<9:47:05,  1.53it/s]
 18%|█▊        | 11797/65536 [2:12:12<9:55:06,  1.51it/s]
 18%|█▊        | 11798/65536 [2:12:12<10:08:26,  1.47it/s]
 18%|█▊        | 11799/65536 [2:12:13<10:13:40,  1.46it/s]
 18%|█▊        | 11800/65536 [2:12:14<9:58:18,  1.50it/s] 
                                                         
{'loss': 0.9532, 'learning_rate': 8.402106036488307e-07, 'epoch': 728.4}

 18%|█▊        | 11800/65536 [2:12:14<9:58:18,  1.50it/s]
 18%|█▊        | 11801/65536 [2:12:14<9:45:44,  1.53it/s]
 18%|█▊        | 11802/65536 [2:12:15<9:58:30,  1.50it/s]
 18%|█▊        | 11803/65536 [2:12:16<10:05:47,  1.48it/s]
 18%|█▊        | 11804/65536 [2:12:16<10:04:50,  1.48it/s]
 18%|█▊        | 11805/65536 [2:12:17<10:08:01,  1.47it/s]
 18%|█▊        | 11806/65536 [2:12:18<9:55:48,  1.50it/s] 
 18%|█▊        | 11807/65536 [2:12:18<9:53:40,  1.51it/s]
 18%|█▊        | 11808/65536 [2:12:19<10:12:32,  1.46it/s]
 18%|█▊        | 11809/65536 [2:12:20<10:17:54,  1.45it/s]
 18%|█▊        | 11810/65536 [2:12:21<10:36:14,  1.41it/s]
 18%|█▊        | 11811/65536 [2:12:21<10:15:38,  1.45it/s]
 18%|█▊        | 11812/65536 [2:12:22<10:14:52,  1.46it/s]
 18%|█▊        | 11813/65536 [2:12:23<10:08:40,  1.47it/s]
 18%|█▊        | 11814/65536 [2:12:23<10:11:17,  1.46it/s]
 18%|█▊        | 11815/65536 [2:12:24<10:05:12,  1.48it/s]
 18%|█▊        | 11816/65536 [2:12:25<9:45:17,  1.53it/s] 
 18%|█▊        | 11817/65536 [2:12:25<9:50:17,  1.52it/s]
 18%|█▊        | 11818/65536 [2:12:26<9:56:21,  1.50it/s]
 18%|█▊        | 11819/65536 [2:12:27<10:05:33,  1.48it/s]
 18%|█▊        | 11820/65536 [2:12:27<10:05:03,  1.48it/s]
                                                          
{'loss': 0.9449, 'learning_rate': 8.399351046896045e-07, 'epoch': 729.63}

 18%|█▊        | 11820/65536 [2:12:27<10:05:03,  1.48it/s]
 18%|█▊        | 11821/65536 [2:12:28<10:17:37,  1.45it/s]
 18%|█▊        | 11822/65536 [2:12:29<10:24:29,  1.43it/s]
 18%|█▊        | 11823/65536 [2:12:29<10:07:15,  1.47it/s]
 18%|█▊        | 11824/65536 [2:12:30<10:15:24,  1.45it/s]
 18%|█▊        | 11825/65536 [2:12:31<10:19:23,  1.45it/s]
 18%|█▊        | 11826/65536 [2:12:31<9:57:23,  1.50it/s] 
 18%|█▊        | 11827/65536 [2:12:32<10:14:55,  1.46it/s]
 18%|█▊        | 11828/65536 [2:12:33<10:21:40,  1.44it/s]
 18%|█▊        | 11829/65536 [2:12:33<10:18:46,  1.45it/s]
 18%|█▊        | 11830/65536 [2:12:34<9:54:48,  1.50it/s] 
 18%|█▊        | 11831/65536 [2:12:35<9:49:15,  1.52it/s]
 18%|█▊        | 11832/65536 [2:12:35<9:51:31,  1.51it/s]
 18%|█▊        | 11833/65536 [2:12:36<10:05:14,  1.48it/s]
 18%|█▊        | 11834/65536 [2:12:37<10:09:27,  1.47it/s]
 18%|█▊        | 11835/65536 [2:12:37<10:04:12,  1.48it/s]
 18%|█▊        | 11836/65536 [2:12:38<9:52:51,  1.51it/s] 
 18%|█▊        | 11837/65536 [2:12:39<10:00:34,  1.49it/s]
 18%|█▊        | 11838/65536 [2:12:39<9:59:39,  1.49it/s] 
 18%|█▊        | 11839/65536 [2:12:40<10:00:03,  1.49it/s]
 18%|█▊        | 11840/65536 [2:12:41<10:11:34,  1.46it/s]
                                                          
{'loss': 0.9624, 'learning_rate': 8.396596057303784e-07, 'epoch': 730.86}

 18%|█▊        | 11840/65536 [2:12:41<10:11:34,  1.46it/s]
 18%|█▊        | 11841/65536 [2:12:42<10:22:19,  1.44it/s]
 18%|█▊        | 11842/65536 [2:12:42<10:21:11,  1.44it/s]
 18%|█▊        | 11843/65536 [2:12:43<10:37:08,  1.40it/s]
 18%|█▊        | 11844/65536 [2:12:44<10:17:23,  1.45it/s]
 18%|█▊        | 11845/65536 [2:12:44<9:55:36,  1.50it/s] 
 18%|█▊        | 11846/65536 [2:12:45<10:01:44,  1.49it/s]
 18%|█▊        | 11847/65536 [2:12:46<10:01:43,  1.49it/s]
 18%|█▊        | 11848/65536 [2:12:46<9:57:40,  1.50it/s] 
 18%|█▊        | 11849/65536 [2:12:47<9:50:55,  1.51it/s]
 18%|█▊        | 11850/65536 [2:12:48<9:52:33,  1.51it/s]
 18%|█▊        | 11851/65536 [2:12:48<10:11:51,  1.46it/s]
 18%|█▊        | 11852/65536 [2:12:49<9:56:33,  1.50it/s] 
 18%|█▊        | 11853/65536 [2:12:50<9:52:10,  1.51it/s]
 18%|█▊        | 11854/65536 [2:12:50<9:45:51,  1.53it/s]
 18%|█▊        | 11855/65536 [2:12:51<9:51:59,  1.51it/s]
 18%|█▊        | 11856/65536 [2:12:52<10:11:25,  1.46it/s]
 18%|█▊        | 11857/65536 [2:12:52<10:19:19,  1.44it/s]
 18%|█▊        | 11858/65536 [2:12:53<10:18:17,  1.45it/s]
 18%|█▊        | 11859/65536 [2:12:54<10:23:08,  1.44it/s]
 18%|█▊        | 11860/65536 [2:12:54<10:15:20,  1.45it/s]
                                                          
{'loss': 0.9627, 'learning_rate': 8.393841067711522e-07, 'epoch': 732.1}

 18%|█▊        | 11860/65536 [2:12:54<10:15:20,  1.45it/s]
 18%|█▊        | 11861/65536 [2:12:55<10:00:53,  1.49it/s]
 18%|█▊        | 11862/65536 [2:12:56<10:01:42,  1.49it/s]
 18%|█▊        | 11863/65536 [2:12:56<9:51:03,  1.51it/s] 
 18%|█▊        | 11864/65536 [2:12:57<9:58:06,  1.50it/s]
 18%|█▊        | 11865/65536 [2:12:58<10:13:29,  1.46it/s]
 18%|█▊        | 11866/65536 [2:12:58<10:04:26,  1.48it/s]
 18%|█▊        | 11867/65536 [2:12:59<10:02:16,  1.49it/s]
 18%|█▊        | 11868/65536 [2:13:00<10:07:52,  1.47it/s]
 18%|█▊        | 11869/65536 [2:13:00<10:03:39,  1.48it/s]
 18%|█▊        | 11870/65536 [2:13:01<10:07:19,  1.47it/s]
 18%|█▊        | 11871/65536 [2:13:02<9:59:36,  1.49it/s] 
 18%|█▊        | 11872/65536 [2:13:02<9:46:25,  1.53it/s]
 18%|█▊        | 11873/65536 [2:13:03<10:08:36,  1.47it/s]
 18%|█▊        | 11874/65536 [2:13:04<10:11:09,  1.46it/s]
 18%|█▊        | 11875/65536 [2:13:05<10:25:13,  1.43it/s]
 18%|█▊        | 11876/65536 [2:13:05<10:16:53,  1.45it/s]
 18%|█▊        | 11877/65536 [2:13:06<10:15:07,  1.45it/s]
 18%|█▊        | 11878/65536 [2:13:07<10:06:07,  1.48it/s]
 18%|█▊        | 11879/65536 [2:13:07<10:29:59,  1.42it/s]
 18%|█▊        | 11880/65536 [2:13:08<10:23:33,  1.43it/s]
                                                          
{'loss': 0.9684, 'learning_rate': 8.39108607811926e-07, 'epoch': 733.33}

 18%|█▊        | 11880/65536 [2:13:08<10:23:33,  1.43it/s]
 18%|█▊        | 11881/65536 [2:13:09<10:16:16,  1.45it/s]
 18%|█▊        | 11882/65536 [2:13:09<10:02:01,  1.49it/s]
 18%|█▊        | 11883/65536 [2:13:10<10:00:06,  1.49it/s]
 18%|█▊        | 11884/65536 [2:13:11<9:49:00,  1.52it/s] 
 18%|█▊        | 11885/65536 [2:13:11<9:52:48,  1.51it/s]
 18%|█▊        | 11886/65536 [2:13:12<9:52:16,  1.51it/s]
 18%|█▊        | 11887/65536 [2:13:13<9:43:33,  1.53it/s]
 18%|█▊        | 11888/65536 [2:13:13<9:46:54,  1.52it/s]
 18%|█▊        | 11889/65536 [2:13:14<9:48:49,  1.52it/s]
 18%|█▊        | 11890/65536 [2:13:15<9:52:41,  1.51it/s]
 18%|█▊        | 11891/65536 [2:13:15<10:20:15,  1.44it/s]
 18%|█▊        | 11892/65536 [2:13:16<10:38:24,  1.40it/s]
 18%|█▊        | 11893/65536 [2:13:17<10:18:17,  1.45it/s]
 18%|█▊        | 11894/65536 [2:13:17<10:06:24,  1.47it/s]
 18%|█▊        | 11895/65536 [2:13:18<9:50:48,  1.51it/s] 
 18%|█▊        | 11896/65536 [2:13:19<10:07:01,  1.47it/s]
 18%|█▊        | 11897/65536 [2:13:19<9:46:36,  1.52it/s] 
 18%|█▊        | 11898/65536 [2:13:20<10:01:23,  1.49it/s]
 18%|█▊        | 11899/65536 [2:13:21<9:52:46,  1.51it/s] 
 18%|█▊        | 11900/65536 [2:13:21<9:48:06,  1.52it/s]
                                                         
{'loss': 0.9731, 'learning_rate': 8.388331088526999e-07, 'epoch': 734.57}

 18%|█▊        | 11900/65536 [2:13:21<9:48:06,  1.52it/s]
 18%|█▊        | 11901/65536 [2:13:22<9:46:25,  1.52it/s]
 18%|█▊        | 11902/65536 [2:13:23<9:43:20,  1.53it/s]
 18%|█▊        | 11903/65536 [2:13:23<9:58:10,  1.49it/s]
 18%|█▊        | 11904/65536 [2:13:24<9:53:15,  1.51it/s]
 18%|█▊        | 11905/65536 [2:13:25<9:51:05,  1.51it/s]
 18%|█▊        | 11906/65536 [2:13:25<9:50:43,  1.51it/s]
 18%|█▊        | 11907/65536 [2:13:26<9:52:49,  1.51it/s]
 18%|█▊        | 11908/65536 [2:13:27<10:12:41,  1.46it/s]
 18%|█▊        | 11909/65536 [2:13:27<10:01:04,  1.49it/s]
 18%|█▊        | 11910/65536 [2:13:28<10:09:02,  1.47it/s]
 18%|█▊        | 11911/65536 [2:13:29<10:21:29,  1.44it/s]
 18%|█▊        | 11912/65536 [2:13:29<10:15:16,  1.45it/s]
 18%|█▊        | 11913/65536 [2:13:30<10:18:10,  1.45it/s]
 18%|█▊        | 11914/65536 [2:13:31<10:13:02,  1.46it/s]
 18%|█▊        | 11915/65536 [2:13:32<10:13:25,  1.46it/s]
 18%|█▊        | 11916/65536 [2:13:32<9:55:10,  1.50it/s] 
 18%|█▊        | 11917/65536 [2:13:33<9:58:32,  1.49it/s]
 18%|█▊        | 11918/65536 [2:13:34<10:04:08,  1.48it/s]
 18%|█▊        | 11919/65536 [2:13:34<10:16:51,  1.45it/s]
 18%|█▊        | 11920/65536 [2:13:35<10:05:10,  1.48it/s]
                                                          
{'loss': 0.9741, 'learning_rate': 8.385576098934737e-07, 'epoch': 735.8}

 18%|█▊        | 11920/65536 [2:13:35<10:05:10,  1.48it/s]
 18%|█▊        | 11921/65536 [2:13:36<9:50:24,  1.51it/s] 
 18%|█▊        | 11922/65536 [2:13:36<9:46:21,  1.52it/s]
 18%|█▊        | 11923/65536 [2:13:37<9:42:47,  1.53it/s]
 18%|█▊        | 11924/65536 [2:13:38<10:18:25,  1.44it/s]
 18%|█▊        | 11925/65536 [2:13:38<10:04:41,  1.48it/s]
 18%|█▊        | 11926/65536 [2:13:39<10:03:11,  1.48it/s]
 18%|█▊        | 11927/65536 [2:13:40<10:11:49,  1.46it/s]
 18%|█▊        | 11928/65536 [2:13:40<10:07:00,  1.47it/s]
 18%|█▊        | 11929/65536 [2:13:41<10:05:40,  1.48it/s]
 18%|█▊        | 11930/65536 [2:13:42<9:59:53,  1.49it/s] 
 18%|█▊        | 11931/65536 [2:13:42<9:45:31,  1.53it/s]
 18%|█▊        | 11932/65536 [2:13:43<9:45:23,  1.53it/s]
 18%|█▊        | 11933/65536 [2:13:44<9:43:50,  1.53it/s]
 18%|█▊        | 11934/65536 [2:13:44<9:56:10,  1.50it/s]
 18%|█▊        | 11935/65536 [2:13:45<10:00:57,  1.49it/s]
 18%|█▊        | 11936/65536 [2:13:46<10:02:52,  1.48it/s]
 18%|█▊        | 11937/65536 [2:13:46<10:12:32,  1.46it/s]
 18%|█▊        | 11938/65536 [2:13:47<10:06:55,  1.47it/s]
 18%|█▊        | 11939/65536 [2:13:48<9:49:32,  1.52it/s] 
 18%|█▊        | 11940/65536 [2:13:48<10:29:54,  1.42it/s]
                                                          
{'loss': 0.952, 'learning_rate': 8.382821109342476e-07, 'epoch': 737.04}

 18%|█▊        | 11940/65536 [2:13:48<10:29:54,  1.42it/s]
 18%|█▊        | 11941/65536 [2:13:49<10:22:24,  1.44it/s]
 18%|█▊        | 11942/65536 [2:13:50<10:19:50,  1.44it/s]
 18%|█▊        | 11943/65536 [2:13:50<10:14:49,  1.45it/s]
 18%|█▊        | 11944/65536 [2:13:51<10:31:03,  1.42it/s]
 18%|█▊        | 11945/65536 [2:13:52<9:59:03,  1.49it/s] 
 18%|█▊        | 11946/65536 [2:13:52<9:58:00,  1.49it/s]
 18%|█▊        | 11947/65536 [2:13:53<9:56:53,  1.50it/s]
 18%|█▊        | 11948/65536 [2:13:54<10:11:43,  1.46it/s]
 18%|█▊        | 11949/65536 [2:13:54<10:00:05,  1.49it/s]
 18%|█▊        | 11950/65536 [2:13:55<10:03:04,  1.48it/s]
 18%|█▊        | 11951/65536 [2:13:56<9:58:21,  1.49it/s] 
 18%|█▊        | 11952/65536 [2:13:56<9:48:24,  1.52it/s]
 18%|█▊        | 11953/65536 [2:13:57<9:46:24,  1.52it/s]
 18%|█▊        | 11954/65536 [2:13:58<9:38:36,  1.54it/s]
 18%|█▊        | 11955/65536 [2:13:58<10:03:31,  1.48it/s]
 18%|█▊        | 11956/65536 [2:13:59<10:31:37,  1.41it/s]
 18%|█▊        | 11957/65536 [2:14:00<10:10:41,  1.46it/s]
 18%|█▊        | 11958/65536 [2:14:01<10:10:15,  1.46it/s]
 18%|█▊        | 11959/65536 [2:14:01<10:09:37,  1.46it/s]
 18%|█▊        | 11960/65536 [2:14:02<10:11:37,  1.46it/s]
                                                          
{'loss': 0.9556, 'learning_rate': 8.380066119750214e-07, 'epoch': 738.27}

 18%|█▊        | 11960/65536 [2:14:02<10:11:37,  1.46it/s]
 18%|█▊        | 11961/65536 [2:14:03<10:14:57,  1.45it/s]
 18%|█▊        | 11962/65536 [2:14:03<10:05:38,  1.47it/s]
 18%|█▊        | 11963/65536 [2:14:04<10:03:56,  1.48it/s]
 18%|█▊        | 11964/65536 [2:14:05<10:05:12,  1.48it/s]
 18%|█▊        | 11965/65536 [2:14:05<10:27:26,  1.42it/s]
 18%|█▊        | 11966/65536 [2:14:06<10:32:02,  1.41it/s]
 18%|█▊        | 11967/65536 [2:14:07<10:21:09,  1.44it/s]
 18%|█▊        | 11968/65536 [2:14:07<10:14:45,  1.45it/s]
 18%|█▊        | 11969/65536 [2:14:08<9:56:13,  1.50it/s] 
 18%|█▊        | 11970/65536 [2:14:09<9:44:52,  1.53it/s]
 18%|█▊        | 11971/65536 [2:14:09<9:34:29,  1.55it/s]
 18%|█▊        | 11972/65536 [2:14:10<10:02:39,  1.48it/s]
 18%|█▊        | 11973/65536 [2:14:11<9:58:52,  1.49it/s] 
 18%|█▊        | 11974/65536 [2:14:11<10:14:11,  1.45it/s]
 18%|█▊        | 11975/65536 [2:14:12<10:04:58,  1.48it/s]
 18%|█▊        | 11976/65536 [2:14:13<10:07:50,  1.47it/s]
 18%|█▊        | 11977/65536 [2:14:13<10:01:35,  1.48it/s]
 18%|█▊        | 11978/65536 [2:14:14<9:58:10,  1.49it/s] 
 18%|█▊        | 11979/65536 [2:14:15<10:08:18,  1.47it/s]
 18%|█▊        | 11980/65536 [2:14:16<10:19:15,  1.44it/s]
                                                          
{'loss': 0.9562, 'learning_rate': 8.377311130157952e-07, 'epoch': 739.51}

 18%|█▊        | 11980/65536 [2:14:16<10:19:15,  1.44it/s]
 18%|█▊        | 11981/65536 [2:14:16<10:06:52,  1.47it/s]
 18%|█▊        | 11982/65536 [2:14:17<9:49:06,  1.52it/s] 
 18%|█▊        | 11983/65536 [2:14:17<9:45:15,  1.53it/s]
 18%|█▊        | 11984/65536 [2:14:18<9:51:24,  1.51it/s]
 18%|█▊        | 11985/65536 [2:14:19<9:56:36,  1.50it/s]
 18%|█▊        | 11986/65536 [2:14:20<10:07:59,  1.47it/s]
 18%|█▊        | 11987/65536 [2:14:20<10:06:24,  1.47it/s]
 18%|█▊        | 11988/65536 [2:14:21<9:55:51,  1.50it/s] 
 18%|█▊        | 11989/65536 [2:14:22<10:44:15,  1.39it/s]
 18%|█▊        | 11990/65536 [2:14:22<10:31:16,  1.41it/s]
 18%|█▊        | 11991/65536 [2:14:23<10:15:40,  1.45it/s]
 18%|█▊        | 11992/65536 [2:14:24<10:07:47,  1.47it/s]
 18%|█▊        | 11993/65536 [2:14:24<10:06:58,  1.47it/s]
 18%|█▊        | 11994/65536 [2:14:25<10:15:48,  1.45it/s]
 18%|█▊        | 11995/65536 [2:14:26<10:15:46,  1.45it/s]
 18%|█▊        | 11996/65536 [2:14:26<10:13:05,  1.46it/s]
 18%|█▊        | 11997/65536 [2:14:27<10:09:17,  1.46it/s]
 18%|█▊        | 11998/65536 [2:14:28<10:04:34,  1.48it/s]
 18%|█▊        | 11999/65536 [2:14:28<9:55:15,  1.50it/s] 
 18%|█▊        | 12000/65536 [2:14:29<10:01:16,  1.48it/s]
                                                          
{'loss': 0.9371, 'learning_rate': 8.37455614056569e-07, 'epoch': 740.74}

 18%|█▊        | 12000/65536 [2:14:29<10:01:16,  1.48it/s]
 18%|█▊        | 12001/65536 [2:14:30<9:55:41,  1.50it/s] 
 18%|█▊        | 12002/65536 [2:14:30<9:53:08,  1.50it/s]
 18%|█▊        | 12003/65536 [2:14:31<9:45:52,  1.52it/s]
 18%|█▊        | 12004/65536 [2:14:32<9:40:18,  1.54it/s]
 18%|█▊        | 12005/65536 [2:14:32<10:15:01,  1.45it/s]
 18%|█▊        | 12006/65536 [2:14:33<10:06:45,  1.47it/s]
 18%|█▊        | 12007/65536 [2:14:34<9:56:04,  1.50it/s] 
 18%|█▊        | 12008/65536 [2:14:34<9:40:12,  1.54it/s]
 18%|█▊        | 12009/65536 [2:14:35<9:49:11,  1.51it/s]
 18%|█▊        | 12010/65536 [2:14:36<9:55:00,  1.50it/s]
 18%|█▊        | 12011/65536 [2:14:36<9:47:26,  1.52it/s]
 18%|█▊        | 12012/65536 [2:14:37<9:56:49,  1.49it/s]
 18%|█▊        | 12013/65536 [2:14:38<9:48:11,  1.52it/s]
 18%|█▊        | 12014/65536 [2:14:38<9:48:47,  1.52it/s]
 18%|█▊        | 12015/65536 [2:14:39<10:02:13,  1.48it/s]
 18%|█▊        | 12016/65536 [2:14:40<10:05:12,  1.47it/s]
 18%|█▊        | 12017/65536 [2:14:40<10:12:48,  1.46it/s]
 18%|█▊        | 12018/65536 [2:14:41<10:15:22,  1.45it/s]
 18%|█▊        | 12019/65536 [2:14:42<10:15:19,  1.45it/s]
 18%|█▊        | 12020/65536 [2:14:43<10:11:14,  1.46it/s]
                                                          
{'loss': 0.9728, 'learning_rate': 8.371801150973429e-07, 'epoch': 741.98}

 18%|█▊        | 12020/65536 [2:14:43<10:11:14,  1.46it/s]
 18%|█▊        | 12021/65536 [2:14:43<10:39:17,  1.40it/s]
 18%|█▊        | 12022/65536 [2:14:44<10:24:43,  1.43it/s]
 18%|█▊        | 12023/65536 [2:14:45<10:21:53,  1.43it/s]
 18%|█▊        | 12024/65536 [2:14:45<10:06:12,  1.47it/s]
 18%|█▊        | 12025/65536 [2:14:46<9:54:43,  1.50it/s] 
 18%|█▊        | 12026/65536 [2:14:47<9:48:17,  1.52it/s]
 18%|█▊        | 12027/65536 [2:14:47<9:49:36,  1.51it/s]
 18%|█▊        | 12028/65536 [2:14:48<9:41:13,  1.53it/s]
 18%|█▊        | 12029/65536 [2:14:49<9:36:02,  1.55it/s]
 18%|█▊        | 12030/65536 [2:14:49<9:52:01,  1.51it/s]
 18%|█▊        | 12031/65536 [2:14:50<10:09:27,  1.46it/s]
 18%|█▊        | 12032/65536 [2:14:51<10:23:32,  1.43it/s]
 18%|█▊        | 12033/65536 [2:14:51<10:16:18,  1.45it/s]
 18%|█▊        | 12034/65536 [2:14:52<10:02:53,  1.48it/s]
 18%|█▊        | 12035/65536 [2:14:53<10:09:53,  1.46it/s]
 18%|█▊        | 12036/65536 [2:14:53<9:56:14,  1.50it/s] 
 18%|█▊        | 12037/65536 [2:14:54<10:17:31,  1.44it/s]
 18%|█▊        | 12038/65536 [2:14:55<10:02:59,  1.48it/s]
 18%|█▊        | 12039/65536 [2:14:55<10:02:50,  1.48it/s]
 18%|█▊        | 12040/65536 [2:14:56<9:58:03,  1.49it/s] 
                                                         
{'loss': 0.9664, 'learning_rate': 8.369046161381168e-07, 'epoch': 743.21}

 18%|█▊        | 12040/65536 [2:14:56<9:58:03,  1.49it/s]
 18%|█▊        | 12041/65536 [2:14:57<10:04:21,  1.48it/s]
 18%|█▊        | 12042/65536 [2:14:57<9:54:06,  1.50it/s] 
 18%|█▊        | 12043/65536 [2:14:58<10:01:43,  1.48it/s]
 18%|█▊        | 12044/65536 [2:14:59<10:05:47,  1.47it/s]
 18%|█▊        | 12045/65536 [2:14:59<9:58:04,  1.49it/s] 
 18%|█▊        | 12046/65536 [2:15:00<10:05:45,  1.47it/s]
 18%|█▊        | 12047/65536 [2:15:01<9:57:58,  1.49it/s] 
 18%|█▊        | 12048/65536 [2:15:02<10:24:26,  1.43it/s]
 18%|█▊        | 12049/65536 [2:15:02<10:15:22,  1.45it/s]
 18%|█▊        | 12050/65536 [2:15:03<9:58:20,  1.49it/s] 
 18%|█▊        | 12051/65536 [2:15:03<9:42:20,  1.53it/s]
 18%|█▊        | 12052/65536 [2:15:04<9:42:50,  1.53it/s]
 18%|█▊        | 12053/65536 [2:15:05<10:20:53,  1.44it/s]
 18%|█▊        | 12054/65536 [2:15:06<10:01:40,  1.48it/s]
 18%|█▊        | 12055/65536 [2:15:06<10:02:08,  1.48it/s]
 18%|█▊        | 12056/65536 [2:15:07<9:58:23,  1.49it/s] 
 18%|█▊        | 12057/65536 [2:15:08<10:13:23,  1.45it/s]
 18%|█▊        | 12058/65536 [2:15:08<10:10:15,  1.46it/s]
 18%|█▊        | 12059/65536 [2:15:09<10:18:02,  1.44it/s]
 18%|█▊        | 12060/65536 [2:15:10<10:17:10,  1.44it/s]
                                                          
{'loss': 0.9514, 'learning_rate': 8.366291171788906e-07, 'epoch': 744.44}

 18%|█▊        | 12060/65536 [2:15:10<10:17:10,  1.44it/s]
 18%|█▊        | 12061/65536 [2:15:10<10:15:36,  1.45it/s]
 18%|█▊        | 12062/65536 [2:15:11<10:00:32,  1.48it/s]
 18%|█▊        | 12063/65536 [2:15:12<9:58:20,  1.49it/s] 
 18%|█▊        | 12064/65536 [2:15:12<9:52:45,  1.50it/s]
 18%|█▊        | 12065/65536 [2:15:13<9:46:08,  1.52it/s]
 18%|█▊        | 12066/65536 [2:15:14<9:50:46,  1.51it/s]
 18%|█▊        | 12067/65536 [2:15:14<9:43:20,  1.53it/s]
 18%|█▊        | 12068/65536 [2:15:15<9:49:21,  1.51it/s]
 18%|█▊        | 12069/65536 [2:15:16<9:41:36,  1.53it/s]
 18%|█▊        | 12070/65536 [2:15:16<10:05:13,  1.47it/s]
 18%|█▊        | 12071/65536 [2:15:17<10:00:41,  1.48it/s]
 18%|█▊        | 12072/65536 [2:15:18<10:00:11,  1.48it/s]
 18%|█▊        | 12073/65536 [2:15:18<9:58:17,  1.49it/s] 
 18%|█▊        | 12074/65536 [2:15:19<9:46:21,  1.52it/s]
 18%|█▊        | 12075/65536 [2:15:20<9:40:57,  1.53it/s]
 18%|█▊        | 12076/65536 [2:15:20<9:33:29,  1.55it/s]
 18%|█▊        | 12077/65536 [2:15:21<9:53:53,  1.50it/s]
 18%|█▊        | 12078/65536 [2:15:22<10:00:30,  1.48it/s]
 18%|█▊        | 12079/65536 [2:15:22<10:20:09,  1.44it/s]
 18%|█▊        | 12080/65536 [2:15:23<10:11:54,  1.46it/s]
                                                          
{'loss': 0.9668, 'learning_rate': 8.363536182196645e-07, 'epoch': 745.68}

 18%|█▊        | 12080/65536 [2:15:23<10:11:54,  1.46it/s]
 18%|█▊        | 12081/65536 [2:15:24<10:14:30,  1.45it/s]
 18%|█▊        | 12082/65536 [2:15:24<10:06:04,  1.47it/s]
 18%|█▊        | 12083/65536 [2:15:25<9:48:00,  1.52it/s] 
 18%|█▊        | 12084/65536 [2:15:26<9:59:56,  1.48it/s]
 18%|█▊        | 12085/65536 [2:15:26<9:58:34,  1.49it/s]
 18%|█▊        | 12086/65536 [2:15:27<10:46:11,  1.38it/s]
 18%|█▊        | 12087/65536 [2:15:28<10:14:15,  1.45it/s]
 18%|█▊        | 12088/65536 [2:15:29<10:18:31,  1.44it/s]
 18%|█▊        | 12089/65536 [2:15:29<10:12:09,  1.46it/s]
 18%|█▊        | 12090/65536 [2:15:30<10:08:58,  1.46it/s]
 18%|█▊        | 12091/65536 [2:15:31<10:09:51,  1.46it/s]
 18%|█▊        | 12092/65536 [2:15:31<10:10:23,  1.46it/s]
 18%|█▊        | 12093/65536 [2:15:32<10:09:10,  1.46it/s]
 18%|█▊        | 12094/65536 [2:15:33<10:03:56,  1.47it/s]
 18%|█▊        | 12095/65536 [2:15:33<10:06:28,  1.47it/s]
 18%|█▊        | 12096/65536 [2:15:34<10:01:42,  1.48it/s]
 18%|█▊        | 12097/65536 [2:15:35<10:07:09,  1.47it/s]
 18%|█▊        | 12098/65536 [2:15:35<9:52:08,  1.50it/s] 
 18%|█▊        | 12099/65536 [2:15:36<9:45:19,  1.52it/s]
 18%|█▊        | 12100/65536 [2:15:37<9:38:32,  1.54it/s]
                                                         
{'loss': 0.9582, 'learning_rate': 8.360781192604383e-07, 'epoch': 746.91}

 18%|█▊        | 12100/65536 [2:15:37<9:38:32,  1.54it/s]
 18%|█▊        | 12101/65536 [2:15:37<9:54:30,  1.50it/s]
 18%|█▊        | 12102/65536 [2:15:38<10:12:36,  1.45it/s]
 18%|█▊        | 12103/65536 [2:15:39<10:05:42,  1.47it/s]
 18%|█▊        | 12104/65536 [2:15:39<10:11:28,  1.46it/s]
 18%|█▊        | 12105/65536 [2:15:40<10:16:43,  1.44it/s]
 18%|█▊        | 12106/65536 [2:15:41<10:22:40,  1.43it/s]
 18%|█▊        | 12107/65536 [2:15:41<10:06:07,  1.47it/s]
 18%|█▊        | 12108/65536 [2:15:42<9:59:02,  1.49it/s] 
 18%|█▊        | 12109/65536 [2:15:43<9:58:46,  1.49it/s]
 18%|█▊        | 12110/65536 [2:15:43<9:50:40,  1.51it/s]
 18%|█▊        | 12111/65536 [2:15:44<9:50:35,  1.51it/s]
 18%|█▊        | 12112/65536 [2:15:45<10:05:52,  1.47it/s]
 18%|█▊        | 12113/65536 [2:15:45<10:08:20,  1.46it/s]
 18%|█▊        | 12114/65536 [2:15:46<9:42:31,  1.53it/s] 
 18%|█▊        | 12115/65536 [2:15:47<9:48:49,  1.51it/s]
 18%|█▊        | 12116/65536 [2:15:47<9:48:41,  1.51it/s]
 18%|█▊        | 12117/65536 [2:15:48<9:42:38,  1.53it/s]
 18%|█▊        | 12118/65536 [2:15:49<10:19:48,  1.44it/s]
 18%|█▊        | 12119/65536 [2:15:50<10:20:18,  1.44it/s]
 18%|█▊        | 12120/65536 [2:15:50<10:27:06,  1.42it/s]
                                                          
{'loss': 0.9562, 'learning_rate': 8.358026203012122e-07, 'epoch': 748.15}

 18%|█▊        | 12120/65536 [2:15:50<10:27:06,  1.42it/s]
 18%|█▊        | 12121/65536 [2:15:51<10:17:17,  1.44it/s]
 18%|█▊        | 12122/65536 [2:15:52<9:58:20,  1.49it/s] 
 18%|█▊        | 12123/65536 [2:15:52<10:02:26,  1.48it/s]
 18%|█▊        | 12124/65536 [2:15:53<9:52:32,  1.50it/s] 
 19%|█▊        | 12125/65536 [2:15:54<9:51:55,  1.50it/s]
 19%|█▊        | 12126/65536 [2:15:54<10:16:42,  1.44it/s]
 19%|█▊        | 12127/65536 [2:15:55<10:22:29,  1.43it/s]
 19%|█▊        | 12128/65536 [2:15:56<10:08:10,  1.46it/s]
 19%|█▊        | 12129/65536 [2:15:56<10:18:06,  1.44it/s]
 19%|█▊        | 12130/65536 [2:15:57<10:13:34,  1.45it/s]
 19%|█▊        | 12131/65536 [2:15:58<9:48:55,  1.51it/s] 
 19%|█▊        | 12132/65536 [2:15:58<9:39:08,  1.54it/s]
 19%|█▊        | 12133/65536 [2:15:59<9:46:02,  1.52it/s]
 19%|█▊        | 12134/65536 [2:16:00<10:13:45,  1.45it/s]
 19%|█▊        | 12135/65536 [2:16:00<10:09:01,  1.46it/s]
 19%|█▊        | 12136/65536 [2:16:01<10:21:05,  1.43it/s]
 19%|█▊        | 12137/65536 [2:16:02<10:11:35,  1.46it/s]
 19%|█▊        | 12138/65536 [2:16:02<10:09:58,  1.46it/s]
 19%|█▊        | 12139/65536 [2:16:03<10:12:12,  1.45it/s]
 19%|█▊        | 12140/65536 [2:16:04<9:52:51,  1.50it/s] 
                                                         
{'loss': 0.9667, 'learning_rate': 8.355271213419861e-07, 'epoch': 749.38}

 19%|█▊        | 12140/65536 [2:16:04<9:52:51,  1.50it/s]
 19%|█▊        | 12141/65536 [2:16:04<9:33:53,  1.55it/s]
 19%|█▊        | 12142/65536 [2:16:05<10:01:32,  1.48it/s]
 19%|█▊        | 12143/65536 [2:16:06<9:58:54,  1.49it/s] 
 19%|█▊        | 12144/65536 [2:16:06<9:48:20,  1.51it/s]
 19%|█▊        | 12145/65536 [2:16:07<9:52:28,  1.50it/s]
 19%|█▊        | 12146/65536 [2:16:08<9:38:55,  1.54it/s]
 19%|█▊        | 12147/65536 [2:16:08<9:33:38,  1.55it/s]
 19%|█▊        | 12148/65536 [2:16:09<9:58:17,  1.49it/s]
 19%|█▊        | 12149/65536 [2:16:10<9:50:57,  1.51it/s]
 19%|█▊        | 12150/65536 [2:16:10<10:04:59,  1.47it/s]
 19%|█▊        | 12151/65536 [2:16:11<10:17:40,  1.44it/s]
 19%|█▊        | 12152/65536 [2:16:12<10:23:12,  1.43it/s]
 19%|█▊        | 12153/65536 [2:16:12<10:05:07,  1.47it/s]
 19%|█▊        | 12154/65536 [2:16:13<10:09:19,  1.46it/s]
 19%|█▊        | 12155/65536 [2:16:14<10:05:35,  1.47it/s]
 19%|█▊        | 12156/65536 [2:16:15<10:05:37,  1.47it/s]
 19%|█▊        | 12157/65536 [2:16:15<10:06:01,  1.47it/s]
 19%|█▊        | 12158/65536 [2:16:16<9:49:19,  1.51it/s] 
 19%|█▊        | 12159/65536 [2:16:16<9:43:52,  1.52it/s]
 19%|█▊        | 12160/65536 [2:16:17<9:40:17,  1.53it/s]
                                                         
{'loss': 0.9502, 'learning_rate': 8.352516223827598e-07, 'epoch': 750.62}

 19%|█▊        | 12160/65536 [2:16:17<9:40:17,  1.53it/s]
 19%|█▊        | 12161/65536 [2:16:18<9:46:56,  1.52it/s]
 19%|█▊        | 12162/65536 [2:16:18<9:37:05,  1.54it/s]
 19%|█▊        | 12163/65536 [2:16:19<9:45:10,  1.52it/s]
 19%|█▊        | 12164/65536 [2:16:20<9:47:40,  1.51it/s]
 19%|█▊        | 12165/65536 [2:16:20<9:51:42,  1.50it/s]
 19%|█▊        | 12166/65536 [2:16:21<9:48:33,  1.51it/s]
 19%|█▊        | 12167/65536 [2:16:22<10:03:30,  1.47it/s]
 19%|█▊        | 12168/65536 [2:16:22<9:56:59,  1.49it/s] 
 19%|█▊        | 12169/65536 [2:16:23<9:52:04,  1.50it/s]
 19%|█▊        | 12170/65536 [2:16:24<9:56:36,  1.49it/s]
 19%|█▊        | 12171/65536 [2:16:24<9:54:36,  1.50it/s]
 19%|█▊        | 12172/65536 [2:16:25<10:19:01,  1.44it/s]
 19%|█▊        | 12173/65536 [2:16:26<10:13:55,  1.45it/s]
 19%|█▊        | 12174/65536 [2:16:27<10:07:32,  1.46it/s]
 19%|█▊        | 12175/65536 [2:16:27<10:06:57,  1.47it/s]
 19%|█▊        | 12176/65536 [2:16:28<9:58:02,  1.49it/s] 
 19%|█▊        | 12177/65536 [2:16:29<10:07:23,  1.46it/s]
 19%|█▊        | 12178/65536 [2:16:29<10:07:12,  1.46it/s]
 19%|█▊        | 12179/65536 [2:16:30<10:12:01,  1.45it/s]
 19%|█▊        | 12180/65536 [2:16:31<10:00:01,  1.48it/s]
                                                          
{'loss': 0.9691, 'learning_rate': 8.349761234235337e-07, 'epoch': 751.85}

 19%|█▊        | 12180/65536 [2:16:31<10:00:01,  1.48it/s]
 19%|█▊        | 12181/65536 [2:16:31<9:51:48,  1.50it/s] 
 19%|█▊        | 12182/65536 [2:16:32<9:43:50,  1.52it/s]
 19%|█▊        | 12183/65536 [2:16:33<10:10:52,  1.46it/s]
 19%|█▊        | 12184/65536 [2:16:33<9:55:06,  1.49it/s] 
 19%|█▊        | 12185/65536 [2:16:34<9:53:05,  1.50it/s]
 19%|█▊        | 12186/65536 [2:16:35<9:53:06,  1.50it/s]
 19%|█▊        | 12187/65536 [2:16:35<9:51:30,  1.50it/s]
 19%|█▊        | 12188/65536 [2:16:36<10:06:59,  1.46it/s]
 19%|█▊        | 12189/65536 [2:16:37<10:01:52,  1.48it/s]
 19%|█▊        | 12190/65536 [2:16:37<10:03:11,  1.47it/s]
 19%|█▊        | 12191/65536 [2:16:38<10:12:30,  1.45it/s]
 19%|█▊        | 12192/65536 [2:16:39<10:01:08,  1.48it/s]
 19%|█▊        | 12193/65536 [2:16:39<10:17:21,  1.44it/s]
 19%|█▊        | 12194/65536 [2:16:40<9:45:02,  1.52it/s] 
 19%|█▊        | 12195/65536 [2:16:41<9:42:00,  1.53it/s]
 19%|█▊        | 12196/65536 [2:16:41<10:04:14,  1.47it/s]
 19%|█▊        | 12197/65536 [2:16:42<10:01:45,  1.48it/s]
 19%|█▊        | 12198/65536 [2:16:43<9:59:06,  1.48it/s] 
 19%|█▊        | 12199/65536 [2:16:43<10:15:25,  1.44it/s]
 19%|█▊        | 12200/65536 [2:16:44<10:06:23,  1.47it/s]
                                                          
{'loss': 0.964, 'learning_rate': 8.347006244643075e-07, 'epoch': 753.09}

 19%|█▊        | 12200/65536 [2:16:44<10:06:23,  1.47it/s]
 19%|█▊        | 12201/65536 [2:16:45<10:13:25,  1.45it/s]
 19%|█▊        | 12202/65536 [2:16:46<10:05:14,  1.47it/s]
 19%|█▊        | 12203/65536 [2:16:46<10:10:15,  1.46it/s]
 19%|█▊        | 12204/65536 [2:16:47<10:08:50,  1.46it/s]
 19%|█▊        | 12205/65536 [2:16:48<9:51:31,  1.50it/s] 
 19%|█▊        | 12206/65536 [2:16:48<9:51:24,  1.50it/s]
 19%|█▊        | 12207/65536 [2:16:49<9:41:41,  1.53it/s]
 19%|█▊        | 12208/65536 [2:16:49<9:46:10,  1.52it/s]
 19%|█▊        | 12209/65536 [2:16:50<9:47:25,  1.51it/s]
 19%|█▊        | 12210/65536 [2:16:51<9:31:47,  1.55it/s]
 19%|█▊        | 12211/65536 [2:16:51<9:34:46,  1.55it/s]
 19%|█▊        | 12212/65536 [2:16:52<9:44:47,  1.52it/s]
 19%|█▊        | 12213/65536 [2:16:53<9:40:11,  1.53it/s]
 19%|█▊        | 12214/65536 [2:16:53<9:40:58,  1.53it/s]
 19%|█▊        | 12215/65536 [2:16:54<10:18:03,  1.44it/s]
 19%|█▊        | 12216/65536 [2:16:55<10:27:02,  1.42it/s]
 19%|█▊        | 12217/65536 [2:16:56<10:07:44,  1.46it/s]
 19%|█▊        | 12218/65536 [2:16:56<9:49:19,  1.51it/s] 
 19%|█▊        | 12219/65536 [2:16:57<9:45:40,  1.52it/s]
 19%|█▊        | 12220/65536 [2:16:57<9:52:50,  1.50it/s]
                                                         
{'loss': 0.9786, 'learning_rate': 8.344251255050814e-07, 'epoch': 754.32}

 19%|█▊        | 12220/65536 [2:16:57<9:52:50,  1.50it/s]
 19%|█▊        | 12221/65536 [2:16:58<9:43:03,  1.52it/s]
 19%|█▊        | 12222/65536 [2:16:59<9:50:04,  1.51it/s]
 19%|█▊        | 12223/65536 [2:16:59<9:58:40,  1.48it/s]
 19%|█▊        | 12224/65536 [2:17:00<9:55:53,  1.49it/s]
 19%|█▊        | 12225/65536 [2:17:01<9:48:45,  1.51it/s]
 19%|█▊        | 12226/65536 [2:17:01<9:49:57,  1.51it/s]
 19%|█▊        | 12227/65536 [2:17:02<9:50:45,  1.50it/s]
 19%|█▊        | 12228/65536 [2:17:03<9:42:45,  1.52it/s]
 19%|█▊        | 12229/65536 [2:17:03<9:50:08,  1.51it/s]
 19%|█▊        | 12230/65536 [2:17:04<9:56:16,  1.49it/s]
 19%|█▊        | 12231/65536 [2:17:05<10:03:54,  1.47it/s]
 19%|█▊        | 12232/65536 [2:17:06<10:20:15,  1.43it/s]
 19%|█▊        | 12233/65536 [2:17:06<10:21:11,  1.43it/s]
 19%|█▊        | 12234/65536 [2:17:07<10:20:27,  1.43it/s]
 19%|█▊        | 12235/65536 [2:17:08<10:23:05,  1.43it/s]
 19%|█▊        | 12236/65536 [2:17:08<10:34:37,  1.40it/s]
 19%|█▊        | 12237/65536 [2:17:09<10:17:49,  1.44it/s]
 19%|█▊        | 12238/65536 [2:17:10<10:24:02,  1.42it/s]
 19%|█▊        | 12239/65536 [2:17:10<10:08:26,  1.46it/s]
 19%|█▊        | 12240/65536 [2:17:11<10:00:02,  1.48it/s]
                                                          
{'loss': 0.9491, 'learning_rate': 8.341496265458553e-07, 'epoch': 755.56}

 19%|█▊        | 12240/65536 [2:17:11<10:00:02,  1.48it/s]
 19%|█▊        | 12241/65536 [2:17:12<9:45:02,  1.52it/s] 
 19%|█▊        | 12242/65536 [2:17:12<9:45:36,  1.52it/s]
 19%|█▊        | 12243/65536 [2:17:13<9:44:01,  1.52it/s]
 19%|█▊        | 12244/65536 [2:17:14<9:53:51,  1.50it/s]
 19%|█▊        | 12245/65536 [2:17:14<9:46:33,  1.51it/s]
 19%|█▊        | 12246/65536 [2:17:15<10:07:20,  1.46it/s]
 19%|█▊        | 12247/65536 [2:17:16<10:01:11,  1.48it/s]
 19%|█▊        | 12248/65536 [2:17:17<10:21:38,  1.43it/s]
 19%|█▊        | 12249/65536 [2:17:17<10:13:04,  1.45it/s]
 19%|█▊        | 12250/65536 [2:17:18<10:08:20,  1.46it/s]
 19%|█▊        | 12251/65536 [2:17:19<10:23:35,  1.42it/s]
 19%|█▊        | 12252/65536 [2:17:19<10:12:30,  1.45it/s]
 19%|█▊        | 12253/65536 [2:17:20<9:52:02,  1.50it/s] 
 19%|█▊        | 12254/65536 [2:17:21<9:53:30,  1.50it/s]
 19%|█▊        | 12255/65536 [2:17:21<9:46:44,  1.51it/s]
 19%|█▊        | 12256/65536 [2:17:22<9:58:01,  1.48it/s]
 19%|█▊        | 12257/65536 [2:17:23<10:29:13,  1.41it/s]
 19%|█▊        | 12258/65536 [2:17:23<10:17:52,  1.44it/s]
 19%|█▊        | 12259/65536 [2:17:24<10:22:23,  1.43it/s]
 19%|█▊        | 12260/65536 [2:17:25<10:06:16,  1.46it/s]
                                                          
{'loss': 0.9155, 'learning_rate': 8.33874127586629e-07, 'epoch': 756.79}

 19%|█▊        | 12260/65536 [2:17:25<10:06:16,  1.46it/s]
 19%|█▊        | 12261/65536 [2:17:25<9:59:28,  1.48it/s] 
 19%|█▊        | 12262/65536 [2:17:26<9:58:37,  1.48it/s]
 19%|█▊        | 12263/65536 [2:17:27<9:50:29,  1.50it/s]
 19%|█▊        | 12264/65536 [2:17:27<10:07:00,  1.46it/s]
 19%|█▊        | 12265/65536 [2:17:28<10:17:10,  1.44it/s]
 19%|█▊        | 12266/65536 [2:17:29<10:23:00,  1.43it/s]
 19%|█▊        | 12267/65536 [2:17:30<10:11:46,  1.45it/s]
 19%|█▊        | 12268/65536 [2:17:30<9:59:39,  1.48it/s] 
 19%|█▊        | 12269/65536 [2:17:31<9:48:54,  1.51it/s]
 19%|█▊        | 12270/65536 [2:17:31<9:43:57,  1.52it/s]
 19%|█▊        | 12271/65536 [2:17:32<9:41:11,  1.53it/s]
 19%|█▊        | 12272/65536 [2:17:33<9:40:16,  1.53it/s]
 19%|█▊        | 12273/65536 [2:17:33<9:38:04,  1.54it/s]
 19%|█▊        | 12274/65536 [2:17:34<9:38:22,  1.53it/s]
 19%|█▊        | 12275/65536 [2:17:35<9:41:16,  1.53it/s]
 19%|█▊        | 12276/65536 [2:17:35<9:56:03,  1.49it/s]
 19%|█▊        | 12277/65536 [2:17:36<10:02:10,  1.47it/s]
 19%|█▊        | 12278/65536 [2:17:37<10:01:51,  1.47it/s]
 19%|█▊        | 12279/65536 [2:17:37<9:49:27,  1.51it/s] 
 19%|█▊        | 12280/65536 [2:17:38<10:09:00,  1.46it/s]
                                                          
{'loss': 0.9834, 'learning_rate': 8.335986286274029e-07, 'epoch': 758.02}

 19%|█▊        | 12280/65536 [2:17:38<10:09:00,  1.46it/s]
 19%|█▊        | 12281/65536 [2:17:39<10:12:30,  1.45it/s]
 19%|█▊        | 12282/65536 [2:17:39<10:03:17,  1.47it/s]
 19%|█▊        | 12283/65536 [2:17:40<9:52:07,  1.50it/s] 
 19%|█▊        | 12284/65536 [2:17:41<9:34:01,  1.55it/s]
 19%|█▊        | 12285/65536 [2:17:41<9:37:25,  1.54it/s]
 19%|█▊        | 12286/65536 [2:17:42<9:22:33,  1.58it/s]
 19%|█▊        | 12287/65536 [2:17:43<9:43:32,  1.52it/s]
 19%|█▉        | 12288/65536 [2:17:43<9:41:52,  1.53it/s]
 19%|█▉        | 12289/65536 [2:17:44<10:01:36,  1.48it/s]
 19%|█▉        | 12290/65536 [2:17:45<10:12:30,  1.45it/s]
 19%|█▉        | 12291/65536 [2:17:45<10:13:45,  1.45it/s]
 19%|█▉        | 12292/65536 [2:17:46<10:02:09,  1.47it/s]
 19%|█▉        | 12293/65536 [2:17:47<9:46:59,  1.51it/s] 
 19%|█▉        | 12294/65536 [2:17:47<9:48:38,  1.51it/s]
 19%|█▉        | 12295/65536 [2:17:48<9:54:18,  1.49it/s]
 19%|█▉        | 12296/65536 [2:17:49<10:06:42,  1.46it/s]
 19%|█▉        | 12297/65536 [2:17:50<10:15:57,  1.44it/s]
 19%|█▉        | 12298/65536 [2:17:50<10:15:07,  1.44it/s]
 19%|█▉        | 12299/65536 [2:17:51<9:51:42,  1.50it/s] 
 19%|█▉        | 12300/65536 [2:17:51<9:44:09,  1.52it/s]
                                                         
{'loss': 0.9735, 'learning_rate': 8.333231296681767e-07, 'epoch': 759.26}

 19%|█▉        | 12300/65536 [2:17:51<9:44:09,  1.52it/s]
 19%|█▉        | 12301/65536 [2:17:52<9:55:00,  1.49it/s]
 19%|█▉        | 12302/65536 [2:17:53<10:10:41,  1.45it/s]
 19%|█▉        | 12303/65536 [2:17:54<10:03:47,  1.47it/s]
 19%|█▉        | 12304/65536 [2:17:54<9:57:02,  1.49it/s] 
 19%|█▉        | 12305/65536 [2:17:55<9:51:19,  1.50it/s]
 19%|█▉        | 12306/65536 [2:17:56<9:48:43,  1.51it/s]
 19%|█▉        | 12307/65536 [2:17:56<10:05:35,  1.46it/s]
 19%|█▉        | 12308/65536 [2:17:57<10:14:25,  1.44it/s]
 19%|█▉        | 12309/65536 [2:17:58<9:55:00,  1.49it/s] 
 19%|█▉        | 12310/65536 [2:17:58<9:54:54,  1.49it/s]
 19%|█▉        | 12311/65536 [2:17:59<9:55:06,  1.49it/s]
 19%|█▉        | 12312/65536 [2:18:00<9:42:26,  1.52it/s]
 19%|█▉        | 12313/65536 [2:18:00<10:13:29,  1.45it/s]
 19%|█▉        | 12314/65536 [2:18:01<10:04:07,  1.47it/s]
 19%|█▉        | 12315/65536 [2:18:02<10:02:31,  1.47it/s]
 19%|█▉        | 12316/65536 [2:18:02<9:56:53,  1.49it/s] 
 19%|█▉        | 12317/65536 [2:18:03<10:08:04,  1.46it/s]
 19%|█▉        | 12318/65536 [2:18:04<10:07:27,  1.46it/s]
 19%|█▉        | 12319/65536 [2:18:04<10:02:04,  1.47it/s]
 19%|█▉        | 12320/65536 [2:18:05<9:57:55,  1.48it/s] 
                                                         
{'loss': 0.9419, 'learning_rate': 8.330476307089506e-07, 'epoch': 760.49}

 19%|█▉        | 12320/65536 [2:18:05<9:57:55,  1.48it/s]
 19%|█▉        | 12321/65536 [2:18:06<9:58:06,  1.48it/s]
 19%|█▉        | 12322/65536 [2:18:06<9:49:24,  1.50it/s]
 19%|█▉        | 12323/65536 [2:18:07<10:10:30,  1.45it/s]
 19%|█▉        | 12324/65536 [2:18:08<10:00:01,  1.48it/s]
 19%|█▉        | 12325/65536 [2:18:08<10:03:31,  1.47it/s]
 19%|█▉        | 12326/65536 [2:18:09<10:11:49,  1.45it/s]
 19%|█▉        | 12327/65536 [2:18:10<9:57:23,  1.48it/s] 
 19%|█▉        | 12328/65536 [2:18:10<9:46:56,  1.51it/s]
 19%|█▉        | 12329/65536 [2:18:11<9:59:47,  1.48it/s]
 19%|█▉        | 12330/65536 [2:18:12<10:02:09,  1.47it/s]
 19%|█▉        | 12331/65536 [2:18:13<10:04:12,  1.47it/s]
 19%|█▉        | 12332/65536 [2:18:13<9:54:11,  1.49it/s] 
 19%|█▉        | 12333/65536 [2:18:14<9:42:47,  1.52it/s]
 19%|█▉        | 12334/65536 [2:18:14<9:43:11,  1.52it/s]
 19%|█▉        | 12335/65536 [2:18:15<9:40:50,  1.53it/s]
 19%|█▉        | 12336/65536 [2:18:16<9:48:24,  1.51it/s]
 19%|█▉        | 12337/65536 [2:18:16<9:52:11,  1.50it/s]
 19%|█▉        | 12338/65536 [2:18:17<9:49:59,  1.50it/s]
 19%|█▉        | 12339/65536 [2:18:18<9:54:24,  1.49it/s]
 19%|█▉        | 12340/65536 [2:18:18<9:51:57,  1.50it/s]
                                                         
{'loss': 0.9699, 'learning_rate': 8.327721317497245e-07, 'epoch': 761.73}

 19%|█▉        | 12340/65536 [2:18:18<9:51:57,  1.50it/s]
 19%|█▉        | 12341/65536 [2:18:19<9:52:38,  1.50it/s]
 19%|█▉        | 12342/65536 [2:18:20<9:54:36,  1.49it/s]
 19%|█▉        | 12343/65536 [2:18:20<9:47:31,  1.51it/s]
 19%|█▉        | 12344/65536 [2:18:21<9:51:42,  1.50it/s]
 19%|█▉        | 12345/65536 [2:18:22<10:08:45,  1.46it/s]
 19%|█▉        | 12346/65536 [2:18:23<10:11:38,  1.45it/s]
 19%|█▉        | 12347/65536 [2:18:23<10:14:48,  1.44it/s]
 19%|█▉        | 12348/65536 [2:18:24<10:00:44,  1.48it/s]
 19%|█▉        | 12349/65536 [2:18:25<9:55:22,  1.49it/s] 
 19%|█▉        | 12350/65536 [2:18:25<9:54:02,  1.49it/s]
 19%|█▉        | 12351/65536 [2:18:26<9:48:26,  1.51it/s]
 19%|█▉        | 12352/65536 [2:18:27<9:44:23,  1.52it/s]
 19%|█▉        | 12353/65536 [2:18:27<9:42:28,  1.52it/s]
 19%|█▉        | 12354/65536 [2:18:28<9:44:33,  1.52it/s]
 19%|█▉        | 12355/65536 [2:18:29<9:46:13,  1.51it/s]
 19%|█▉        | 12356/65536 [2:18:29<9:46:47,  1.51it/s]
 19%|█▉        | 12357/65536 [2:18:30<9:47:24,  1.51it/s]
 19%|█▉        | 12358/65536 [2:18:31<9:51:32,  1.50it/s]
 19%|█▉        | 12359/65536 [2:18:31<9:41:27,  1.52it/s]
 19%|█▉        | 12360/65536 [2:18:32<10:00:24,  1.48it/s]
                                                          
{'loss': 0.9808, 'learning_rate': 8.324966327904983e-07, 'epoch': 762.96}

 19%|█▉        | 12360/65536 [2:18:32<10:00:24,  1.48it/s]
 19%|█▉        | 12361/65536 [2:18:33<10:28:08,  1.41it/s]
 19%|█▉        | 12362/65536 [2:18:33<10:14:56,  1.44it/s]
 19%|█▉        | 12363/65536 [2:18:34<10:08:54,  1.46it/s]
 19%|█▉        | 12364/65536 [2:18:35<10:07:04,  1.46it/s]
 19%|█▉        | 12365/65536 [2:18:35<10:06:41,  1.46it/s]
 19%|█▉        | 12366/65536 [2:18:36<10:03:34,  1.47it/s]
 19%|█▉        | 12367/65536 [2:18:37<10:03:17,  1.47it/s]
 19%|█▉        | 12368/65536 [2:18:37<9:49:17,  1.50it/s] 
 19%|█▉        | 12369/65536 [2:18:38<9:57:25,  1.48it/s]
 19%|█▉        | 12370/65536 [2:18:39<10:05:13,  1.46it/s]
 19%|█▉        | 12371/65536 [2:18:39<10:03:14,  1.47it/s]
 19%|█▉        | 12372/65536 [2:18:40<9:49:48,  1.50it/s] 
 19%|█▉        | 12373/65536 [2:18:41<10:03:47,  1.47it/s]
 19%|█▉        | 12374/65536 [2:18:41<9:56:55,  1.48it/s] 
 19%|█▉        | 12375/65536 [2:18:42<10:11:54,  1.45it/s]
 19%|█▉        | 12376/65536 [2:18:43<10:08:49,  1.46it/s]
 19%|█▉        | 12377/65536 [2:18:44<10:27:55,  1.41it/s]
 19%|█▉        | 12378/65536 [2:18:44<10:24:35,  1.42it/s]
 19%|█▉        | 12379/65536 [2:18:45<10:20:40,  1.43it/s]
 19%|█▉        | 12380/65536 [2:18:46<10:07:01,  1.46it/s]
                                                          
{'loss': 0.9335, 'learning_rate': 8.322211338312722e-07, 'epoch': 764.2}

 19%|█▉        | 12380/65536 [2:18:46<10:07:01,  1.46it/s]
 19%|█▉        | 12381/65536 [2:18:46<10:10:13,  1.45it/s]
 19%|█▉        | 12382/65536 [2:18:47<10:18:53,  1.43it/s]
 19%|█▉        | 12383/65536 [2:18:48<10:04:21,  1.47it/s]
 19%|█▉        | 12384/65536 [2:18:48<10:15:08,  1.44it/s]
 19%|█▉        | 12385/65536 [2:18:49<10:14:57,  1.44it/s]
 19%|█▉        | 12386/65536 [2:18:50<10:08:34,  1.46it/s]
 19%|█▉        | 12387/65536 [2:18:50<10:14:32,  1.44it/s]
 19%|█▉        | 12388/65536 [2:18:51<9:59:57,  1.48it/s] 
 19%|█▉        | 12389/65536 [2:18:52<9:44:13,  1.52it/s]
 19%|█▉        | 12390/65536 [2:18:52<9:50:28,  1.50it/s]
 19%|█▉        | 12391/65536 [2:18:53<9:43:44,  1.52it/s]
 19%|█▉        | 12392/65536 [2:18:54<9:41:52,  1.52it/s]
 19%|█▉        | 12393/65536 [2:18:54<9:28:37,  1.56it/s]
 19%|█▉        | 12394/65536 [2:18:55<10:02:56,  1.47it/s]
 19%|█▉        | 12395/65536 [2:18:56<10:05:36,  1.46it/s]
 19%|█▉        | 12396/65536 [2:18:57<10:22:09,  1.42it/s]
 19%|█▉        | 12397/65536 [2:18:57<10:18:52,  1.43it/s]
 19%|█▉        | 12398/65536 [2:18:58<10:05:43,  1.46it/s]
 19%|█▉        | 12399/65536 [2:18:58<9:51:22,  1.50it/s] 
 19%|█▉        | 12400/65536 [2:18:59<9:52:19,  1.50it/s]
                                                         
{'loss': 0.9542, 'learning_rate': 8.31945634872046e-07, 'epoch': 765.43}

 19%|█▉        | 12400/65536 [2:18:59<9:52:19,  1.50it/s]
 19%|█▉        | 12401/65536 [2:19:00<9:54:37,  1.49it/s]
 19%|█▉        | 12402/65536 [2:19:01<9:54:52,  1.49it/s]
 19%|█▉        | 12403/65536 [2:19:01<9:40:29,  1.53it/s]
 19%|█▉        | 12404/65536 [2:19:02<9:35:30,  1.54it/s]
 19%|█▉        | 12405/65536 [2:19:02<9:43:52,  1.52it/s]
 19%|█▉        | 12406/65536 [2:19:03<9:48:48,  1.50it/s]
 19%|█▉        | 12407/65536 [2:19:04<9:52:01,  1.50it/s]
 19%|█▉        | 12408/65536 [2:19:04<9:37:59,  1.53it/s]
 19%|█▉        | 12409/65536 [2:19:05<9:44:45,  1.51it/s]
 19%|█▉        | 12410/65536 [2:19:06<10:09:05,  1.45it/s]
 19%|█▉        | 12411/65536 [2:19:07<10:07:51,  1.46it/s]
 19%|█▉        | 12412/65536 [2:19:07<9:55:24,  1.49it/s] 
 19%|█▉        | 12413/65536 [2:19:08<9:52:55,  1.49it/s]
 19%|█▉        | 12414/65536 [2:19:09<9:59:55,  1.48it/s]
 19%|█▉        | 12415/65536 [2:19:09<9:59:55,  1.48it/s]
 19%|█▉        | 12416/65536 [2:19:10<10:02:08,  1.47it/s]
 19%|█▉        | 12417/65536 [2:19:11<10:08:19,  1.46it/s]
 19%|█▉        | 12418/65536 [2:19:11<10:01:57,  1.47it/s]
 19%|█▉        | 12419/65536 [2:19:12<9:40:34,  1.52it/s] 
 19%|█▉        | 12420/65536 [2:19:13<9:41:21,  1.52it/s]
                                                         
{'loss': 0.9657, 'learning_rate': 8.316701359128198e-07, 'epoch': 766.67}

 19%|█▉        | 12420/65536 [2:19:13<9:41:21,  1.52it/s]
 19%|█▉        | 12421/65536 [2:19:13<9:41:37,  1.52it/s]
 19%|█▉        | 12422/65536 [2:19:14<9:35:45,  1.54it/s]
 19%|█▉        | 12423/65536 [2:19:15<9:52:10,  1.49it/s]
 19%|█▉        | 12424/65536 [2:19:15<9:49:46,  1.50it/s]
 19%|█▉        | 12425/65536 [2:19:16<9:51:41,  1.50it/s]
 19%|█▉        | 12426/65536 [2:19:17<10:07:32,  1.46it/s]
 19%|█▉        | 12427/65536 [2:19:17<10:01:28,  1.47it/s]
 19%|█▉        | 12428/65536 [2:19:18<10:14:25,  1.44it/s]
 19%|█▉        | 12429/65536 [2:19:19<9:56:54,  1.48it/s] 
 19%|█▉        | 12430/65536 [2:19:19<9:55:30,  1.49it/s]
 19%|█▉        | 12431/65536 [2:19:20<10:25:45,  1.41it/s]
 19%|█▉        | 12432/65536 [2:19:21<10:13:28,  1.44it/s]
 19%|█▉        | 12433/65536 [2:19:21<10:00:34,  1.47it/s]
 19%|█▉        | 12434/65536 [2:19:22<10:03:35,  1.47it/s]
 19%|█▉        | 12435/65536 [2:19:23<9:56:02,  1.48it/s] 
 19%|█▉        | 12436/65536 [2:19:23<9:51:39,  1.50it/s]
 19%|█▉        | 12437/65536 [2:19:24<9:44:19,  1.51it/s]
 19%|█▉        | 12438/65536 [2:19:25<9:39:31,  1.53it/s]
 19%|█▉        | 12439/65536 [2:19:25<9:57:23,  1.48it/s]
 19%|█▉        | 12440/65536 [2:19:26<9:51:28,  1.50it/s]
                                                         
{'loss': 0.9562, 'learning_rate': 8.313946369535936e-07, 'epoch': 767.9}

 19%|█▉        | 12440/65536 [2:19:26<9:51:28,  1.50it/s]
 19%|█▉        | 12441/65536 [2:19:27<9:48:06,  1.50it/s]
 19%|█▉        | 12442/65536 [2:19:27<10:14:29,  1.44it/s]
 19%|█▉        | 12443/65536 [2:19:28<10:22:27,  1.42it/s]
 19%|█▉        | 12444/65536 [2:19:29<10:28:11,  1.41it/s]
 19%|█▉        | 12445/65536 [2:19:30<10:20:15,  1.43it/s]
 19%|█▉        | 12446/65536 [2:19:30<10:12:27,  1.44it/s]
 19%|█▉        | 12447/65536 [2:19:31<10:11:12,  1.45it/s]
 19%|█▉        | 12448/65536 [2:19:32<9:55:38,  1.49it/s] 
 19%|█▉        | 12449/65536 [2:19:32<9:52:37,  1.49it/s]
 19%|█▉        | 12450/65536 [2:19:33<9:52:13,  1.49it/s]
 19%|█▉        | 12451/65536 [2:19:34<9:47:39,  1.51it/s]
 19%|█▉        | 12452/65536 [2:19:34<9:47:27,  1.51it/s]
 19%|█▉        | 12453/65536 [2:19:35<10:01:34,  1.47it/s]
 19%|█▉        | 12454/65536 [2:19:36<9:50:23,  1.50it/s] 
 19%|█▉        | 12455/65536 [2:19:36<9:42:34,  1.52it/s]
 19%|█▉        | 12456/65536 [2:19:37<9:50:08,  1.50it/s]
 19%|█▉        | 12457/65536 [2:19:38<9:41:30,  1.52it/s]
 19%|█▉        | 12458/65536 [2:19:38<10:00:49,  1.47it/s]
 19%|█▉        | 12459/65536 [2:19:39<10:09:08,  1.45it/s]
 19%|█▉        | 12460/65536 [2:19:40<10:07:52,  1.46it/s]
                                                          
{'loss': 0.9711, 'learning_rate': 8.311191379943675e-07, 'epoch': 769.14}

 19%|█▉        | 12460/65536 [2:19:40<10:07:52,  1.46it/s]
 19%|█▉        | 12461/65536 [2:19:40<10:12:52,  1.44it/s]
 19%|█▉        | 12462/65536 [2:19:41<9:55:43,  1.48it/s] 
 19%|█▉        | 12463/65536 [2:19:42<9:41:29,  1.52it/s]
 19%|█▉        | 12464/65536 [2:19:42<9:51:43,  1.49it/s]
 19%|█▉        | 12465/65536 [2:19:43<10:05:50,  1.46it/s]
 19%|█▉        | 12466/65536 [2:19:44<9:52:23,  1.49it/s] 
 19%|█▉        | 12467/65536 [2:19:44<9:45:52,  1.51it/s]
 19%|█▉        | 12468/65536 [2:19:45<9:32:42,  1.54it/s]
 19%|█▉        | 12469/65536 [2:19:46<9:44:11,  1.51it/s]
 19%|█▉        | 12470/65536 [2:19:46<9:51:51,  1.49it/s]
 19%|█▉        | 12471/65536 [2:19:47<9:55:59,  1.48it/s]
 19%|█▉        | 12472/65536 [2:19:48<9:56:06,  1.48it/s]
 19%|█▉        | 12473/65536 [2:19:48<9:53:28,  1.49it/s]
 19%|█▉        | 12474/65536 [2:19:49<10:09:39,  1.45it/s]
 19%|█▉        | 12475/65536 [2:19:50<10:17:23,  1.43it/s]
 19%|█▉        | 12476/65536 [2:19:50<10:10:10,  1.45it/s]
 19%|█▉        | 12477/65536 [2:19:51<10:06:13,  1.46it/s]
 19%|█▉        | 12478/65536 [2:19:52<9:57:29,  1.48it/s] 
 19%|█▉        | 12479/65536 [2:19:52<9:55:48,  1.48it/s]
 19%|█▉        | 12480/65536 [2:19:53<10:02:45,  1.47it/s]
                                                          
{'loss': 0.9407, 'learning_rate': 8.308436390351413e-07, 'epoch': 770.37}

 19%|█▉        | 12480/65536 [2:19:53<10:02:45,  1.47it/s]
 19%|█▉        | 12481/65536 [2:19:54<9:54:38,  1.49it/s] 
 19%|█▉        | 12482/65536 [2:19:54<10:03:44,  1.46it/s]
 19%|█▉        | 12483/65536 [2:19:55<9:56:25,  1.48it/s] 
 19%|█▉        | 12484/65536 [2:19:56<9:56:37,  1.48it/s]
 19%|█▉        | 12485/65536 [2:19:57<10:10:05,  1.45it/s]
 19%|█▉        | 12486/65536 [2:19:57<10:00:47,  1.47it/s]
 19%|█▉        | 12487/65536 [2:19:58<10:06:10,  1.46it/s]
 19%|█▉        | 12488/65536 [2:19:59<9:56:59,  1.48it/s] 
 19%|█▉        | 12489/65536 [2:19:59<9:58:12,  1.48it/s]
 19%|█▉        | 12490/65536 [2:20:00<9:50:16,  1.50it/s]
 19%|█▉        | 12491/65536 [2:20:01<10:19:10,  1.43it/s]
 19%|█▉        | 12492/65536 [2:20:01<10:11:58,  1.44it/s]
 19%|█▉        | 12493/65536 [2:20:02<10:02:16,  1.47it/s]
 19%|█▉        | 12494/65536 [2:20:03<9:50:22,  1.50it/s] 
 19%|█▉        | 12495/65536 [2:20:03<9:48:37,  1.50it/s]
 19%|█▉        | 12496/65536 [2:20:04<9:42:26,  1.52it/s]
 19%|█▉        | 12497/65536 [2:20:05<9:41:43,  1.52it/s]
 19%|█▉        | 12498/65536 [2:20:05<9:52:58,  1.49it/s]
 19%|█▉        | 12499/65536 [2:20:06<10:05:26,  1.46it/s]
 19%|█▉        | 12500/65536 [2:20:07<9:58:37,  1.48it/s] 
                                                         
{'loss': 0.9533, 'learning_rate': 8.305681400759153e-07, 'epoch': 771.6}

 19%|█▉        | 12500/65536 [2:20:07<9:58:37,  1.48it/s]
 19%|█▉        | 12501/65536 [2:20:07<10:13:18,  1.44it/s]
 19%|█▉        | 12502/65536 [2:20:08<10:11:14,  1.45it/s]
 19%|█▉        | 12503/65536 [2:20:09<9:53:00,  1.49it/s] 
 19%|█▉        | 12504/65536 [2:20:09<9:49:33,  1.50it/s]
 19%|█▉        | 12505/65536 [2:20:10<9:43:26,  1.51it/s]
 19%|█▉        | 12506/65536 [2:20:11<9:43:56,  1.51it/s]
 19%|█▉        | 12507/65536 [2:20:11<10:07:57,  1.45it/s]
 19%|█▉        | 12508/65536 [2:20:12<10:03:42,  1.46it/s]
 19%|█▉        | 12509/65536 [2:20:13<10:20:58,  1.42it/s]
 19%|█▉        | 12510/65536 [2:20:14<10:13:56,  1.44it/s]
 19%|█▉        | 12511/65536 [2:20:14<9:52:37,  1.49it/s] 
 19%|█▉        | 12512/65536 [2:20:15<9:53:35,  1.49it/s]
 19%|█▉        | 12513/65536 [2:20:15<9:58:43,  1.48it/s]
 19%|█▉        | 12514/65536 [2:20:16<9:50:12,  1.50it/s]
 19%|█▉        | 12515/65536 [2:20:17<9:58:04,  1.48it/s]
 19%|█▉        | 12516/65536 [2:20:18<9:59:26,  1.47it/s]
 19%|█▉        | 12517/65536 [2:20:18<9:54:37,  1.49it/s]
 19%|█▉        | 12518/65536 [2:20:19<9:44:31,  1.51it/s]
 19%|█▉        | 12519/65536 [2:20:20<9:53:23,  1.49it/s]
 19%|█▉        | 12520/65536 [2:20:20<9:57:26,  1.48it/s]
                                                         
{'loss': 0.9568, 'learning_rate': 8.302926411166891e-07, 'epoch': 772.84}

 19%|█▉        | 12520/65536 [2:20:20<9:57:26,  1.48it/s]
 19%|█▉        | 12521/65536 [2:20:21<9:52:09,  1.49it/s]
 19%|█▉        | 12522/65536 [2:20:22<9:55:33,  1.48it/s]
 19%|█▉        | 12523/65536 [2:20:22<10:14:28,  1.44it/s]
 19%|█▉        | 12524/65536 [2:20:23<10:05:10,  1.46it/s]
 19%|█▉        | 12525/65536 [2:20:24<10:04:13,  1.46it/s]
 19%|█▉        | 12526/65536 [2:20:24<10:02:50,  1.47it/s]
 19%|█▉        | 12527/65536 [2:20:25<9:59:09,  1.47it/s] 
 19%|█▉        | 12528/65536 [2:20:26<9:53:54,  1.49it/s]
 19%|█▉        | 12529/65536 [2:20:26<10:06:43,  1.46it/s]
 19%|█▉        | 12530/65536 [2:20:27<10:01:23,  1.47it/s]
 19%|█▉        | 12531/65536 [2:20:28<9:51:31,  1.49it/s] 
 19%|█▉        | 12532/65536 [2:20:28<10:02:34,  1.47it/s]
 19%|█▉        | 12533/65536 [2:20:29<10:00:00,  1.47it/s]
 19%|█▉        | 12534/65536 [2:20:30<9:57:39,  1.48it/s] 
 19%|█▉        | 12535/65536 [2:20:30<9:39:41,  1.52it/s]
 19%|█▉        | 12536/65536 [2:20:31<9:52:36,  1.49it/s]
 19%|█▉        | 12537/65536 [2:20:32<9:59:54,  1.47it/s]
 19%|█▉        | 12538/65536 [2:20:32<9:45:47,  1.51it/s]
 19%|█▉        | 12539/65536 [2:20:33<10:06:45,  1.46it/s]
 19%|█▉        | 12540/65536 [2:20:34<10:08:27,  1.45it/s]
                                                          
{'loss': 0.9437, 'learning_rate': 8.300171421574629e-07, 'epoch': 774.07}

 19%|█▉        | 12540/65536 [2:20:34<10:08:27,  1.45it/s]
 19%|█▉        | 12541/65536 [2:20:34<9:56:18,  1.48it/s] 
 19%|█▉        | 12542/65536 [2:20:35<9:58:54,  1.47it/s]
 19%|█▉        | 12543/65536 [2:20:36<9:57:39,  1.48it/s]
 19%|█▉        | 12544/65536 [2:20:36<9:50:38,  1.50it/s]
 19%|█▉        | 12545/65536 [2:20:37<9:45:35,  1.51it/s]
 19%|█▉        | 12546/65536 [2:20:38<9:36:47,  1.53it/s]
 19%|█▉        | 12547/65536 [2:20:38<9:45:46,  1.51it/s]
 19%|█▉        | 12548/65536 [2:20:39<9:49:16,  1.50it/s]
 19%|█▉        | 12549/65536 [2:20:40<10:04:58,  1.46it/s]
 19%|█▉        | 12550/65536 [2:20:40<9:36:58,  1.53it/s] 
 19%|█▉        | 12551/65536 [2:20:41<9:31:15,  1.55it/s]
 19%|█▉        | 12552/65536 [2:20:42<9:29:33,  1.55it/s]
 19%|█▉        | 12553/65536 [2:20:42<9:56:49,  1.48it/s]
 19%|█▉        | 12554/65536 [2:20:43<9:40:21,  1.52it/s]
 19%|█▉        | 12555/65536 [2:20:44<9:53:03,  1.49it/s]
 19%|█▉        | 12556/65536 [2:20:44<10:09:28,  1.45it/s]
 19%|█▉        | 12557/65536 [2:20:45<10:11:30,  1.44it/s]
 19%|█▉        | 12558/65536 [2:20:46<10:05:28,  1.46it/s]
 19%|█▉        | 12559/65536 [2:20:46<9:59:38,  1.47it/s] 
 19%|█▉        | 12560/65536 [2:20:47<10:16:06,  1.43it/s]
                                                          
{'loss': 0.9435, 'learning_rate': 8.297416431982368e-07, 'epoch': 775.31}

 19%|█▉        | 12560/65536 [2:20:47<10:16:06,  1.43it/s]
 19%|█▉        | 12561/65536 [2:20:48<10:20:53,  1.42it/s]
 19%|█▉        | 12562/65536 [2:20:49<10:14:16,  1.44it/s]
 19%|█▉        | 12563/65536 [2:20:49<10:01:10,  1.47it/s]
 19%|█▉        | 12564/65536 [2:20:50<9:49:21,  1.50it/s] 
 19%|█▉        | 12565/65536 [2:20:51<9:42:54,  1.51it/s]
 19%|█▉        | 12566/65536 [2:20:51<9:41:43,  1.52it/s]
 19%|█▉        | 12567/65536 [2:20:52<9:38:14,  1.53it/s]
 19%|█▉        | 12568/65536 [2:20:53<9:39:53,  1.52it/s]
 19%|█▉        | 12569/65536 [2:20:53<9:38:01,  1.53it/s]
 19%|█▉        | 12570/65536 [2:20:54<9:39:29,  1.52it/s]
 19%|█▉        | 12571/65536 [2:20:54<9:39:28,  1.52it/s]
 19%|█▉        | 12572/65536 [2:20:55<10:12:32,  1.44it/s]
 19%|█▉        | 12573/65536 [2:20:56<10:01:55,  1.47it/s]
 19%|█▉        | 12574/65536 [2:20:57<9:42:04,  1.52it/s] 
 19%|█▉        | 12575/65536 [2:20:57<9:57:58,  1.48it/s]
 19%|█▉        | 12576/65536 [2:20:58<9:52:23,  1.49it/s]
 19%|█▉        | 12577/65536 [2:20:59<9:45:49,  1.51it/s]
 19%|█▉        | 12578/65536 [2:20:59<9:41:24,  1.52it/s]
 19%|█▉        | 12579/65536 [2:21:00<9:39:01,  1.52it/s]
 19%|█▉        | 12580/65536 [2:21:00<9:36:40,  1.53it/s]
                                                         
{'loss': 0.9654, 'learning_rate': 8.294661442390106e-07, 'epoch': 776.54}

 19%|█▉        | 12580/65536 [2:21:00<9:36:40,  1.53it/s]
 19%|█▉        | 12581/65536 [2:21:01<9:43:14,  1.51it/s]
 19%|█▉        | 12582/65536 [2:21:02<9:47:31,  1.50it/s]
 19%|█▉        | 12583/65536 [2:21:03<9:52:57,  1.49it/s]
 19%|█▉        | 12584/65536 [2:21:03<9:54:08,  1.49it/s]
 19%|█▉        | 12585/65536 [2:21:04<9:32:10,  1.54it/s]
 19%|█▉        | 12586/65536 [2:21:05<9:59:48,  1.47it/s]
 19%|█▉        | 12587/65536 [2:21:05<9:48:13,  1.50it/s]
 19%|█▉        | 12588/65536 [2:21:06<10:22:41,  1.42it/s]
 19%|█▉        | 12589/65536 [2:21:07<10:08:08,  1.45it/s]
 19%|█▉        | 12590/65536 [2:21:07<10:07:04,  1.45it/s]
 19%|█▉        | 12591/65536 [2:21:08<10:03:06,  1.46it/s]
 19%|█▉        | 12592/65536 [2:21:09<9:50:00,  1.50it/s] 
 19%|█▉        | 12593/65536 [2:21:09<10:06:36,  1.45it/s]
 19%|█▉        | 12594/65536 [2:21:10<9:56:50,  1.48it/s] 
 19%|█▉        | 12595/65536 [2:21:11<9:53:00,  1.49it/s]
 19%|█▉        | 12596/65536 [2:21:11<10:12:58,  1.44it/s]
 19%|█▉        | 12597/65536 [2:21:12<10:13:57,  1.44it/s]
 19%|█▉        | 12598/65536 [2:21:13<10:14:46,  1.44it/s]
 19%|█▉        | 12599/65536 [2:21:14<10:11:30,  1.44it/s]
 19%|█▉        | 12600/65536 [2:21:14<9:57:27,  1.48it/s] 
                                                         
{'loss': 0.9195, 'learning_rate': 8.291906452797846e-07, 'epoch': 777.78}

 19%|█▉        | 12600/65536 [2:21:14<9:57:27,  1.48it/s]
 19%|█▉        | 12601/65536 [2:21:15<9:54:00,  1.49it/s]
 19%|█▉        | 12602/65536 [2:21:15<9:43:46,  1.51it/s]
 19%|█▉        | 12603/65536 [2:21:16<9:26:13,  1.56it/s]
 19%|█▉        | 12604/65536 [2:21:17<9:56:28,  1.48it/s]
 19%|█▉        | 12605/65536 [2:21:17<9:48:16,  1.50it/s]
 19%|█▉        | 12606/65536 [2:21:18<10:07:06,  1.45it/s]
 19%|█▉        | 12607/65536 [2:21:19<10:13:58,  1.44it/s]
 19%|█▉        | 12608/65536 [2:21:20<10:14:16,  1.44it/s]
 19%|█▉        | 12609/65536 [2:21:20<10:14:12,  1.44it/s]
 19%|█▉        | 12610/65536 [2:21:21<9:57:08,  1.48it/s] 
 19%|█▉        | 12611/65536 [2:21:22<9:39:57,  1.52it/s]
 19%|█▉        | 12612/65536 [2:21:22<9:37:58,  1.53it/s]
 19%|█▉        | 12613/65536 [2:21:23<9:29:18,  1.55it/s]
 19%|█▉        | 12614/65536 [2:21:23<9:40:19,  1.52it/s]
 19%|█▉        | 12615/65536 [2:21:24<9:39:39,  1.52it/s]
 19%|█▉        | 12616/65536 [2:21:25<9:42:46,  1.51it/s]
 19%|█▉        | 12617/65536 [2:21:25<9:44:36,  1.51it/s]
 19%|█▉        | 12618/65536 [2:21:26<9:45:16,  1.51it/s]
 19%|█▉        | 12619/65536 [2:21:27<9:47:21,  1.50it/s]
 19%|█▉        | 12620/65536 [2:21:28<10:13:02,  1.44it/s]
                                                          
{'loss': 0.9618, 'learning_rate': 8.289151463205584e-07, 'epoch': 779.01}

 19%|█▉        | 12620/65536 [2:21:28<10:13:02,  1.44it/s]
 19%|█▉        | 12621/65536 [2:21:28<10:19:55,  1.42it/s]
 19%|█▉        | 12622/65536 [2:21:29<10:08:26,  1.45it/s]
 19%|█▉        | 12623/65536 [2:21:30<10:08:03,  1.45it/s]
 19%|█▉        | 12624/65536 [2:21:30<10:03:17,  1.46it/s]
 19%|█▉        | 12625/65536 [2:21:31<9:46:58,  1.50it/s] 
 19%|█▉        | 12626/65536 [2:21:32<9:51:51,  1.49it/s]
 19%|█▉        | 12627/65536 [2:21:32<9:42:17,  1.51it/s]
 19%|█▉        | 12628/65536 [2:21:33<9:48:03,  1.50it/s]
 19%|█▉        | 12629/65536 [2:21:34<9:50:33,  1.49it/s]
 19%|█▉        | 12630/65536 [2:21:34<9:47:59,  1.50it/s]
 19%|█▉        | 12631/65536 [2:21:35<9:40:30,  1.52it/s]
 19%|█▉        | 12632/65536 [2:21:36<9:35:32,  1.53it/s]
 19%|█▉        | 12633/65536 [2:21:36<9:44:30,  1.51it/s]
 19%|█▉        | 12634/65536 [2:21:37<9:38:11,  1.52it/s]
 19%|█▉        | 12635/65536 [2:21:38<10:01:38,  1.47it/s]
 19%|█▉        | 12636/65536 [2:21:38<9:55:39,  1.48it/s] 
 19%|█▉        | 12637/65536 [2:21:39<10:21:48,  1.42it/s]
 19%|█▉        | 12638/65536 [2:21:40<10:19:12,  1.42it/s]
 19%|█▉        | 12639/65536 [2:21:40<10:00:15,  1.47it/s]
 19%|█▉        | 12640/65536 [2:21:41<9:56:18,  1.48it/s] 
                                                         
{'loss': 0.9405, 'learning_rate': 8.286396473613322e-07, 'epoch': 780.25}

 19%|█▉        | 12640/65536 [2:21:41<9:56:18,  1.48it/s]
 19%|█▉        | 12641/65536 [2:21:42<9:48:57,  1.50it/s]
 19%|█▉        | 12642/65536 [2:21:42<9:51:31,  1.49it/s]
 19%|█▉        | 12643/65536 [2:21:43<9:34:09,  1.54it/s]
 19%|█▉        | 12644/65536 [2:21:44<9:27:29,  1.55it/s]
 19%|█▉        | 12645/65536 [2:21:44<9:45:27,  1.51it/s]
 19%|█▉        | 12646/65536 [2:21:45<9:36:39,  1.53it/s]
 19%|█▉        | 12647/65536 [2:21:46<9:38:18,  1.52it/s]
 19%|█▉        | 12648/65536 [2:21:46<9:53:03,  1.49it/s]
 19%|█▉        | 12649/65536 [2:21:47<9:42:51,  1.51it/s]
 19%|█▉        | 12650/65536 [2:21:48<9:50:20,  1.49it/s]
 19%|█▉        | 12651/65536 [2:21:48<9:43:04,  1.51it/s]
 19%|█▉        | 12652/65536 [2:21:49<9:44:03,  1.51it/s]
 19%|█▉        | 12653/65536 [2:21:50<10:13:32,  1.44it/s]
 19%|█▉        | 12654/65536 [2:21:50<9:54:13,  1.48it/s] 
 19%|█▉        | 12655/65536 [2:21:51<10:08:22,  1.45it/s]
 19%|█▉        | 12656/65536 [2:21:52<9:49:45,  1.49it/s] 
 19%|█▉        | 12657/65536 [2:21:52<9:53:54,  1.48it/s]
 19%|█▉        | 12658/65536 [2:21:53<10:17:42,  1.43it/s]
 19%|█▉        | 12659/65536 [2:21:54<10:21:57,  1.42it/s]
 19%|█▉        | 12660/65536 [2:21:55<10:02:44,  1.46it/s]
                                                          
{'loss': 0.9697, 'learning_rate': 8.283641484021061e-07, 'epoch': 781.48}

 19%|█▉        | 12660/65536 [2:21:55<10:02:44,  1.46it/s]
 19%|█▉        | 12661/65536 [2:21:55<9:53:34,  1.48it/s] 
 19%|█▉        | 12662/65536 [2:21:56<9:53:35,  1.48it/s]
 19%|█▉        | 12663/65536 [2:21:56<9:43:11,  1.51it/s]
 19%|█▉        | 12664/65536 [2:21:57<9:37:30,  1.53it/s]
 19%|█▉        | 12665/65536 [2:21:58<9:38:28,  1.52it/s]
 19%|█▉        | 12666/65536 [2:21:58<9:33:31,  1.54it/s]
 19%|█▉        | 12667/65536 [2:21:59<9:37:50,  1.52it/s]
 19%|█▉        | 12668/65536 [2:22:00<9:33:06,  1.54it/s]
 19%|█▉        | 12669/65536 [2:22:00<9:54:49,  1.48it/s]
 19%|█▉        | 12670/65536 [2:22:01<9:44:16,  1.51it/s]
 19%|█▉        | 12671/65536 [2:22:02<9:35:05,  1.53it/s]
 19%|█▉        | 12672/65536 [2:22:02<10:06:53,  1.45it/s]
 19%|█▉        | 12673/65536 [2:22:03<10:05:01,  1.46it/s]
 19%|█▉        | 12674/65536 [2:22:04<10:03:24,  1.46it/s]
 19%|█▉        | 12675/65536 [2:22:04<9:50:19,  1.49it/s] 
 19%|█▉        | 12676/65536 [2:22:05<9:40:12,  1.52it/s]
 19%|█▉        | 12677/65536 [2:22:06<9:38:42,  1.52it/s]
 19%|█▉        | 12678/65536 [2:22:06<9:42:13,  1.51it/s]
 19%|█▉        | 12679/65536 [2:22:07<9:36:27,  1.53it/s]
 19%|█▉        | 12680/65536 [2:22:08<9:41:21,  1.52it/s]
                                                         
{'loss': 0.9623, 'learning_rate': 8.280886494428799e-07, 'epoch': 782.72}

 19%|█▉        | 12680/65536 [2:22:08<9:41:21,  1.52it/s]
 19%|█▉        | 12681/65536 [2:22:08<9:36:49,  1.53it/s]
 19%|█▉        | 12682/65536 [2:22:09<9:38:50,  1.52it/s]
 19%|█▉        | 12683/65536 [2:22:10<9:51:44,  1.49it/s]
 19%|█▉        | 12684/65536 [2:22:10<10:00:31,  1.47it/s]
 19%|█▉        | 12685/65536 [2:22:11<10:14:37,  1.43it/s]
 19%|█▉        | 12686/65536 [2:22:12<10:33:06,  1.39it/s]
 19%|█▉        | 12687/65536 [2:22:13<10:36:15,  1.38it/s]
 19%|█▉        | 12688/65536 [2:22:13<10:30:03,  1.40it/s]
 19%|█▉        | 12689/65536 [2:22:14<10:22:27,  1.42it/s]
 19%|█▉        | 12690/65536 [2:22:15<10:16:27,  1.43it/s]
 19%|█▉        | 12691/65536 [2:22:15<10:10:23,  1.44it/s]
 19%|█▉        | 12692/65536 [2:22:16<9:54:11,  1.48it/s] 
 19%|█▉        | 12693/65536 [2:22:17<9:43:55,  1.51it/s]
 19%|█▉        | 12694/65536 [2:22:17<9:48:11,  1.50it/s]
 19%|█▉        | 12695/65536 [2:22:18<9:50:53,  1.49it/s]
 19%|█▉        | 12696/65536 [2:22:19<9:34:18,  1.53it/s]
 19%|█▉        | 12697/65536 [2:22:19<9:43:20,  1.51it/s]
 19%|█▉        | 12698/65536 [2:22:20<9:36:49,  1.53it/s]
 19%|█▉        | 12699/65536 [2:22:21<9:35:29,  1.53it/s]
 19%|█▉        | 12700/65536 [2:22:21<9:27:02,  1.55it/s]
                                                         
{'loss': 0.9577, 'learning_rate': 8.278131504836536e-07, 'epoch': 783.95}

 19%|█▉        | 12700/65536 [2:22:21<9:27:02,  1.55it/s]
 19%|█▉        | 12701/65536 [2:22:22<10:01:34,  1.46it/s]
 19%|█▉        | 12702/65536 [2:22:23<10:09:12,  1.45it/s]
 19%|█▉        | 12703/65536 [2:22:23<10:05:24,  1.45it/s]
 19%|█▉        | 12704/65536 [2:22:24<10:08:08,  1.45it/s]
 19%|█▉        | 12705/65536 [2:22:25<9:54:39,  1.48it/s] 
 19%|█▉        | 12706/65536 [2:22:25<9:40:17,  1.52it/s]
 19%|█▉        | 12707/65536 [2:22:26<9:36:28,  1.53it/s]
 19%|█▉        | 12708/65536 [2:22:27<9:31:20,  1.54it/s]
 19%|█▉        | 12709/65536 [2:22:27<9:36:06,  1.53it/s]
 19%|█▉        | 12710/65536 [2:22:28<9:36:42,  1.53it/s]
 19%|█▉        | 12711/65536 [2:22:29<9:51:01,  1.49it/s]
 19%|█▉        | 12712/65536 [2:22:29<9:47:34,  1.50it/s]
 19%|█▉        | 12713/65536 [2:22:30<9:50:10,  1.49it/s]
 19%|█▉        | 12714/65536 [2:22:31<9:37:13,  1.53it/s]
 19%|█▉        | 12715/65536 [2:22:31<9:33:32,  1.53it/s]
 19%|█▉        | 12716/65536 [2:22:32<9:37:38,  1.52it/s]
 19%|█▉        | 12717/65536 [2:22:33<9:45:29,  1.50it/s]
 19%|█▉        | 12718/65536 [2:22:33<9:55:19,  1.48it/s]
 19%|█▉        | 12719/65536 [2:22:34<9:49:30,  1.49it/s]
 19%|█▉        | 12720/65536 [2:22:35<9:46:02,  1.50it/s]
                                                         
{'loss': 0.9621, 'learning_rate': 8.275376515244275e-07, 'epoch': 785.19}

 19%|█▉        | 12720/65536 [2:22:35<9:46:02,  1.50it/s]
 19%|█▉        | 12721/65536 [2:22:35<9:45:27,  1.50it/s]
 19%|█▉        | 12722/65536 [2:22:36<9:35:57,  1.53it/s]
 19%|█▉        | 12723/65536 [2:22:37<9:41:11,  1.51it/s]
 19%|█▉        | 12724/65536 [2:22:37<9:47:16,  1.50it/s]
 19%|█▉        | 12725/65536 [2:22:38<9:49:38,  1.49it/s]
 19%|█▉        | 12726/65536 [2:22:39<10:03:58,  1.46it/s]
 19%|█▉        | 12727/65536 [2:22:39<9:48:34,  1.50it/s] 
 19%|█▉        | 12728/65536 [2:22:40<9:54:21,  1.48it/s]
 19%|█▉        | 12729/65536 [2:22:41<10:05:06,  1.45it/s]
 19%|█▉        | 12730/65536 [2:22:41<9:58:26,  1.47it/s] 
 19%|█▉        | 12731/65536 [2:22:42<9:51:55,  1.49it/s]
 19%|█▉        | 12732/65536 [2:22:43<9:29:03,  1.55it/s]
 19%|█▉        | 12733/65536 [2:22:43<9:50:30,  1.49it/s]
 19%|█▉        | 12734/65536 [2:22:44<10:09:52,  1.44it/s]
 19%|█▉        | 12735/65536 [2:22:45<10:04:53,  1.45it/s]
 19%|█▉        | 12736/65536 [2:22:45<10:00:53,  1.46it/s]
 19%|█▉        | 12737/65536 [2:22:46<9:54:21,  1.48it/s] 
 19%|█▉        | 12738/65536 [2:22:47<10:04:00,  1.46it/s]
 19%|█▉        | 12739/65536 [2:22:47<9:51:51,  1.49it/s] 
 19%|█▉        | 12740/65536 [2:22:48<10:02:31,  1.46it/s]
                                                          
{'loss': 0.9475, 'learning_rate': 8.272621525652014e-07, 'epoch': 786.42}

 19%|█▉        | 12740/65536 [2:22:48<10:02:31,  1.46it/s]
 19%|█▉        | 12741/65536 [2:22:49<9:58:33,  1.47it/s] 
 19%|█▉        | 12742/65536 [2:22:49<9:38:23,  1.52it/s]
 19%|█▉        | 12743/65536 [2:22:50<9:31:22,  1.54it/s]
 19%|█▉        | 12744/65536 [2:22:51<9:39:31,  1.52it/s]
 19%|█▉        | 12745/65536 [2:22:52<9:58:26,  1.47it/s]
 19%|█▉        | 12746/65536 [2:22:52<9:51:55,  1.49it/s]
 19%|█▉        | 12747/65536 [2:22:53<9:47:30,  1.50it/s]
 19%|█▉        | 12748/65536 [2:22:53<9:43:53,  1.51it/s]
 19%|█▉        | 12749/65536 [2:22:54<10:08:28,  1.45it/s]
 19%|█▉        | 12750/65536 [2:22:55<10:18:15,  1.42it/s]
 19%|█▉        | 12751/65536 [2:22:56<10:08:02,  1.45it/s]
 19%|█▉        | 12752/65536 [2:22:56<9:55:34,  1.48it/s] 
 19%|█▉        | 12753/65536 [2:22:57<9:51:27,  1.49it/s]
 19%|█▉        | 12754/65536 [2:22:58<9:46:55,  1.50it/s]
 19%|█▉        | 12755/65536 [2:22:58<9:53:08,  1.48it/s]
 19%|█▉        | 12756/65536 [2:22:59<9:36:07,  1.53it/s]
 19%|█▉        | 12757/65536 [2:23:00<9:52:16,  1.49it/s]
 19%|█▉        | 12758/65536 [2:23:00<9:56:36,  1.47it/s]
 19%|█▉        | 12759/65536 [2:23:01<10:12:54,  1.44it/s]
 19%|█▉        | 12760/65536 [2:23:02<10:15:22,  1.43it/s]
                                                          
{'loss': 0.9387, 'learning_rate': 8.269866536059753e-07, 'epoch': 787.65}

 19%|█▉        | 12760/65536 [2:23:02<10:15:22,  1.43it/s]
 19%|█▉        | 12761/65536 [2:23:02<10:02:14,  1.46it/s]
 19%|█▉        | 12762/65536 [2:23:03<9:52:33,  1.48it/s] 
 19%|█▉        | 12763/65536 [2:23:04<9:42:23,  1.51it/s]
 19%|█▉        | 12764/65536 [2:23:04<9:27:47,  1.55it/s]
 19%|█▉        | 12765/65536 [2:23:05<9:30:36,  1.54it/s]
 19%|█▉        | 12766/65536 [2:23:06<9:45:02,  1.50it/s]
 19%|█▉        | 12767/65536 [2:23:06<9:55:19,  1.48it/s]
 19%|█▉        | 12768/65536 [2:23:07<9:41:34,  1.51it/s]
 19%|█▉        | 12769/65536 [2:23:08<9:33:55,  1.53it/s]
 19%|█▉        | 12770/65536 [2:23:08<9:52:19,  1.48it/s]
 19%|█▉        | 12771/65536 [2:23:09<9:35:52,  1.53it/s]
 19%|█▉        | 12772/65536 [2:23:10<9:37:50,  1.52it/s]
 19%|█▉        | 12773/65536 [2:23:10<9:28:14,  1.55it/s]
 19%|█▉        | 12774/65536 [2:23:11<9:33:55,  1.53it/s]
 19%|█▉        | 12775/65536 [2:23:12<9:40:05,  1.52it/s]
 19%|█▉        | 12776/65536 [2:23:12<9:49:50,  1.49it/s]
 19%|█▉        | 12777/65536 [2:23:13<10:05:06,  1.45it/s]
 19%|█▉        | 12778/65536 [2:23:14<10:09:38,  1.44it/s]
 19%|█▉        | 12779/65536 [2:23:14<9:49:48,  1.49it/s] 
 20%|█▉        | 12780/65536 [2:23:15<9:56:21,  1.47it/s]
                                                         
{'loss': 0.9592, 'learning_rate': 8.267111546467491e-07, 'epoch': 788.89}

 20%|█▉        | 12780/65536 [2:23:15<9:56:21,  1.47it/s]
 20%|█▉        | 12781/65536 [2:23:16<9:48:44,  1.49it/s]
 20%|█▉        | 12782/65536 [2:23:16<10:02:25,  1.46it/s]
 20%|█▉        | 12783/65536 [2:23:17<9:58:01,  1.47it/s] 
 20%|█▉        | 12784/65536 [2:23:18<10:07:51,  1.45it/s]
 20%|█▉        | 12785/65536 [2:23:18<10:13:35,  1.43it/s]
 20%|█▉        | 12786/65536 [2:23:19<10:28:06,  1.40it/s]
 20%|█▉        | 12787/65536 [2:23:20<10:20:18,  1.42it/s]
 20%|█▉        | 12788/65536 [2:23:21<10:07:13,  1.45it/s]
 20%|█▉        | 12789/65536 [2:23:21<9:59:14,  1.47it/s] 
 20%|█▉        | 12790/65536 [2:23:22<9:48:28,  1.49it/s]
 20%|█▉        | 12791/65536 [2:23:23<9:45:15,  1.50it/s]
 20%|█▉        | 12792/65536 [2:23:23<9:42:31,  1.51it/s]
 20%|█▉        | 12793/65536 [2:23:24<9:39:10,  1.52it/s]
 20%|█▉        | 12794/65536 [2:23:24<9:36:02,  1.53it/s]
 20%|█▉        | 12795/65536 [2:23:25<9:34:10,  1.53it/s]
 20%|█▉        | 12796/65536 [2:23:26<9:29:33,  1.54it/s]
 20%|█▉        | 12797/65536 [2:23:26<9:33:16,  1.53it/s]
 20%|█▉        | 12798/65536 [2:23:27<9:33:38,  1.53it/s]
 20%|█▉        | 12799/65536 [2:23:28<10:04:50,  1.45it/s]
 20%|█▉        | 12800/65536 [2:23:29<10:00:58,  1.46it/s]
                                                          
{'loss': 0.9456, 'learning_rate': 8.264356556875229e-07, 'epoch': 790.12}

 20%|█▉        | 12800/65536 [2:23:29<10:00:58,  1.46it/s]
 20%|█▉        | 12801/65536 [2:23:29<9:46:10,  1.50it/s] 
 20%|█▉        | 12802/65536 [2:23:30<9:52:24,  1.48it/s]
 20%|█▉        | 12803/65536 [2:23:30<9:45:27,  1.50it/s]
 20%|█▉        | 12804/65536 [2:23:31<9:57:12,  1.47it/s]
 20%|█▉        | 12805/65536 [2:23:32<9:55:53,  1.47it/s]
 20%|█▉        | 12806/65536 [2:23:33<9:43:43,  1.51it/s]
 20%|█▉        | 12807/65536 [2:23:33<9:31:27,  1.54it/s]
 20%|█▉        | 12808/65536 [2:23:34<9:36:20,  1.52it/s]
 20%|█▉        | 12809/65536 [2:23:34<9:38:14,  1.52it/s]
 20%|█▉        | 12810/65536 [2:23:35<9:34:04,  1.53it/s]
 20%|█▉        | 12811/65536 [2:23:36<9:39:40,  1.52it/s]
 20%|█▉        | 12812/65536 [2:23:37<10:01:06,  1.46it/s]
 20%|█▉        | 12813/65536 [2:23:37<9:40:41,  1.51it/s] 
 20%|█▉        | 12814/65536 [2:23:38<9:33:40,  1.53it/s]
 20%|█▉        | 12815/65536 [2:23:39<10:07:13,  1.45it/s]
 20%|█▉        | 12816/65536 [2:23:39<10:04:35,  1.45it/s]
 20%|█▉        | 12817/65536 [2:23:40<9:53:56,  1.48it/s] 
 20%|█▉        | 12818/65536 [2:23:41<9:56:54,  1.47it/s]
 20%|█▉        | 12819/65536 [2:23:41<9:47:31,  1.50it/s]
 20%|█▉        | 12820/65536 [2:23:42<9:36:14,  1.52it/s]
                                                         
{'loss': 0.9641, 'learning_rate': 8.261601567282967e-07, 'epoch': 791.36}

 20%|█▉        | 12820/65536 [2:23:42<9:36:14,  1.52it/s]
 20%|█▉        | 12821/65536 [2:23:42<9:40:31,  1.51it/s]
 20%|█▉        | 12822/65536 [2:23:43<9:58:11,  1.47it/s]
 20%|█▉        | 12823/65536 [2:23:44<9:54:15,  1.48it/s]
 20%|█▉        | 12824/65536 [2:23:45<9:39:47,  1.52it/s]
 20%|█▉        | 12825/65536 [2:23:45<9:48:44,  1.49it/s]
 20%|█▉        | 12826/65536 [2:23:46<9:37:01,  1.52it/s]
 20%|█▉        | 12827/65536 [2:23:47<9:40:45,  1.51it/s]
 20%|█▉        | 12828/65536 [2:23:47<9:53:29,  1.48it/s]
 20%|█▉        | 12829/65536 [2:23:48<10:03:40,  1.46it/s]
 20%|█▉        | 12830/65536 [2:23:49<9:44:30,  1.50it/s] 
 20%|█▉        | 12831/65536 [2:23:49<9:59:04,  1.47it/s]
 20%|█▉        | 12832/65536 [2:23:50<9:55:55,  1.47it/s]
 20%|█▉        | 12833/65536 [2:23:51<10:02:08,  1.46it/s]
 20%|█▉        | 12834/65536 [2:23:51<9:52:25,  1.48it/s] 
 20%|█▉        | 12835/65536 [2:23:52<9:53:43,  1.48it/s]
 20%|█▉        | 12836/65536 [2:23:53<9:35:13,  1.53it/s]
 20%|█▉        | 12837/65536 [2:23:53<9:29:37,  1.54it/s]
 20%|█▉        | 12838/65536 [2:23:54<9:41:56,  1.51it/s]
 20%|█▉        | 12839/65536 [2:23:55<9:43:41,  1.50it/s]
 20%|█▉        | 12840/65536 [2:23:55<9:47:01,  1.50it/s]
                                                         
{'loss': 0.9672, 'learning_rate': 8.258846577690706e-07, 'epoch': 792.59}

 20%|█▉        | 12840/65536 [2:23:55<9:47:01,  1.50it/s]
 20%|█▉        | 12841/65536 [2:23:56<9:44:55,  1.50it/s]
 20%|█▉        | 12842/65536 [2:23:57<9:48:06,  1.49it/s]
 20%|█▉        | 12843/65536 [2:23:57<9:49:12,  1.49it/s]
 20%|█▉        | 12844/65536 [2:23:58<9:57:32,  1.47it/s]
 20%|█▉        | 12845/65536 [2:23:59<10:10:17,  1.44it/s]
 20%|█▉        | 12846/65536 [2:23:59<10:09:13,  1.44it/s]
 20%|█▉        | 12847/65536 [2:24:00<10:15:52,  1.43it/s]
 20%|█▉        | 12848/65536 [2:24:01<10:16:38,  1.42it/s]
 20%|█▉        | 12849/65536 [2:24:02<10:24:50,  1.41it/s]
 20%|█▉        | 12850/65536 [2:24:02<10:31:47,  1.39it/s]
 20%|█▉        | 12851/65536 [2:24:03<10:10:46,  1.44it/s]
 20%|█▉        | 12852/65536 [2:24:04<10:18:35,  1.42it/s]
 20%|█▉        | 12853/65536 [2:24:04<9:59:17,  1.47it/s] 
 20%|█▉        | 12854/65536 [2:24:05<10:05:04,  1.45it/s]
 20%|█▉        | 12855/65536 [2:24:06<9:53:42,  1.48it/s] 
 20%|█▉        | 12856/65536 [2:24:06<9:45:01,  1.50it/s]
 20%|█▉        | 12857/65536 [2:24:07<9:46:43,  1.50it/s]
 20%|█▉        | 12858/65536 [2:24:08<9:44:42,  1.50it/s]
 20%|█▉        | 12859/65536 [2:24:08<9:32:35,  1.53it/s]
 20%|█▉        | 12860/65536 [2:24:09<9:31:19,  1.54it/s]
                                                         
{'loss': 0.9228, 'learning_rate': 8.256091588098445e-07, 'epoch': 793.83}

 20%|█▉        | 12860/65536 [2:24:09<9:31:19,  1.54it/s]
 20%|█▉        | 12861/65536 [2:24:09<9:23:47,  1.56it/s]
 20%|█▉        | 12862/65536 [2:24:10<9:14:12,  1.58it/s]
 20%|█▉        | 12863/65536 [2:24:11<9:34:31,  1.53it/s]
 20%|█▉        | 12864/65536 [2:24:11<9:42:31,  1.51it/s]
 20%|█▉        | 12865/65536 [2:24:12<9:41:26,  1.51it/s]
 20%|█▉        | 12866/65536 [2:24:13<9:46:26,  1.50it/s]
 20%|█▉        | 12867/65536 [2:24:14<10:06:09,  1.45it/s]
 20%|█▉        | 12868/65536 [2:24:14<9:51:28,  1.48it/s] 
 20%|█▉        | 12869/65536 [2:24:15<9:52:26,  1.48it/s]
 20%|█▉        | 12870/65536 [2:24:16<9:49:15,  1.49it/s]
 20%|█▉        | 12871/65536 [2:24:16<10:02:19,  1.46it/s]
 20%|█▉        | 12872/65536 [2:24:17<9:56:43,  1.47it/s] 
 20%|█▉        | 12873/65536 [2:24:18<9:58:37,  1.47it/s]
 20%|█▉        | 12874/65536 [2:24:18<9:38:43,  1.52it/s]
 20%|█▉        | 12875/65536 [2:24:19<9:37:32,  1.52it/s]
 20%|█▉        | 12876/65536 [2:24:20<9:31:36,  1.54it/s]
 20%|█▉        | 12877/65536 [2:24:20<9:37:33,  1.52it/s]
 20%|█▉        | 12878/65536 [2:24:21<9:38:53,  1.52it/s]
 20%|█▉        | 12879/65536 [2:24:21<9:31:37,  1.54it/s]
 20%|█▉        | 12880/65536 [2:24:22<9:56:56,  1.47it/s]
                                                         
{'loss': 0.9616, 'learning_rate': 8.253336598506183e-07, 'epoch': 795.06}

 20%|█▉        | 12880/65536 [2:24:22<9:56:56,  1.47it/s]
 20%|█▉        | 12881/65536 [2:24:23<9:44:17,  1.50it/s]
 20%|█▉        | 12882/65536 [2:24:24<9:48:21,  1.49it/s]
 20%|█▉        | 12883/65536 [2:24:24<9:57:17,  1.47it/s]
 20%|█▉        | 12884/65536 [2:24:25<9:48:01,  1.49it/s]
 20%|█▉        | 12885/65536 [2:24:26<9:59:09,  1.46it/s]
 20%|█▉        | 12886/65536 [2:24:26<9:52:02,  1.48it/s]
 20%|█▉        | 12887/65536 [2:24:27<9:49:59,  1.49it/s]
 20%|█▉        | 12888/65536 [2:24:28<9:46:19,  1.50it/s]
 20%|█▉        | 12889/65536 [2:24:28<9:25:17,  1.55it/s]
 20%|█▉        | 12890/65536 [2:24:29<9:33:55,  1.53it/s]
 20%|█▉        | 12891/65536 [2:24:30<9:57:32,  1.47it/s]
 20%|█▉        | 12892/65536 [2:24:30<9:39:11,  1.51it/s]
 20%|█▉        | 12893/65536 [2:24:31<9:45:08,  1.50it/s]
 20%|█▉        | 12894/65536 [2:24:32<9:44:28,  1.50it/s]
 20%|█▉        | 12895/65536 [2:24:32<9:28:09,  1.54it/s]
 20%|█▉        | 12896/65536 [2:24:33<10:00:43,  1.46it/s]
 20%|█▉        | 12897/65536 [2:24:34<9:52:14,  1.48it/s] 
 20%|█▉        | 12898/65536 [2:24:34<9:40:27,  1.51it/s]
 20%|█▉        | 12899/65536 [2:24:35<9:46:13,  1.50it/s]
 20%|█▉        | 12900/65536 [2:24:36<9:42:20,  1.51it/s]
                                                         
{'loss': 0.9543, 'learning_rate': 8.250581608913922e-07, 'epoch': 796.3}

 20%|█▉        | 12900/65536 [2:24:36<9:42:20,  1.51it/s]
 20%|█▉        | 12901/65536 [2:24:36<9:58:49,  1.46it/s]
 20%|█▉        | 12902/65536 [2:24:37<9:39:43,  1.51it/s]
 20%|█▉        | 12903/65536 [2:24:38<9:47:05,  1.49it/s]
 20%|█▉        | 12904/65536 [2:24:38<10:07:37,  1.44it/s]
 20%|█▉        | 12905/65536 [2:24:39<10:14:24,  1.43it/s]
 20%|█▉        | 12906/65536 [2:24:40<9:58:02,  1.47it/s] 
 20%|█▉        | 12907/65536 [2:24:40<9:48:41,  1.49it/s]
 20%|█▉        | 12908/65536 [2:24:41<9:59:49,  1.46it/s]
 20%|█▉        | 12909/65536 [2:24:42<9:44:22,  1.50it/s]
 20%|█▉        | 12910/65536 [2:24:42<9:39:02,  1.51it/s]
 20%|█▉        | 12911/65536 [2:24:43<9:42:09,  1.51it/s]
 20%|█▉        | 12912/65536 [2:24:44<9:57:01,  1.47it/s]
 20%|█▉        | 12913/65536 [2:24:44<9:42:56,  1.50it/s]
 20%|█▉        | 12914/65536 [2:24:45<9:50:49,  1.48it/s]
 20%|█▉        | 12915/65536 [2:24:46<10:02:34,  1.46it/s]
 20%|█▉        | 12916/65536 [2:24:46<9:50:11,  1.49it/s] 
 20%|█▉        | 12917/65536 [2:24:47<9:46:55,  1.49it/s]
 20%|█▉        | 12918/65536 [2:24:48<9:58:45,  1.46it/s]
 20%|█▉        | 12919/65536 [2:24:48<9:50:08,  1.49it/s]
 20%|█▉        | 12920/65536 [2:24:49<9:36:06,  1.52it/s]
                                                         
{'loss': 0.9506, 'learning_rate': 8.24782661932166e-07, 'epoch': 797.53}

 20%|█▉        | 12920/65536 [2:24:49<9:36:06,  1.52it/s]
 20%|█▉        | 12921/65536 [2:24:50<9:41:27,  1.51it/s]
 20%|█▉        | 12922/65536 [2:24:50<9:36:14,  1.52it/s]
 20%|█▉        | 12923/65536 [2:24:51<9:33:37,  1.53it/s]
 20%|█▉        | 12924/65536 [2:24:52<9:37:03,  1.52it/s]
 20%|█▉        | 12925/65536 [2:24:52<9:38:59,  1.51it/s]
 20%|█▉        | 12926/65536 [2:24:53<9:44:50,  1.50it/s]
 20%|█▉        | 12927/65536 [2:24:54<9:39:38,  1.51it/s]
 20%|█▉        | 12928/65536 [2:24:54<9:47:16,  1.49it/s]
 20%|█▉        | 12929/65536 [2:24:55<9:47:08,  1.49it/s]
 20%|█▉        | 12930/65536 [2:24:56<9:46:46,  1.49it/s]
 20%|█▉        | 12931/65536 [2:24:56<9:50:59,  1.48it/s]
 20%|█▉        | 12932/65536 [2:24:57<9:44:16,  1.50it/s]
 20%|█▉        | 12933/65536 [2:24:58<9:37:28,  1.52it/s]
 20%|█▉        | 12934/65536 [2:24:58<9:37:22,  1.52it/s]
 20%|█▉        | 12935/65536 [2:24:59<9:48:16,  1.49it/s]
 20%|█▉        | 12936/65536 [2:25:00<9:31:53,  1.53it/s]
 20%|█▉        | 12937/65536 [2:25:00<9:23:23,  1.56it/s]
 20%|█▉        | 12938/65536 [2:25:01<9:46:51,  1.49it/s]
 20%|█▉        | 12939/65536 [2:25:02<9:46:56,  1.49it/s]
 20%|█▉        | 12940/65536 [2:25:02<9:53:42,  1.48it/s]
                                                         
{'loss': 0.9698, 'learning_rate': 8.245071629729399e-07, 'epoch': 798.77}

 20%|█▉        | 12940/65536 [2:25:02<9:53:42,  1.48it/s]
 20%|█▉        | 12941/65536 [2:25:03<9:47:59,  1.49it/s]
 20%|█▉        | 12942/65536 [2:25:04<9:43:29,  1.50it/s]
 20%|█▉        | 12943/65536 [2:25:04<9:42:57,  1.50it/s]
 20%|█▉        | 12944/65536 [2:25:05<10:15:17,  1.42it/s]
 20%|█▉        | 12945/65536 [2:25:06<10:02:09,  1.46it/s]
 20%|█▉        | 12946/65536 [2:25:06<9:43:03,  1.50it/s] 
 20%|█▉        | 12947/65536 [2:25:07<9:49:04,  1.49it/s]
 20%|█▉        | 12948/65536 [2:25:08<9:51:29,  1.48it/s]
 20%|█▉        | 12949/65536 [2:25:08<9:48:56,  1.49it/s]
 20%|█▉        | 12950/65536 [2:25:09<9:39:49,  1.51it/s]
 20%|█▉        | 12951/65536 [2:25:10<9:37:41,  1.52it/s]
 20%|█▉        | 12952/65536 [2:25:10<9:47:05,  1.49it/s]
 20%|█▉        | 12953/65536 [2:25:11<9:30:03,  1.54it/s]
 20%|█▉        | 12954/65536 [2:25:12<9:17:03,  1.57it/s]
 20%|█▉        | 12955/65536 [2:25:12<9:34:27,  1.53it/s]
 20%|█▉        | 12956/65536 [2:25:13<9:42:32,  1.50it/s]
 20%|█▉        | 12957/65536 [2:25:14<9:49:42,  1.49it/s]
 20%|█▉        | 12958/65536 [2:25:14<9:49:02,  1.49it/s]
 20%|█▉        | 12959/65536 [2:25:15<9:56:14,  1.47it/s]
 20%|█▉        | 12960/65536 [2:25:16<9:59:51,  1.46it/s]
                                                         
{'loss': 0.9481, 'learning_rate': 8.242316640137136e-07, 'epoch': 800.0}

 20%|█▉        | 12960/65536 [2:25:16<9:59:51,  1.46it/s]
 20%|█▉        | 12961/65536 [2:25:16<10:04:16,  1.45it/s]
 20%|█▉        | 12962/65536 [2:25:17<9:56:03,  1.47it/s] 
 20%|█▉        | 12963/65536 [2:25:18<9:58:50,  1.46it/s]
 20%|█▉        | 12964/65536 [2:25:19<10:06:07,  1.45it/s]
 20%|█▉        | 12965/65536 [2:25:19<10:10:25,  1.44it/s]
 20%|█▉        | 12966/65536 [2:25:20<9:55:06,  1.47it/s] 
 20%|█▉        | 12967/65536 [2:25:21<9:46:54,  1.49it/s]
 20%|█▉        | 12968/65536 [2:25:21<9:35:42,  1.52it/s]
 20%|█▉        | 12969/65536 [2:25:22<9:37:37,  1.52it/s]
 20%|█▉        | 12970/65536 [2:25:22<9:48:16,  1.49it/s]
 20%|█▉        | 12971/65536 [2:25:23<9:42:07,  1.50it/s]
 20%|█▉        | 12972/65536 [2:25:24<9:38:14,  1.52it/s]
 20%|█▉        | 12973/65536 [2:25:24<9:37:59,  1.52it/s]
 20%|█▉        | 12974/65536 [2:25:25<9:49:03,  1.49it/s]
 20%|█▉        | 12975/65536 [2:25:26<9:54:32,  1.47it/s]
 20%|█▉        | 12976/65536 [2:25:26<9:42:49,  1.50it/s]
 20%|█▉        | 12977/65536 [2:25:27<10:17:55,  1.42it/s]
 20%|█▉        | 12978/65536 [2:25:28<10:15:06,  1.42it/s]
 20%|█▉        | 12979/65536 [2:25:29<9:54:54,  1.47it/s] 
 20%|█▉        | 12980/65536 [2:25:29<9:44:59,  1.50it/s]
                                                         
{'loss': 0.9509, 'learning_rate': 8.239561650544875e-07, 'epoch': 801.23}

 20%|█▉        | 12980/65536 [2:25:29<9:44:59,  1.50it/s]
 20%|█▉        | 12981/65536 [2:25:30<9:46:41,  1.49it/s]
 20%|█▉        | 12982/65536 [2:25:31<9:52:01,  1.48it/s]
 20%|█▉        | 12983/65536 [2:25:31<9:55:57,  1.47it/s]
 20%|█▉        | 12984/65536 [2:25:32<9:51:43,  1.48it/s]
 20%|█▉        | 12985/65536 [2:25:33<9:46:44,  1.49it/s]
 20%|█▉        | 12986/65536 [2:25:33<9:36:56,  1.52it/s]
 20%|█▉        | 12987/65536 [2:25:34<9:34:43,  1.52it/s]
 20%|█▉        | 12988/65536 [2:25:35<9:48:07,  1.49it/s]
 20%|█▉        | 12989/65536 [2:25:35<9:48:48,  1.49it/s]
 20%|█▉        | 12990/65536 [2:25:36<9:50:46,  1.48it/s]
 20%|█▉        | 12991/65536 [2:25:37<9:45:13,  1.50it/s]
 20%|█▉        | 12992/65536 [2:25:37<9:29:57,  1.54it/s]
 20%|█▉        | 12993/65536 [2:25:38<10:04:50,  1.45it/s]
 20%|█▉        | 12994/65536 [2:25:39<9:55:51,  1.47it/s] 
 20%|█▉        | 12995/65536 [2:25:39<9:57:55,  1.46it/s]
 20%|█▉        | 12996/65536 [2:25:40<9:53:23,  1.48it/s]
 20%|█▉        | 12997/65536 [2:25:41<9:59:07,  1.46it/s]
 20%|█▉        | 12998/65536 [2:25:41<9:55:48,  1.47it/s]
 20%|█▉        | 12999/65536 [2:25:42<9:53:27,  1.48it/s]
 20%|█▉        | 13000/65536 [2:25:43<9:40:11,  1.51it/s]
                                                         
{'loss': 0.9293, 'learning_rate': 8.236806660952614e-07, 'epoch': 802.47}

 20%|█▉        | 13000/65536 [2:25:43<9:40:11,  1.51it/s]
 20%|█▉        | 13001/65536 [2:25:43<10:03:39,  1.45it/s]
 20%|█▉        | 13002/65536 [2:25:44<9:54:11,  1.47it/s] 
 20%|█▉        | 13003/65536 [2:25:45<9:54:40,  1.47it/s]
 20%|█▉        | 13004/65536 [2:25:45<9:46:41,  1.49it/s]
 20%|█▉        | 13005/65536 [2:25:46<9:36:45,  1.52it/s]
 20%|█▉        | 13006/65536 [2:25:47<9:34:19,  1.52it/s]
 20%|█▉        | 13007/65536 [2:25:47<9:29:55,  1.54it/s]
 20%|█▉        | 13008/65536 [2:25:48<9:35:18,  1.52it/s]
 20%|█▉        | 13009/65536 [2:25:49<9:54:29,  1.47it/s]
 20%|█▉        | 13010/65536 [2:25:49<9:53:58,  1.47it/s]
 20%|█▉        | 13011/65536 [2:25:50<9:52:49,  1.48it/s]
 20%|█▉        | 13012/65536 [2:25:51<9:47:02,  1.49it/s]
 20%|█▉        | 13013/65536 [2:25:51<9:49:01,  1.49it/s]
 20%|█▉        | 13014/65536 [2:25:52<9:38:54,  1.51it/s]
 20%|█▉        | 13015/65536 [2:25:53<9:33:30,  1.53it/s]
 20%|█▉        | 13016/65536 [2:25:53<9:38:56,  1.51it/s]
 20%|█▉        | 13017/65536 [2:25:54<9:57:20,  1.47it/s]
 20%|█▉        | 13018/65536 [2:25:55<10:02:30,  1.45it/s]
 20%|█▉        | 13019/65536 [2:25:55<9:50:52,  1.48it/s] 
 20%|█▉        | 13020/65536 [2:25:56<9:54:08,  1.47it/s]
                                                         
{'loss': 0.9437, 'learning_rate': 8.234051671360352e-07, 'epoch': 803.7}

 20%|█▉        | 13020/65536 [2:25:56<9:54:08,  1.47it/s]
 20%|█▉        | 13021/65536 [2:25:57<9:31:09,  1.53it/s]
 20%|█▉        | 13022/65536 [2:25:57<9:56:52,  1.47it/s]
 20%|█▉        | 13023/65536 [2:25:58<9:49:31,  1.48it/s]
 20%|█▉        | 13024/65536 [2:25:59<9:53:09,  1.48it/s]
 20%|█▉        | 13025/65536 [2:26:00<12:18:47,  1.18it/s]
 20%|█▉        | 13026/65536 [2:26:01<11:26:05,  1.28it/s]
 20%|█▉        | 13027/65536 [2:26:01<10:45:27,  1.36it/s]
 20%|█▉        | 13028/65536 [2:26:02<10:34:17,  1.38it/s]
 20%|█▉        | 13029/65536 [2:26:03<10:12:54,  1.43it/s]
 20%|█▉        | 13030/65536 [2:26:03<10:13:21,  1.43it/s]
 20%|█▉        | 13031/65536 [2:26:04<10:02:55,  1.45it/s]
 20%|█▉        | 13032/65536 [2:26:05<9:47:38,  1.49it/s] 
 20%|█▉        | 13033/65536 [2:26:05<9:52:42,  1.48it/s]
 20%|█▉        | 13034/65536 [2:26:06<9:37:44,  1.51it/s]
 20%|█▉        | 13035/65536 [2:26:07<9:49:41,  1.48it/s]
 20%|█▉        | 13036/65536 [2:26:07<9:41:17,  1.51it/s]
 20%|█▉        | 13037/65536 [2:26:08<9:56:28,  1.47it/s]
 20%|█▉        | 13038/65536 [2:26:09<9:47:47,  1.49it/s]
 20%|█▉        | 13039/65536 [2:26:09<9:51:59,  1.48it/s]
 20%|█▉        | 13040/65536 [2:26:10<9:42:15,  1.50it/s]
                                                         
{'loss': 0.9335, 'learning_rate': 8.231296681768091e-07, 'epoch': 804.94}

 20%|█▉        | 13040/65536 [2:26:10<9:42:15,  1.50it/s]
 20%|█▉        | 13041/65536 [2:26:11<9:55:56,  1.47it/s]
 20%|█▉        | 13042/65536 [2:26:12<10:29:54,  1.39it/s]
 20%|█▉        | 13043/65536 [2:26:12<10:19:01,  1.41it/s]
 20%|█▉        | 13044/65536 [2:26:13<10:05:45,  1.44it/s]
 20%|█▉        | 13045/65536 [2:26:14<10:00:18,  1.46it/s]
 20%|█▉        | 13046/65536 [2:26:14<10:00:13,  1.46it/s]
 20%|█▉        | 13047/65536 [2:26:15<10:06:25,  1.44it/s]
 20%|█▉        | 13048/65536 [2:26:16<9:45:35,  1.49it/s] 
 20%|█▉        | 13049/65536 [2:26:16<9:44:39,  1.50it/s]
 20%|█▉        | 13050/65536 [2:26:17<9:42:51,  1.50it/s]
 20%|█▉        | 13051/65536 [2:26:18<9:41:04,  1.51it/s]
 20%|█▉        | 13052/65536 [2:26:18<9:46:55,  1.49it/s]
 20%|█▉        | 13053/65536 [2:26:19<9:42:56,  1.50it/s]
 20%|█▉        | 13054/65536 [2:26:20<9:35:55,  1.52it/s]
 20%|█▉        | 13055/65536 [2:26:20<9:36:25,  1.52it/s]
 20%|█▉        | 13056/65536 [2:26:21<9:41:13,  1.50it/s]
 20%|█▉        | 13057/65536 [2:26:22<9:43:43,  1.50it/s]
 20%|█▉        | 13058/65536 [2:26:22<10:07:37,  1.44it/s]
 20%|█▉        | 13059/65536 [2:26:23<10:21:47,  1.41it/s]
 20%|█▉        | 13060/65536 [2:26:24<10:13:43,  1.43it/s]
                                                          
{'loss': 0.9264, 'learning_rate': 8.228541692175829e-07, 'epoch': 806.17}

 20%|█▉        | 13060/65536 [2:26:24<10:13:43,  1.43it/s]
 20%|█▉        | 13061/65536 [2:26:24<10:05:47,  1.44it/s]
 20%|█▉        | 13062/65536 [2:26:25<10:08:13,  1.44it/s]
 20%|█▉        | 13063/65536 [2:26:26<10:00:17,  1.46it/s]
 20%|█▉        | 13064/65536 [2:26:26<9:49:56,  1.48it/s] 
 20%|█▉        | 13065/65536 [2:26:27<9:44:11,  1.50it/s]
 20%|█▉        | 13066/65536 [2:26:28<9:45:34,  1.49it/s]
 20%|█▉        | 13067/65536 [2:26:28<9:45:09,  1.49it/s]
 20%|█▉        | 13068/65536 [2:26:29<9:40:23,  1.51it/s]
 20%|█▉        | 13069/65536 [2:26:30<9:36:52,  1.52it/s]
 20%|█▉        | 13070/65536 [2:26:30<9:48:35,  1.49it/s]
 20%|█▉        | 13071/65536 [2:26:31<9:39:41,  1.51it/s]
 20%|█▉        | 13072/65536 [2:26:32<9:48:23,  1.49it/s]
 20%|█▉        | 13073/65536 [2:26:32<9:39:16,  1.51it/s]
 20%|█▉        | 13074/65536 [2:26:33<9:56:48,  1.47it/s]
 20%|█▉        | 13075/65536 [2:26:34<10:00:38,  1.46it/s]
 20%|█▉        | 13076/65536 [2:26:35<10:00:35,  1.46it/s]
 20%|█▉        | 13077/65536 [2:26:35<9:55:24,  1.47it/s] 
 20%|█▉        | 13078/65536 [2:26:36<9:49:56,  1.48it/s]
 20%|█▉        | 13079/65536 [2:26:37<9:55:30,  1.47it/s]
 20%|█▉        | 13080/65536 [2:26:37<9:56:37,  1.47it/s]
                                                         
{'loss': 0.9638, 'learning_rate': 8.225786702583567e-07, 'epoch': 807.41}

 20%|█▉        | 13080/65536 [2:26:37<9:56:37,  1.47it/s]
 20%|█▉        | 13081/65536 [2:26:38<10:03:15,  1.45it/s]
 20%|█▉        | 13082/65536 [2:26:39<9:57:24,  1.46it/s] 
 20%|█▉        | 13083/65536 [2:26:39<9:44:14,  1.50it/s]
 20%|█▉        | 13084/65536 [2:26:40<9:56:45,  1.46it/s]
 20%|█▉        | 13085/65536 [2:26:41<9:31:26,  1.53it/s]
 20%|█▉        | 13086/65536 [2:26:41<9:23:47,  1.55it/s]
 20%|█▉        | 13087/65536 [2:26:42<9:39:53,  1.51it/s]
 20%|█▉        | 13088/65536 [2:26:43<9:41:43,  1.50it/s]
 20%|█▉        | 13089/65536 [2:26:43<9:38:52,  1.51it/s]
 20%|█▉        | 13090/65536 [2:26:44<10:00:28,  1.46it/s]
 20%|█▉        | 13091/65536 [2:26:45<10:14:26,  1.42it/s]
 20%|█▉        | 13092/65536 [2:26:45<10:12:40,  1.43it/s]
 20%|█▉        | 13093/65536 [2:26:46<9:57:44,  1.46it/s] 
 20%|█▉        | 13094/65536 [2:26:47<9:39:20,  1.51it/s]
 20%|█▉        | 13095/65536 [2:26:47<9:49:11,  1.48it/s]
 20%|█▉        | 13096/65536 [2:26:48<9:40:01,  1.51it/s]
 20%|█▉        | 13097/65536 [2:26:49<9:58:50,  1.46it/s]
 20%|█▉        | 13098/65536 [2:26:49<9:50:11,  1.48it/s]
 20%|█▉        | 13099/65536 [2:26:50<9:39:51,  1.51it/s]
 20%|█▉        | 13100/65536 [2:26:51<9:18:38,  1.56it/s]
                                                         
{'loss': 0.9496, 'learning_rate': 8.223031712991305e-07, 'epoch': 808.64}

 20%|█▉        | 13100/65536 [2:26:51<9:18:38,  1.56it/s]
 20%|█▉        | 13101/65536 [2:26:51<9:19:06,  1.56it/s]
 20%|█▉        | 13102/65536 [2:26:52<9:31:23,  1.53it/s]
 20%|█▉        | 13103/65536 [2:26:53<9:37:29,  1.51it/s]
 20%|█▉        | 13104/65536 [2:26:53<9:48:40,  1.48it/s]
 20%|█▉        | 13105/65536 [2:26:54<9:46:56,  1.49it/s]
 20%|█▉        | 13106/65536 [2:26:55<10:17:06,  1.42it/s]
 20%|█▉        | 13107/65536 [2:26:55<10:07:09,  1.44it/s]
 20%|██        | 13108/65536 [2:26:56<10:11:45,  1.43it/s]
 20%|██        | 13109/65536 [2:26:57<10:10:00,  1.43it/s]
 20%|██        | 13110/65536 [2:26:58<10:09:50,  1.43it/s]
 20%|██        | 13111/65536 [2:26:58<10:09:55,  1.43it/s]
 20%|██        | 13112/65536 [2:26:59<9:52:34,  1.47it/s] 
 20%|██        | 13113/65536 [2:27:00<10:03:20,  1.45it/s]
 20%|██        | 13114/65536 [2:27:00<9:55:47,  1.47it/s] 
 20%|██        | 13115/65536 [2:27:01<9:53:35,  1.47it/s]
 20%|██        | 13116/65536 [2:27:02<10:04:30,  1.45it/s]
 20%|██        | 13117/65536 [2:27:02<9:45:46,  1.49it/s] 
 20%|██        | 13118/65536 [2:27:03<9:47:14,  1.49it/s]
 20%|██        | 13119/65536 [2:27:04<9:49:13,  1.48it/s]
 20%|██        | 13120/65536 [2:27:04<9:27:49,  1.54it/s]
                                                         
{'loss': 0.9495, 'learning_rate': 8.220276723399044e-07, 'epoch': 809.88}

 20%|██        | 13120/65536 [2:27:04<9:27:49,  1.54it/s]
 20%|██        | 13121/65536 [2:27:05<9:31:20,  1.53it/s]
 20%|██        | 13122/65536 [2:27:06<9:32:28,  1.53it/s]
 20%|██        | 13123/65536 [2:27:06<10:12:43,  1.43it/s]
 20%|██        | 13124/65536 [2:27:07<10:13:33,  1.42it/s]
 20%|██        | 13125/65536 [2:27:08<10:01:52,  1.45it/s]
 20%|██        | 13126/65536 [2:27:08<9:56:09,  1.47it/s] 
 20%|██        | 13127/65536 [2:27:09<9:50:10,  1.48it/s]
 20%|██        | 13128/65536 [2:27:10<9:50:02,  1.48it/s]
 20%|██        | 13129/65536 [2:27:10<9:45:14,  1.49it/s]
 20%|██        | 13130/65536 [2:27:11<9:29:20,  1.53it/s]
 20%|██        | 13131/65536 [2:27:12<9:33:35,  1.52it/s]
 20%|██        | 13132/65536 [2:27:12<9:51:07,  1.48it/s]
 20%|██        | 13133/65536 [2:27:13<9:48:59,  1.48it/s]
 20%|██        | 13134/65536 [2:27:14<9:40:21,  1.50it/s]
 20%|██        | 13135/65536 [2:27:14<9:38:27,  1.51it/s]
 20%|██        | 13136/65536 [2:27:15<9:58:46,  1.46it/s]
 20%|██        | 13137/65536 [2:27:16<9:54:33,  1.47it/s]
 20%|██        | 13138/65536 [2:27:16<9:41:29,  1.50it/s]
 20%|██        | 13139/65536 [2:27:17<10:05:49,  1.44it/s]
 20%|██        | 13140/65536 [2:27:18<9:53:58,  1.47it/s] 
                                                         
{'loss': 0.9515, 'learning_rate': 8.217521733806783e-07, 'epoch': 811.11}

 20%|██        | 13140/65536 [2:27:18<9:53:58,  1.47it/s]
 20%|██        | 13141/65536 [2:27:18<9:48:12,  1.48it/s]
 20%|██        | 13142/65536 [2:27:19<9:37:27,  1.51it/s]
 20%|██        | 13143/65536 [2:27:20<9:43:37,  1.50it/s]
 20%|██        | 13144/65536 [2:27:20<9:45:31,  1.49it/s]
 20%|██        | 13145/65536 [2:27:21<10:00:51,  1.45it/s]
 20%|██        | 13146/65536 [2:27:22<9:46:18,  1.49it/s] 
 20%|██        | 13147/65536 [2:27:22<9:41:26,  1.50it/s]
 20%|██        | 13148/65536 [2:27:23<9:48:55,  1.48it/s]
 20%|██        | 13149/65536 [2:27:24<9:48:02,  1.48it/s]
 20%|██        | 13150/65536 [2:27:24<9:46:45,  1.49it/s]
 20%|██        | 13151/65536 [2:27:25<9:55:48,  1.47it/s]
 20%|██        | 13152/65536 [2:27:26<9:50:40,  1.48it/s]
 20%|██        | 13153/65536 [2:27:26<9:45:25,  1.49it/s]
 20%|██        | 13154/65536 [2:27:27<9:48:38,  1.48it/s]
 20%|██        | 13155/65536 [2:27:28<10:14:07,  1.42it/s]
 20%|██        | 13156/65536 [2:27:29<9:56:34,  1.46it/s] 
 20%|██        | 13157/65536 [2:27:29<9:48:52,  1.48it/s]
 20%|██        | 13158/65536 [2:27:30<9:52:03,  1.47it/s]
 20%|██        | 13159/65536 [2:27:31<9:52:34,  1.47it/s]
 20%|██        | 13160/65536 [2:27:31<9:51:00,  1.48it/s]
                                                         
{'loss': 0.9567, 'learning_rate': 8.214766744214521e-07, 'epoch': 812.35}

 20%|██        | 13160/65536 [2:27:31<9:51:00,  1.48it/s]
 20%|██        | 13161/65536 [2:27:32<9:52:52,  1.47it/s]
 20%|██        | 13162/65536 [2:27:33<9:45:16,  1.49it/s]
 20%|██        | 13163/65536 [2:27:33<9:32:10,  1.53it/s]
 20%|██        | 13164/65536 [2:27:34<9:32:53,  1.52it/s]
 20%|██        | 13165/65536 [2:27:35<9:42:21,  1.50it/s]
 20%|██        | 13166/65536 [2:27:35<9:43:14,  1.50it/s]
 20%|██        | 13167/65536 [2:27:36<9:45:42,  1.49it/s]
 20%|██        | 13168/65536 [2:27:37<9:39:48,  1.51it/s]
 20%|██        | 13169/65536 [2:27:37<9:37:43,  1.51it/s]
 20%|██        | 13170/65536 [2:27:38<9:56:43,  1.46it/s]
 20%|██        | 13171/65536 [2:27:39<10:22:11,  1.40it/s]
 20%|██        | 13172/65536 [2:27:39<10:01:49,  1.45it/s]
 20%|██        | 13173/65536 [2:27:40<9:50:45,  1.48it/s] 
 20%|██        | 13174/65536 [2:27:41<10:01:18,  1.45it/s]
 20%|██        | 13175/65536 [2:27:41<9:49:52,  1.48it/s] 
 20%|██        | 13176/65536 [2:27:42<10:07:46,  1.44it/s]
 20%|██        | 13177/65536 [2:27:43<10:03:09,  1.45it/s]
 20%|██        | 13178/65536 [2:27:43<9:57:25,  1.46it/s] 
 20%|██        | 13179/65536 [2:27:44<9:48:01,  1.48it/s]
 20%|██        | 13180/65536 [2:27:45<9:55:57,  1.46it/s]
                                                         
{'loss': 0.9276, 'learning_rate': 8.21201175462226e-07, 'epoch': 813.58}

 20%|██        | 13180/65536 [2:27:45<9:55:57,  1.46it/s]
 20%|██        | 13181/65536 [2:27:46<9:52:36,  1.47it/s]
 20%|██        | 13182/65536 [2:27:46<10:00:12,  1.45it/s]
 20%|██        | 13183/65536 [2:27:47<9:54:28,  1.47it/s] 
 20%|██        | 13184/65536 [2:27:48<10:11:17,  1.43it/s]
 20%|██        | 13185/65536 [2:27:48<9:58:20,  1.46it/s] 
 20%|██        | 13186/65536 [2:27:49<9:40:46,  1.50it/s]
 20%|██        | 13187/65536 [2:27:50<10:08:55,  1.43it/s]
 20%|██        | 13188/65536 [2:27:50<9:59:47,  1.45it/s] 
 20%|██        | 13189/65536 [2:27:51<9:56:44,  1.46it/s]
 20%|██        | 13190/65536 [2:27:52<9:50:34,  1.48it/s]
 20%|██        | 13191/65536 [2:27:52<9:46:02,  1.49it/s]
 20%|██        | 13192/65536 [2:27:53<9:56:05,  1.46it/s]
 20%|██        | 13193/65536 [2:27:54<9:58:18,  1.46it/s]
 20%|██        | 13194/65536 [2:27:54<9:52:52,  1.47it/s]
 20%|██        | 13195/65536 [2:27:55<9:49:42,  1.48it/s]
 20%|██        | 13196/65536 [2:27:56<10:17:33,  1.41it/s]
 20%|██        | 13197/65536 [2:27:56<10:01:11,  1.45it/s]
 20%|██        | 13198/65536 [2:27:57<10:18:28,  1.41it/s]
 20%|██        | 13199/65536 [2:27:58<10:01:04,  1.45it/s]
 20%|██        | 13200/65536 [2:27:58<9:40:27,  1.50it/s] 
                                                         
{'loss': 0.9272, 'learning_rate': 8.209256765029998e-07, 'epoch': 814.81}

 20%|██        | 13200/65536 [2:27:58<9:40:27,  1.50it/s]
 20%|██        | 13201/65536 [2:27:59<9:38:57,  1.51it/s]
 20%|██        | 13202/65536 [2:28:00<9:42:01,  1.50it/s]
 20%|██        | 13203/65536 [2:28:00<9:33:03,  1.52it/s]
 20%|██        | 13204/65536 [2:28:01<10:01:57,  1.45it/s]
 20%|██        | 13205/65536 [2:28:02<9:49:22,  1.48it/s] 
 20%|██        | 13206/65536 [2:28:03<10:04:55,  1.44it/s]
 20%|██        | 13207/65536 [2:28:03<9:48:37,  1.48it/s] 
 20%|██        | 13208/65536 [2:28:04<9:43:51,  1.49it/s]
 20%|██        | 13209/65536 [2:28:05<9:43:04,  1.50it/s]
 20%|██        | 13210/65536 [2:28:05<9:39:35,  1.50it/s]
 20%|██        | 13211/65536 [2:28:06<9:34:47,  1.52it/s]
 20%|██        | 13212/65536 [2:28:06<9:29:03,  1.53it/s]
 20%|██        | 13213/65536 [2:28:07<9:38:27,  1.51it/s]
 20%|██        | 13214/65536 [2:28:08<9:33:19,  1.52it/s]
 20%|██        | 13215/65536 [2:28:08<9:25:38,  1.54it/s]
 20%|██        | 13216/65536 [2:28:09<9:37:33,  1.51it/s]
 20%|██        | 13217/65536 [2:28:10<9:43:22,  1.49it/s]
 20%|██        | 13218/65536 [2:28:11<9:52:15,  1.47it/s]
 20%|██        | 13219/65536 [2:28:11<10:02:02,  1.45it/s]
 20%|██        | 13220/65536 [2:28:12<10:23:48,  1.40it/s]
                                                          
{'loss': 0.9498, 'learning_rate': 8.206501775437737e-07, 'epoch': 816.05}

 20%|██        | 13220/65536 [2:28:12<10:23:48,  1.40it/s]
 20%|██        | 13221/65536 [2:28:13<10:02:40,  1.45it/s]
 20%|██        | 13222/65536 [2:28:13<10:02:22,  1.45it/s]
 20%|██        | 13223/65536 [2:28:14<10:07:59,  1.43it/s]
 20%|██        | 13224/65536 [2:28:15<9:49:12,  1.48it/s] 
 20%|██        | 13225/65536 [2:28:15<9:45:33,  1.49it/s]
 20%|██        | 13226/65536 [2:28:16<9:45:53,  1.49it/s]
 20%|██        | 13227/65536 [2:28:17<9:44:36,  1.49it/s]
 20%|██        | 13228/65536 [2:28:17<9:45:14,  1.49it/s]
 20%|██        | 13229/65536 [2:28:18<9:50:44,  1.48it/s]
 20%|██        | 13230/65536 [2:28:19<9:53:04,  1.47it/s]
 20%|██        | 13231/65536 [2:28:19<9:42:50,  1.50it/s]
 20%|██        | 13232/65536 [2:28:20<9:36:04,  1.51it/s]
 20%|██        | 13233/65536 [2:28:21<9:30:36,  1.53it/s]
 20%|██        | 13234/65536 [2:28:21<9:50:35,  1.48it/s]
 20%|██        | 13235/65536 [2:28:22<9:35:58,  1.51it/s]
 20%|██        | 13236/65536 [2:28:23<10:02:30,  1.45it/s]
 20%|██        | 13237/65536 [2:28:23<10:06:36,  1.44it/s]
 20%|██        | 13238/65536 [2:28:24<10:01:20,  1.45it/s]
 20%|██        | 13239/65536 [2:28:25<9:46:17,  1.49it/s] 
 20%|██        | 13240/65536 [2:28:26<9:54:44,  1.47it/s]
                                                         
{'loss': 0.9256, 'learning_rate': 8.203746785845476e-07, 'epoch': 817.28}

 20%|██        | 13240/65536 [2:28:26<9:54:44,  1.47it/s]
 20%|██        | 13241/65536 [2:28:26<10:08:16,  1.43it/s]
 20%|██        | 13242/65536 [2:28:27<9:51:25,  1.47it/s] 
 20%|██        | 13243/65536 [2:28:28<9:57:29,  1.46it/s]
 20%|██        | 13244/65536 [2:28:28<9:46:38,  1.49it/s]
 20%|██        | 13245/65536 [2:28:29<9:47:15,  1.48it/s]
 20%|██        | 13246/65536 [2:28:30<9:44:08,  1.49it/s]
 20%|██        | 13247/65536 [2:28:30<9:40:02,  1.50it/s]
 20%|██        | 13248/65536 [2:28:31<9:46:56,  1.48it/s]
 20%|██        | 13249/65536 [2:28:32<9:48:03,  1.48it/s]
 20%|██        | 13250/65536 [2:28:32<9:37:18,  1.51it/s]
 20%|██        | 13251/65536 [2:28:33<9:31:57,  1.52it/s]
 20%|██        | 13252/65536 [2:28:34<10:05:05,  1.44it/s]
 20%|██        | 13253/65536 [2:28:34<9:37:23,  1.51it/s] 
 20%|██        | 13254/65536 [2:28:35<9:45:32,  1.49it/s]
 20%|██        | 13255/65536 [2:28:36<9:45:58,  1.49it/s]
 20%|██        | 13256/65536 [2:28:36<10:10:40,  1.43it/s]
 20%|██        | 13257/65536 [2:28:37<9:52:05,  1.47it/s] 
 20%|██        | 13258/65536 [2:28:38<9:47:59,  1.48it/s]
 20%|██        | 13259/65536 [2:28:38<9:41:00,  1.50it/s]
 20%|██        | 13260/65536 [2:28:39<9:52:28,  1.47it/s]
                                                         
{'loss': 0.9521, 'learning_rate': 8.200991796253214e-07, 'epoch': 818.52}

 20%|██        | 13260/65536 [2:28:39<9:52:28,  1.47it/s]
 20%|██        | 13261/65536 [2:28:40<9:46:40,  1.49it/s]
 20%|██        | 13262/65536 [2:28:40<9:42:47,  1.49it/s]
 20%|██        | 13263/65536 [2:28:41<9:41:16,  1.50it/s]
 20%|██        | 13264/65536 [2:28:42<9:51:20,  1.47it/s]
 20%|██        | 13265/65536 [2:28:42<9:53:12,  1.47it/s]
 20%|██        | 13266/65536 [2:28:43<9:48:43,  1.48it/s]
 20%|██        | 13267/65536 [2:28:44<9:49:12,  1.48it/s]
 20%|██        | 13268/65536 [2:28:44<10:01:45,  1.45it/s]
 20%|██        | 13269/65536 [2:28:45<9:49:23,  1.48it/s] 
 20%|██        | 13270/65536 [2:28:46<9:43:56,  1.49it/s]
 20%|██        | 13271/65536 [2:28:46<9:50:25,  1.48it/s]
 20%|██        | 13272/65536 [2:28:47<9:52:59,  1.47it/s]
 20%|██        | 13273/65536 [2:28:48<9:42:57,  1.49it/s]
 20%|██        | 13274/65536 [2:28:48<9:33:27,  1.52it/s]
 20%|██        | 13275/65536 [2:28:49<9:48:52,  1.48it/s]
 20%|██        | 13276/65536 [2:28:50<9:54:33,  1.46it/s]
 20%|██        | 13277/65536 [2:28:50<9:50:47,  1.47it/s]
 20%|██        | 13278/65536 [2:28:51<9:40:04,  1.50it/s]
 20%|██        | 13279/65536 [2:28:52<9:38:22,  1.51it/s]
 20%|██        | 13280/65536 [2:28:52<9:47:12,  1.48it/s]
                                                         
{'loss': 0.9417, 'learning_rate': 8.198236806660953e-07, 'epoch': 819.75}

 20%|██        | 13280/65536 [2:28:52<9:47:12,  1.48it/s]
 20%|██        | 13281/65536 [2:28:53<9:43:54,  1.49it/s]
 20%|██        | 13282/65536 [2:28:54<9:45:36,  1.49it/s]
 20%|██        | 13283/65536 [2:28:54<9:33:08,  1.52it/s]
 20%|██        | 13284/65536 [2:28:55<9:42:03,  1.50it/s]
 20%|██        | 13285/65536 [2:28:56<10:06:25,  1.44it/s]
 20%|██        | 13286/65536 [2:28:57<9:59:43,  1.45it/s] 
 20%|██        | 13287/65536 [2:28:57<9:44:28,  1.49it/s]
 20%|██        | 13288/65536 [2:28:58<9:33:33,  1.52it/s]
 20%|██        | 13289/65536 [2:28:59<9:54:57,  1.46it/s]
 20%|██        | 13290/65536 [2:28:59<9:55:44,  1.46it/s]
 20%|██        | 13291/65536 [2:29:00<9:47:39,  1.48it/s]
 20%|██        | 13292/65536 [2:29:01<9:53:21,  1.47it/s]
 20%|██        | 13293/65536 [2:29:01<9:44:16,  1.49it/s]
 20%|██        | 13294/65536 [2:29:02<9:35:43,  1.51it/s]
 20%|██        | 13295/65536 [2:29:03<9:49:01,  1.48it/s]
 20%|██        | 13296/65536 [2:29:03<9:50:28,  1.47it/s]
 20%|██        | 13297/65536 [2:29:04<9:47:13,  1.48it/s]
 20%|██        | 13298/65536 [2:29:05<9:41:57,  1.50it/s]
 20%|██        | 13299/65536 [2:29:05<9:38:53,  1.50it/s]
 20%|██        | 13300/65536 [2:29:06<9:38:25,  1.51it/s]
                                                         
{'loss': 0.9479, 'learning_rate': 8.195481817068691e-07, 'epoch': 820.99}

 20%|██        | 13300/65536 [2:29:06<9:38:25,  1.51it/s]
 20%|██        | 13301/65536 [2:29:07<10:11:57,  1.42it/s]
 20%|██        | 13302/65536 [2:29:07<9:55:14,  1.46it/s] 
 20%|██        | 13303/65536 [2:29:08<9:54:33,  1.46it/s]
 20%|██        | 13304/65536 [2:29:09<9:53:39,  1.47it/s]
 20%|██        | 13305/65536 [2:29:09<10:02:12,  1.45it/s]
 20%|██        | 13306/65536 [2:29:10<9:55:09,  1.46it/s] 
 20%|██        | 13307/65536 [2:29:11<9:56:35,  1.46it/s]
 20%|██        | 13308/65536 [2:29:12<10:05:20,  1.44it/s]
 20%|██        | 13309/65536 [2:29:12<9:52:04,  1.47it/s] 
 20%|██        | 13310/65536 [2:29:13<9:33:30,  1.52it/s]
 20%|██        | 13311/65536 [2:29:14<9:52:09,  1.47it/s]
 20%|██        | 13312/65536 [2:29:14<9:52:38,  1.47it/s]
 20%|██        | 13313/65536 [2:29:15<9:42:49,  1.49it/s]
 20%|██        | 13314/65536 [2:29:16<9:47:42,  1.48it/s]
 20%|██        | 13315/65536 [2:29:16<9:42:23,  1.49it/s]
 20%|██        | 13316/65536 [2:29:17<9:38:13,  1.51it/s]
 20%|██        | 13317/65536 [2:29:18<10:12:15,  1.42it/s]
 20%|██        | 13318/65536 [2:29:18<10:07:58,  1.43it/s]
 20%|██        | 13319/65536 [2:29:19<9:58:48,  1.45it/s] 
 20%|██        | 13320/65536 [2:29:20<9:52:14,  1.47it/s]
                                                         
{'loss': 0.9377, 'learning_rate': 8.19272682747643e-07, 'epoch': 822.22}

 20%|██        | 13320/65536 [2:29:20<9:52:14,  1.47it/s]
 20%|██        | 13321/65536 [2:29:20<9:37:08,  1.51it/s]
 20%|██        | 13322/65536 [2:29:21<9:46:43,  1.48it/s]
 20%|██        | 13323/65536 [2:29:22<9:43:41,  1.49it/s]
 20%|██        | 13324/65536 [2:29:22<9:46:42,  1.48it/s]
 20%|██        | 13325/65536 [2:29:23<9:36:26,  1.51it/s]
 20%|██        | 13326/65536 [2:29:24<9:29:19,  1.53it/s]
 20%|██        | 13327/65536 [2:29:24<9:27:40,  1.53it/s]
 20%|██        | 13328/65536 [2:29:25<9:38:17,  1.50it/s]
 20%|██        | 13329/65536 [2:29:26<9:42:16,  1.49it/s]
 20%|██        | 13330/65536 [2:29:26<9:49:40,  1.48it/s]
 20%|██        | 13331/65536 [2:29:27<9:54:18,  1.46it/s]
 20%|██        | 13332/65536 [2:29:28<9:51:52,  1.47it/s]
 20%|██        | 13333/65536 [2:29:28<10:03:00,  1.44it/s]
 20%|██        | 13334/65536 [2:29:29<10:03:59,  1.44it/s]
 20%|██        | 13335/65536 [2:29:30<9:59:02,  1.45it/s] 
 20%|██        | 13336/65536 [2:29:30<10:05:16,  1.44it/s]
 20%|██        | 13337/65536 [2:29:31<9:44:43,  1.49it/s] 
 20%|██        | 13338/65536 [2:29:32<9:29:10,  1.53it/s]
 20%|██        | 13339/65536 [2:29:32<9:33:58,  1.52it/s]
 20%|██        | 13340/65536 [2:29:33<9:58:57,  1.45it/s]
                                                         
{'loss': 0.9387, 'learning_rate': 8.189971837884167e-07, 'epoch': 823.46}

 20%|██        | 13340/65536 [2:29:33<9:58:57,  1.45it/s]
 20%|██        | 13341/65536 [2:29:34<9:48:51,  1.48it/s]
 20%|██        | 13342/65536 [2:29:34<9:48:03,  1.48it/s]
 20%|██        | 13343/65536 [2:29:35<9:42:26,  1.49it/s]
 20%|██        | 13344/65536 [2:29:36<9:51:49,  1.47it/s]
 20%|██        | 13345/65536 [2:29:36<9:41:06,  1.50it/s]
 20%|██        | 13346/65536 [2:29:37<9:44:37,  1.49it/s]
 20%|██        | 13347/65536 [2:29:38<9:49:03,  1.48it/s]
 20%|██        | 13348/65536 [2:29:38<9:49:47,  1.47it/s]
 20%|██        | 13349/65536 [2:29:39<10:03:38,  1.44it/s]
 20%|██        | 13350/65536 [2:29:40<10:05:22,  1.44it/s]
 20%|██        | 13351/65536 [2:29:41<9:44:00,  1.49it/s] 
 20%|██        | 13352/65536 [2:29:41<9:45:45,  1.48it/s]
 20%|██        | 13353/65536 [2:29:42<9:41:20,  1.50it/s]
 20%|██        | 13354/65536 [2:29:43<9:32:21,  1.52it/s]
 20%|██        | 13355/65536 [2:29:43<9:50:02,  1.47it/s]
 20%|██        | 13356/65536 [2:29:44<9:55:14,  1.46it/s]
 20%|██        | 13357/65536 [2:29:45<9:49:48,  1.47it/s]
 20%|██        | 13358/65536 [2:29:45<10:00:02,  1.45it/s]
 20%|██        | 13359/65536 [2:29:46<9:43:32,  1.49it/s] 
 20%|██        | 13360/65536 [2:29:47<9:53:40,  1.46it/s]
                                                         
{'loss': 0.9404, 'learning_rate': 8.187216848291906e-07, 'epoch': 824.69}

 20%|██        | 13360/65536 [2:29:47<9:53:40,  1.46it/s]
 20%|██        | 13361/65536 [2:29:47<9:33:27,  1.52it/s]
 20%|██        | 13362/65536 [2:29:48<9:50:46,  1.47it/s]
 20%|██        | 13363/65536 [2:29:49<9:49:39,  1.47it/s]
 20%|██        | 13364/65536 [2:29:49<9:56:29,  1.46it/s]
 20%|██        | 13365/65536 [2:29:50<9:52:31,  1.47it/s]
 20%|██        | 13366/65536 [2:29:51<10:23:36,  1.39it/s]
 20%|██        | 13367/65536 [2:29:51<9:58:04,  1.45it/s] 
 20%|██        | 13368/65536 [2:29:52<10:02:33,  1.44it/s]
 20%|██        | 13369/65536 [2:29:53<10:06:26,  1.43it/s]
 20%|██        | 13370/65536 [2:29:54<9:58:53,  1.45it/s] 
 20%|██        | 13371/65536 [2:29:54<10:07:32,  1.43it/s]
 20%|██        | 13372/65536 [2:29:55<10:06:17,  1.43it/s]
 20%|██        | 13373/65536 [2:29:56<10:14:55,  1.41it/s]
 20%|██        | 13374/65536 [2:29:56<10:18:55,  1.40it/s]
 20%|██        | 13375/65536 [2:29:57<10:03:07,  1.44it/s]
 20%|██        | 13376/65536 [2:29:58<9:45:30,  1.48it/s] 
 20%|██        | 13377/65536 [2:29:58<9:39:21,  1.50it/s]
 20%|██        | 13378/65536 [2:29:59<9:43:48,  1.49it/s]
 20%|██        | 13379/65536 [2:30:00<9:47:27,  1.48it/s]
 20%|██        | 13380/65536 [2:30:00<9:53:32,  1.46it/s]
                                                         
{'loss': 0.9143, 'learning_rate': 8.184461858699645e-07, 'epoch': 825.93}

 20%|██        | 13380/65536 [2:30:00<9:53:32,  1.46it/s]
 20%|██        | 13381/65536 [2:30:01<9:41:09,  1.50it/s]
 20%|██        | 13382/65536 [2:30:02<10:10:48,  1.42it/s]
 20%|██        | 13383/65536 [2:30:02<9:50:38,  1.47it/s] 
 20%|██        | 13384/65536 [2:30:03<9:43:56,  1.49it/s]
 20%|██        | 13385/65536 [2:30:04<9:40:53,  1.50it/s]
 20%|██        | 13386/65536 [2:30:04<9:50:09,  1.47it/s]
 20%|██        | 13387/65536 [2:30:05<9:44:37,  1.49it/s]
 20%|██        | 13388/65536 [2:30:06<9:40:53,  1.50it/s]
 20%|██        | 13389/65536 [2:30:06<9:48:26,  1.48it/s]
 20%|██        | 13390/65536 [2:30:07<9:52:59,  1.47it/s]
 20%|██        | 13391/65536 [2:30:08<9:54:15,  1.46it/s]
 20%|██        | 13392/65536 [2:30:09<9:51:16,  1.47it/s]
 20%|██        | 13393/65536 [2:30:09<9:58:57,  1.45it/s]
 20%|██        | 13394/65536 [2:30:10<9:40:17,  1.50it/s]
 20%|██        | 13395/65536 [2:30:11<9:41:02,  1.50it/s]
 20%|██        | 13396/65536 [2:30:11<9:33:17,  1.52it/s]
 20%|██        | 13397/65536 [2:30:12<9:27:43,  1.53it/s]
 20%|██        | 13398/65536 [2:30:13<10:01:19,  1.45it/s]
 20%|██        | 13399/65536 [2:30:13<9:47:36,  1.48it/s] 
 20%|██        | 13400/65536 [2:30:14<9:45:37,  1.48it/s]
                                                         
{'loss': 0.9586, 'learning_rate': 8.181706869107383e-07, 'epoch': 827.16}

 20%|██        | 13400/65536 [2:30:14<9:45:37,  1.48it/s]
 20%|██        | 13401/65536 [2:30:15<9:53:51,  1.46it/s]
 20%|██        | 13402/65536 [2:30:15<9:56:44,  1.46it/s]
 20%|██        | 13403/65536 [2:30:16<9:56:07,  1.46it/s]
 20%|██        | 13404/65536 [2:30:17<9:54:27,  1.46it/s]
 20%|██        | 13405/65536 [2:30:17<9:52:29,  1.47it/s]
 20%|██        | 13406/65536 [2:30:18<9:48:33,  1.48it/s]
 20%|██        | 13407/65536 [2:30:19<9:48:51,  1.48it/s]
 20%|██        | 13408/65536 [2:30:19<9:35:27,  1.51it/s]
 20%|██        | 13409/65536 [2:30:20<9:27:48,  1.53it/s]
 20%|██        | 13410/65536 [2:30:21<9:31:28,  1.52it/s]
 20%|██        | 13411/65536 [2:30:21<9:27:03,  1.53it/s]
 20%|██        | 13412/65536 [2:30:22<9:29:39,  1.52it/s]
 20%|██        | 13413/65536 [2:30:23<9:36:59,  1.51it/s]
 20%|██        | 13414/65536 [2:30:23<10:08:33,  1.43it/s]
 20%|██        | 13415/65536 [2:30:24<10:02:28,  1.44it/s]
 20%|██        | 13416/65536 [2:30:25<9:57:30,  1.45it/s] 
 20%|██        | 13417/65536 [2:30:25<10:01:25,  1.44it/s]
 20%|██        | 13418/65536 [2:30:26<10:06:50,  1.43it/s]
 20%|██        | 13419/65536 [2:30:27<9:57:39,  1.45it/s] 
 20%|██        | 13420/65536 [2:30:27<9:57:08,  1.45it/s]
                                                         
{'loss': 0.9307, 'learning_rate': 8.178951879515122e-07, 'epoch': 828.4}

 20%|██        | 13420/65536 [2:30:28<9:57:08,  1.45it/s]
 20%|██        | 13421/65536 [2:30:28<9:59:17,  1.45it/s]
 20%|██        | 13422/65536 [2:30:29<10:03:56,  1.44it/s]
 20%|██        | 13423/65536 [2:30:30<10:01:55,  1.44it/s]
 20%|██        | 13424/65536 [2:30:30<9:51:52,  1.47it/s] 
 20%|██        | 13425/65536 [2:30:31<9:51:01,  1.47it/s]
 20%|██        | 13426/65536 [2:30:32<9:52:47,  1.47it/s]
 20%|██        | 13427/65536 [2:30:32<9:35:03,  1.51it/s]
 20%|██        | 13428/65536 [2:30:33<9:32:12,  1.52it/s]
 20%|██        | 13429/65536 [2:30:33<9:22:11,  1.54it/s]
 20%|██        | 13430/65536 [2:30:34<9:40:02,  1.50it/s]
 20%|██        | 13431/65536 [2:30:35<9:35:41,  1.51it/s]
 20%|██        | 13432/65536 [2:30:35<9:16:53,  1.56it/s]
 20%|██        | 13433/65536 [2:30:36<9:18:27,  1.55it/s]
 20%|██        | 13434/65536 [2:30:37<9:38:37,  1.50it/s]
 21%|██        | 13435/65536 [2:30:38<9:51:41,  1.47it/s]
 21%|██        | 13436/65536 [2:30:38<9:47:24,  1.48it/s]
 21%|██        | 13437/65536 [2:30:39<9:58:05,  1.45it/s]
 21%|██        | 13438/65536 [2:30:40<9:34:29,  1.51it/s]
 21%|██        | 13439/65536 [2:30:40<9:31:27,  1.52it/s]
 21%|██        | 13440/65536 [2:30:41<9:29:39,  1.52it/s]
                                                         
{'loss': 0.9537, 'learning_rate': 8.17619688992286e-07, 'epoch': 829.63}

 21%|██        | 13440/65536 [2:30:41<9:29:39,  1.52it/s]
 21%|██        | 13441/65536 [2:30:41<9:26:38,  1.53it/s]
 21%|██        | 13442/65536 [2:30:42<9:26:53,  1.53it/s]
 21%|██        | 13443/65536 [2:30:43<9:35:05,  1.51it/s]
 21%|██        | 13444/65536 [2:30:43<9:22:48,  1.54it/s]
 21%|██        | 13445/65536 [2:30:44<9:41:54,  1.49it/s]
 21%|██        | 13446/65536 [2:30:45<9:34:10,  1.51it/s]
 21%|██        | 13447/65536 [2:30:46<10:00:17,  1.45it/s]
 21%|██        | 13448/65536 [2:30:46<9:52:54,  1.46it/s] 
 21%|██        | 13449/65536 [2:30:47<9:42:27,  1.49it/s]
 21%|██        | 13450/65536 [2:30:48<9:37:43,  1.50it/s]
 21%|██        | 13451/65536 [2:30:48<9:43:09,  1.49it/s]
 21%|██        | 13452/65536 [2:30:49<9:36:17,  1.51it/s]
 21%|██        | 13453/65536 [2:30:50<9:37:29,  1.50it/s]
 21%|██        | 13454/65536 [2:30:50<9:19:30,  1.55it/s]
 21%|██        | 13455/65536 [2:30:51<9:44:23,  1.49it/s]
 21%|██        | 13456/65536 [2:30:51<9:26:25,  1.53it/s]
 21%|██        | 13457/65536 [2:30:52<9:18:37,  1.55it/s]
 21%|██        | 13458/65536 [2:30:53<9:38:12,  1.50it/s]
 21%|██        | 13459/65536 [2:30:53<9:30:17,  1.52it/s]
 21%|██        | 13460/65536 [2:30:54<9:44:36,  1.48it/s]
                                                         
{'loss': 0.9437, 'learning_rate': 8.173441900330599e-07, 'epoch': 830.86}

 21%|██        | 13460/65536 [2:30:54<9:44:36,  1.48it/s]
 21%|██        | 13461/65536 [2:30:55<9:46:32,  1.48it/s]
 21%|██        | 13462/65536 [2:30:56<9:57:15,  1.45it/s]
 21%|██        | 13463/65536 [2:30:56<10:15:04,  1.41it/s]
 21%|██        | 13464/65536 [2:30:57<10:14:19,  1.41it/s]
 21%|██        | 13465/65536 [2:30:58<9:53:41,  1.46it/s] 
 21%|██        | 13466/65536 [2:30:58<10:03:28,  1.44it/s]
 21%|██        | 13467/65536 [2:30:59<9:52:05,  1.47it/s] 
 21%|██        | 13468/65536 [2:31:00<9:37:02,  1.50it/s]
 21%|██        | 13469/65536 [2:31:00<9:25:16,  1.54it/s]
 21%|██        | 13470/65536 [2:31:01<9:43:18,  1.49it/s]
 21%|██        | 13471/65536 [2:31:02<9:52:19,  1.46it/s]
 21%|██        | 13472/65536 [2:31:02<9:34:57,  1.51it/s]
 21%|██        | 13473/65536 [2:31:03<9:53:43,  1.46it/s]
 21%|██        | 13474/65536 [2:31:04<9:37:06,  1.50it/s]
 21%|██        | 13475/65536 [2:31:04<9:35:13,  1.51it/s]
 21%|██        | 13476/65536 [2:31:05<9:30:21,  1.52it/s]
 21%|██        | 13477/65536 [2:31:06<9:27:12,  1.53it/s]
 21%|██        | 13478/65536 [2:31:06<9:33:14,  1.51it/s]
 21%|██        | 13479/65536 [2:31:07<9:48:58,  1.47it/s]
 21%|██        | 13480/65536 [2:31:08<9:53:55,  1.46it/s]
                                                         
{'loss': 0.9587, 'learning_rate': 8.170686910738338e-07, 'epoch': 832.1}

 21%|██        | 13480/65536 [2:31:08<9:53:55,  1.46it/s]
 21%|██        | 13481/65536 [2:31:08<10:03:08,  1.44it/s]
 21%|██        | 13482/65536 [2:31:09<9:41:12,  1.49it/s] 
 21%|██        | 13483/65536 [2:31:10<9:43:54,  1.49it/s]
 21%|██        | 13484/65536 [2:31:10<9:48:10,  1.47it/s]
 21%|██        | 13485/65536 [2:31:11<9:40:12,  1.50it/s]
 21%|██        | 13486/65536 [2:31:12<9:24:46,  1.54it/s]
 21%|██        | 13487/65536 [2:31:12<9:46:37,  1.48it/s]
 21%|██        | 13488/65536 [2:31:13<9:40:32,  1.49it/s]
 21%|██        | 13489/65536 [2:31:14<9:39:46,  1.50it/s]
 21%|██        | 13490/65536 [2:31:14<9:54:14,  1.46it/s]
 21%|██        | 13491/65536 [2:31:15<9:49:25,  1.47it/s]
 21%|██        | 13492/65536 [2:31:16<9:40:42,  1.49it/s]
 21%|██        | 13493/65536 [2:31:16<9:43:51,  1.49it/s]
 21%|██        | 13494/65536 [2:31:17<9:31:15,  1.52it/s]
 21%|██        | 13495/65536 [2:31:18<9:45:33,  1.48it/s]
 21%|██        | 13496/65536 [2:31:18<9:58:15,  1.45it/s]
 21%|██        | 13497/65536 [2:31:19<9:47:58,  1.48it/s]
 21%|██        | 13498/65536 [2:31:20<9:43:47,  1.49it/s]
 21%|██        | 13499/65536 [2:31:20<9:43:22,  1.49it/s]
 21%|██        | 13500/65536 [2:31:21<9:40:12,  1.49it/s]
                                                         
{'loss': 0.9244, 'learning_rate': 8.167931921146075e-07, 'epoch': 833.33}

 21%|██        | 13500/65536 [2:31:21<9:40:12,  1.49it/s]
 21%|██        | 13501/65536 [2:31:22<9:36:28,  1.50it/s]
 21%|██        | 13502/65536 [2:31:22<9:26:26,  1.53it/s]
 21%|██        | 13503/65536 [2:31:23<9:32:30,  1.51it/s]
 21%|██        | 13504/65536 [2:31:24<9:48:16,  1.47it/s]
 21%|██        | 13505/65536 [2:31:24<9:54:03,  1.46it/s]
 21%|██        | 13506/65536 [2:31:25<9:51:16,  1.47it/s]
 21%|██        | 13507/65536 [2:31:26<9:44:15,  1.48it/s]
 21%|██        | 13508/65536 [2:31:26<9:38:24,  1.50it/s]
 21%|██        | 13509/65536 [2:31:27<9:35:34,  1.51it/s]
 21%|██        | 13510/65536 [2:31:28<9:30:50,  1.52it/s]
 21%|██        | 13511/65536 [2:31:29<9:57:58,  1.45it/s]
 21%|██        | 13512/65536 [2:31:29<9:49:39,  1.47it/s]
 21%|██        | 13513/65536 [2:31:30<9:27:31,  1.53it/s]
 21%|██        | 13514/65536 [2:31:30<9:35:01,  1.51it/s]
 21%|██        | 13515/65536 [2:31:31<9:35:14,  1.51it/s]
 21%|██        | 13516/65536 [2:31:32<9:35:42,  1.51it/s]
 21%|██        | 13517/65536 [2:31:32<9:38:10,  1.50it/s]
 21%|██        | 13518/65536 [2:31:33<9:53:18,  1.46it/s]
 21%|██        | 13519/65536 [2:31:34<9:47:28,  1.48it/s]
 21%|██        | 13520/65536 [2:31:35<10:11:13,  1.42it/s]
                                                          
{'loss': 0.924, 'learning_rate': 8.165176931553814e-07, 'epoch': 834.57}

 21%|██        | 13520/65536 [2:31:35<10:11:13,  1.42it/s]
 21%|██        | 13521/65536 [2:31:35<9:56:39,  1.45it/s] 
 21%|██        | 13522/65536 [2:31:36<9:57:19,  1.45it/s]
 21%|██        | 13523/65536 [2:31:37<9:48:58,  1.47it/s]
 21%|██        | 13524/65536 [2:31:37<9:39:23,  1.50it/s]
 21%|██        | 13525/65536 [2:31:38<9:37:46,  1.50it/s]
 21%|██        | 13526/65536 [2:31:39<9:33:56,  1.51it/s]
 21%|██        | 13527/65536 [2:31:39<9:30:08,  1.52it/s]
 21%|██        | 13528/65536 [2:31:40<10:11:27,  1.42it/s]
 21%|██        | 13529/65536 [2:31:41<9:48:56,  1.47it/s] 
 21%|██        | 13530/65536 [2:31:41<9:42:39,  1.49it/s]
 21%|██        | 13531/65536 [2:31:42<9:32:31,  1.51it/s]
 21%|██        | 13532/65536 [2:31:43<9:27:46,  1.53it/s]
 21%|██        | 13533/65536 [2:31:43<9:21:27,  1.54it/s]
 21%|██        | 13534/65536 [2:31:44<9:23:51,  1.54it/s]
 21%|██        | 13535/65536 [2:31:45<9:30:10,  1.52it/s]
 21%|██        | 13536/65536 [2:31:45<9:19:01,  1.55it/s]
 21%|██        | 13537/65536 [2:31:46<9:25:31,  1.53it/s]
 21%|██        | 13538/65536 [2:31:46<9:18:23,  1.55it/s]
 21%|██        | 13539/65536 [2:31:47<9:25:36,  1.53it/s]
 21%|██        | 13540/65536 [2:31:48<9:26:25,  1.53it/s]
                                                         
{'loss': 0.9628, 'learning_rate': 8.162421941961552e-07, 'epoch': 835.8}

 21%|██        | 13540/65536 [2:31:48<9:26:25,  1.53it/s]
 21%|██        | 13541/65536 [2:31:49<9:52:23,  1.46it/s]
 21%|██        | 13542/65536 [2:31:49<9:50:04,  1.47it/s]
 21%|██        | 13543/65536 [2:31:50<9:55:13,  1.46it/s]
 21%|██        | 13544/65536 [2:31:51<10:26:32,  1.38it/s]
 21%|██        | 13545/65536 [2:31:51<10:08:14,  1.42it/s]
 21%|██        | 13546/65536 [2:31:52<9:58:29,  1.45it/s] 
 21%|██        | 13547/65536 [2:31:53<10:03:58,  1.43it/s]
 21%|██        | 13548/65536 [2:31:53<10:08:48,  1.42it/s]
 21%|██        | 13549/65536 [2:31:54<9:53:53,  1.46it/s] 
 21%|██        | 13550/65536 [2:31:55<9:46:16,  1.48it/s]
 21%|██        | 13551/65536 [2:31:55<9:33:22,  1.51it/s]
 21%|██        | 13552/65536 [2:31:56<9:27:56,  1.53it/s]
 21%|██        | 13553/65536 [2:31:57<9:23:37,  1.54it/s]
 21%|██        | 13554/65536 [2:31:57<9:30:41,  1.52it/s]
 21%|██        | 13555/65536 [2:31:58<9:49:52,  1.47it/s]
 21%|██        | 13556/65536 [2:31:59<9:47:37,  1.47it/s]
 21%|██        | 13557/65536 [2:31:59<9:44:25,  1.48it/s]
 21%|██        | 13558/65536 [2:32:00<9:40:15,  1.49it/s]
 21%|██        | 13559/65536 [2:32:01<9:33:18,  1.51it/s]
 21%|██        | 13560/65536 [2:32:02<10:13:43,  1.41it/s]
                                                          
{'loss': 0.9248, 'learning_rate': 8.159666952369291e-07, 'epoch': 837.04}

 21%|██        | 13560/65536 [2:32:02<10:13:43,  1.41it/s]
 21%|██        | 13561/65536 [2:32:02<10:05:28,  1.43it/s]
 21%|██        | 13562/65536 [2:32:03<9:36:39,  1.50it/s] 
 21%|██        | 13563/65536 [2:32:03<9:29:11,  1.52it/s]
 21%|██        | 13564/65536 [2:32:04<9:30:42,  1.52it/s]
 21%|██        | 13565/65536 [2:32:05<9:28:03,  1.52it/s]
 21%|██        | 13566/65536 [2:32:06<9:50:27,  1.47it/s]
 21%|██        | 13567/65536 [2:32:06<9:49:24,  1.47it/s]
 21%|██        | 13568/65536 [2:32:07<9:42:29,  1.49it/s]
 21%|██        | 13569/65536 [2:32:07<9:32:28,  1.51it/s]
 21%|██        | 13570/65536 [2:32:08<9:37:45,  1.50it/s]
 21%|██        | 13571/65536 [2:32:09<9:51:49,  1.46it/s]
 21%|██        | 13572/65536 [2:32:10<9:55:08,  1.46it/s]
 21%|██        | 13573/65536 [2:32:10<9:52:42,  1.46it/s]
 21%|██        | 13574/65536 [2:32:11<9:45:08,  1.48it/s]
 21%|██        | 13575/65536 [2:32:12<9:40:01,  1.49it/s]
 21%|██        | 13576/65536 [2:32:12<9:54:58,  1.46it/s]
 21%|██        | 13577/65536 [2:32:13<10:02:59,  1.44it/s]
 21%|██        | 13578/65536 [2:32:14<9:47:50,  1.47it/s] 
 21%|██        | 13579/65536 [2:32:14<9:58:32,  1.45it/s]
 21%|██        | 13580/65536 [2:32:15<9:51:38,  1.46it/s]
                                                         
{'loss': 0.9204, 'learning_rate': 8.156911962777029e-07, 'epoch': 838.27}

 21%|██        | 13580/65536 [2:32:15<9:51:38,  1.46it/s]
 21%|██        | 13581/65536 [2:32:16<9:42:36,  1.49it/s]
 21%|██        | 13582/65536 [2:32:16<9:36:07,  1.50it/s]
 21%|██        | 13583/65536 [2:32:17<9:37:56,  1.50it/s]
 21%|██        | 13584/65536 [2:32:18<9:40:42,  1.49it/s]
 21%|██        | 13585/65536 [2:32:18<9:34:24,  1.51it/s]
 21%|██        | 13586/65536 [2:32:19<9:36:32,  1.50it/s]
 21%|██        | 13587/65536 [2:32:20<9:31:09,  1.52it/s]
 21%|██        | 13588/65536 [2:32:20<9:27:59,  1.52it/s]
 21%|██        | 13589/65536 [2:32:21<9:27:36,  1.53it/s]
 21%|██        | 13590/65536 [2:32:22<9:41:46,  1.49it/s]
 21%|██        | 13591/65536 [2:32:22<9:52:52,  1.46it/s]
 21%|██        | 13592/65536 [2:32:23<10:15:02,  1.41it/s]
 21%|██        | 13593/65536 [2:32:24<10:08:01,  1.42it/s]
 21%|██        | 13594/65536 [2:32:24<9:43:41,  1.48it/s] 
 21%|██        | 13595/65536 [2:32:25<9:51:10,  1.46it/s]
 21%|██        | 13596/65536 [2:32:26<9:40:40,  1.49it/s]
 21%|██        | 13597/65536 [2:32:26<9:27:07,  1.53it/s]
 21%|██        | 13598/65536 [2:32:27<9:38:57,  1.50it/s]
 21%|██        | 13599/65536 [2:32:28<9:36:34,  1.50it/s]
 21%|██        | 13600/65536 [2:32:28<9:35:56,  1.50it/s]
                                                         
{'loss': 0.9456, 'learning_rate': 8.154156973184767e-07, 'epoch': 839.51}

 21%|██        | 13600/65536 [2:32:28<9:35:56,  1.50it/s]
 21%|██        | 13601/65536 [2:32:29<9:24:01,  1.53it/s]
 21%|██        | 13602/65536 [2:32:30<9:39:08,  1.49it/s]
 21%|██        | 13603/65536 [2:32:30<9:50:10,  1.47it/s]
 21%|██        | 13604/65536 [2:32:31<9:48:49,  1.47it/s]
 21%|██        | 13605/65536 [2:32:32<9:35:33,  1.50it/s]
 21%|██        | 13606/65536 [2:32:32<9:39:55,  1.49it/s]
 21%|██        | 13607/65536 [2:32:33<9:41:42,  1.49it/s]
 21%|██        | 13608/65536 [2:32:34<9:39:07,  1.49it/s]
 21%|██        | 13609/65536 [2:32:35<10:14:10,  1.41it/s]
 21%|██        | 13610/65536 [2:32:35<10:27:00,  1.38it/s]
 21%|██        | 13611/65536 [2:32:36<10:08:01,  1.42it/s]
 21%|██        | 13612/65536 [2:32:37<9:57:08,  1.45it/s] 
 21%|██        | 13613/65536 [2:32:37<9:51:31,  1.46it/s]
 21%|██        | 13614/65536 [2:32:38<9:35:35,  1.50it/s]
 21%|██        | 13615/65536 [2:32:39<9:43:04,  1.48it/s]
 21%|██        | 13616/65536 [2:32:39<9:38:27,  1.50it/s]
 21%|██        | 13617/65536 [2:32:40<9:31:39,  1.51it/s]
 21%|██        | 13618/65536 [2:32:41<9:43:26,  1.48it/s]
 21%|██        | 13619/65536 [2:32:41<9:37:46,  1.50it/s]
 21%|██        | 13620/65536 [2:32:42<9:25:29,  1.53it/s]
                                                         
{'loss': 0.9314, 'learning_rate': 8.151401983592506e-07, 'epoch': 840.74}

 21%|██        | 13620/65536 [2:32:42<9:25:29,  1.53it/s]
 21%|██        | 13621/65536 [2:32:43<9:27:52,  1.52it/s]
 21%|██        | 13622/65536 [2:32:43<9:18:25,  1.55it/s]
 21%|██        | 13623/65536 [2:32:44<9:16:53,  1.55it/s]
 21%|██        | 13624/65536 [2:32:45<9:36:38,  1.50it/s]
 21%|██        | 13625/65536 [2:32:45<10:08:23,  1.42it/s]
 21%|██        | 13626/65536 [2:32:46<10:03:12,  1.43it/s]
 21%|██        | 13627/65536 [2:32:47<9:46:59,  1.47it/s] 
 21%|██        | 13628/65536 [2:32:47<9:57:52,  1.45it/s]
 21%|██        | 13629/65536 [2:32:48<9:53:53,  1.46it/s]
 21%|██        | 13630/65536 [2:32:49<9:45:35,  1.48it/s]
 21%|██        | 13631/65536 [2:32:49<9:38:22,  1.50it/s]
 21%|██        | 13632/65536 [2:32:50<9:38:10,  1.50it/s]
 21%|██        | 13633/65536 [2:32:51<9:39:42,  1.49it/s]
 21%|██        | 13634/65536 [2:32:51<9:27:24,  1.52it/s]
 21%|██        | 13635/65536 [2:32:52<9:28:44,  1.52it/s]
 21%|██        | 13636/65536 [2:32:53<9:39:31,  1.49it/s]
 21%|██        | 13637/65536 [2:32:53<9:37:45,  1.50it/s]
 21%|██        | 13638/65536 [2:32:54<9:34:22,  1.51it/s]
 21%|██        | 13639/65536 [2:32:55<9:42:07,  1.49it/s]
 21%|██        | 13640/65536 [2:32:55<9:46:05,  1.48it/s]
                                                         
{'loss': 0.9374, 'learning_rate': 8.148646994000244e-07, 'epoch': 841.98}

 21%|██        | 13640/65536 [2:32:55<9:46:05,  1.48it/s]
 21%|██        | 13641/65536 [2:32:56<10:10:16,  1.42it/s]
 21%|██        | 13642/65536 [2:32:57<10:25:04,  1.38it/s]
 21%|██        | 13643/65536 [2:32:58<10:08:21,  1.42it/s]
 21%|██        | 13644/65536 [2:32:58<9:59:10,  1.44it/s] 
 21%|██        | 13645/65536 [2:32:59<9:46:26,  1.47it/s]
 21%|██        | 13646/65536 [2:33:00<9:37:25,  1.50it/s]
 21%|██        | 13647/65536 [2:33:00<9:42:42,  1.48it/s]
 21%|██        | 13648/65536 [2:33:01<9:34:39,  1.50it/s]
 21%|██        | 13649/65536 [2:33:01<9:20:40,  1.54it/s]
 21%|██        | 13650/65536 [2:33:02<9:27:58,  1.52it/s]
 21%|██        | 13651/65536 [2:33:03<9:23:28,  1.53it/s]
 21%|██        | 13652/65536 [2:33:03<9:07:09,  1.58it/s]
 21%|██        | 13653/65536 [2:33:04<9:22:14,  1.54it/s]
 21%|██        | 13654/65536 [2:33:05<9:42:36,  1.48it/s]
 21%|██        | 13655/65536 [2:33:05<9:38:06,  1.50it/s]
 21%|██        | 13656/65536 [2:33:06<9:45:08,  1.48it/s]
 21%|██        | 13657/65536 [2:33:07<10:19:19,  1.40it/s]
 21%|██        | 13658/65536 [2:33:08<10:08:36,  1.42it/s]
 21%|██        | 13659/65536 [2:33:08<9:52:29,  1.46it/s] 
 21%|██        | 13660/65536 [2:33:09<9:41:34,  1.49it/s]
                                                         
{'loss': 0.9662, 'learning_rate': 8.145892004407983e-07, 'epoch': 843.21}

 21%|██        | 13660/65536 [2:33:09<9:41:34,  1.49it/s]
 21%|██        | 13661/65536 [2:33:10<9:37:15,  1.50it/s]
 21%|██        | 13662/65536 [2:33:10<9:24:44,  1.53it/s]
 21%|██        | 13663/65536 [2:33:11<9:19:23,  1.55it/s]
 21%|██        | 13664/65536 [2:33:12<9:32:35,  1.51it/s]
 21%|██        | 13665/65536 [2:33:12<9:28:28,  1.52it/s]
 21%|██        | 13666/65536 [2:33:13<9:37:55,  1.50it/s]
 21%|██        | 13667/65536 [2:33:14<9:37:26,  1.50it/s]
 21%|██        | 13668/65536 [2:33:14<9:36:10,  1.50it/s]
 21%|██        | 13669/65536 [2:33:15<9:50:46,  1.46it/s]
 21%|██        | 13670/65536 [2:33:16<9:45:09,  1.48it/s]
 21%|██        | 13671/65536 [2:33:16<9:39:37,  1.49it/s]
 21%|██        | 13672/65536 [2:33:17<9:39:36,  1.49it/s]
 21%|██        | 13673/65536 [2:33:18<10:04:46,  1.43it/s]
 21%|██        | 13674/65536 [2:33:18<9:55:02,  1.45it/s] 
 21%|██        | 13675/65536 [2:33:19<9:46:59,  1.47it/s]
 21%|██        | 13676/65536 [2:33:20<9:40:17,  1.49it/s]
 21%|██        | 13677/65536 [2:33:20<9:52:52,  1.46it/s]
 21%|██        | 13678/65536 [2:33:21<9:38:55,  1.49it/s]
 21%|██        | 13679/65536 [2:33:22<9:23:01,  1.54it/s]
 21%|██        | 13680/65536 [2:33:22<9:34:24,  1.50it/s]
                                                         
{'loss': 0.9286, 'learning_rate': 8.14313701481572e-07, 'epoch': 844.44}

 21%|██        | 13680/65536 [2:33:22<9:34:24,  1.50it/s]
 21%|██        | 13681/65536 [2:33:23<9:46:52,  1.47it/s]
 21%|██        | 13682/65536 [2:33:24<9:40:06,  1.49it/s]
 21%|██        | 13683/65536 [2:33:24<9:40:08,  1.49it/s]
 21%|██        | 13684/65536 [2:33:25<9:18:26,  1.55it/s]
 21%|██        | 13685/65536 [2:33:26<9:24:38,  1.53it/s]
 21%|██        | 13686/65536 [2:33:26<9:26:03,  1.53it/s]
 21%|██        | 13687/65536 [2:33:27<9:32:31,  1.51it/s]
 21%|██        | 13688/65536 [2:33:28<9:20:30,  1.54it/s]
 21%|██        | 13689/65536 [2:33:28<9:45:53,  1.47it/s]
 21%|██        | 13690/65536 [2:33:29<10:03:55,  1.43it/s]
 21%|██        | 13691/65536 [2:33:30<9:54:51,  1.45it/s] 
 21%|██        | 13692/65536 [2:33:30<9:50:48,  1.46it/s]
 21%|██        | 13693/65536 [2:33:31<9:39:21,  1.49it/s]
 21%|██        | 13694/65536 [2:33:32<9:36:44,  1.50it/s]
 21%|██        | 13695/65536 [2:33:32<9:37:36,  1.50it/s]
 21%|██        | 13696/65536 [2:33:33<9:44:30,  1.48it/s]
 21%|██        | 13697/65536 [2:33:34<9:33:36,  1.51it/s]
 21%|██        | 13698/65536 [2:33:34<9:45:39,  1.48it/s]
 21%|██        | 13699/65536 [2:33:35<9:35:37,  1.50it/s]
 21%|██        | 13700/65536 [2:33:36<9:41:46,  1.48it/s]
                                                         
{'loss': 0.9308, 'learning_rate': 8.14038202522346e-07, 'epoch': 845.68}

 21%|██        | 13700/65536 [2:33:36<9:41:46,  1.48it/s]
 21%|██        | 13701/65536 [2:33:36<9:43:16,  1.48it/s]
 21%|██        | 13702/65536 [2:33:37<9:48:03,  1.47it/s]
 21%|██        | 13703/65536 [2:33:38<10:09:19,  1.42it/s]
 21%|██        | 13704/65536 [2:33:39<9:53:18,  1.46it/s] 
 21%|██        | 13705/65536 [2:33:39<9:42:59,  1.48it/s]
 21%|██        | 13706/65536 [2:33:40<10:19:11,  1.40it/s]
 21%|██        | 13707/65536 [2:33:41<10:00:40,  1.44it/s]
 21%|██        | 13708/65536 [2:33:41<9:44:53,  1.48it/s] 
 21%|██        | 13709/65536 [2:33:42<9:43:15,  1.48it/s]
 21%|██        | 13710/65536 [2:33:43<9:40:44,  1.49it/s]
 21%|██        | 13711/65536 [2:33:43<9:33:43,  1.51it/s]
 21%|██        | 13712/65536 [2:33:44<9:52:04,  1.46it/s]
 21%|██        | 13713/65536 [2:33:45<9:48:51,  1.47it/s]
 21%|██        | 13714/65536 [2:33:45<9:53:42,  1.45it/s]
 21%|██        | 13715/65536 [2:33:46<9:43:46,  1.48it/s]
 21%|██        | 13716/65536 [2:33:47<9:36:29,  1.50it/s]
 21%|██        | 13717/65536 [2:33:47<9:33:34,  1.51it/s]
 21%|██        | 13718/65536 [2:33:48<9:23:27,  1.53it/s]
 21%|██        | 13719/65536 [2:33:49<9:20:23,  1.54it/s]
 21%|██        | 13720/65536 [2:33:49<9:18:19,  1.55it/s]
                                                         
{'loss': 0.942, 'learning_rate': 8.137627035631199e-07, 'epoch': 846.91}

 21%|██        | 13720/65536 [2:33:49<9:18:19,  1.55it/s]
 21%|██        | 13721/65536 [2:33:50<9:32:38,  1.51it/s]
 21%|██        | 13722/65536 [2:33:51<9:57:29,  1.45it/s]
 21%|██        | 13723/65536 [2:33:51<9:56:17,  1.45it/s]
 21%|██        | 13724/65536 [2:33:52<9:44:00,  1.48it/s]
 21%|██        | 13725/65536 [2:33:53<9:35:45,  1.50it/s]
 21%|██        | 13726/65536 [2:33:53<10:01:59,  1.43it/s]
 21%|██        | 13727/65536 [2:33:54<9:49:51,  1.46it/s] 
 21%|██        | 13728/65536 [2:33:55<9:38:23,  1.49it/s]
 21%|██        | 13729/65536 [2:33:55<9:41:36,  1.48it/s]
 21%|██        | 13730/65536 [2:33:56<9:40:10,  1.49it/s]
 21%|██        | 13731/65536 [2:33:57<9:31:06,  1.51it/s]
 21%|██        | 13732/65536 [2:33:57<9:29:25,  1.52it/s]
 21%|██        | 13733/65536 [2:33:58<9:13:17,  1.56it/s]
 21%|██        | 13734/65536 [2:33:59<9:27:33,  1.52it/s]
 21%|██        | 13735/65536 [2:33:59<9:45:42,  1.47it/s]
 21%|██        | 13736/65536 [2:34:00<9:46:50,  1.47it/s]
 21%|██        | 13737/65536 [2:34:01<9:42:45,  1.48it/s]
 21%|██        | 13738/65536 [2:34:01<9:53:53,  1.45it/s]
 21%|██        | 13739/65536 [2:34:02<9:48:27,  1.47it/s]
 21%|██        | 13740/65536 [2:34:03<9:51:44,  1.46it/s]
                                                         
{'loss': 0.9374, 'learning_rate': 8.134872046038937e-07, 'epoch': 848.15}

 21%|██        | 13740/65536 [2:34:03<9:51:44,  1.46it/s]
 21%|██        | 13741/65536 [2:34:03<9:49:21,  1.46it/s]
 21%|██        | 13742/65536 [2:34:04<9:34:49,  1.50it/s]
 21%|██        | 13743/65536 [2:34:05<9:19:59,  1.54it/s]
 21%|██        | 13744/65536 [2:34:05<9:29:27,  1.52it/s]
 21%|██        | 13745/65536 [2:34:06<9:32:34,  1.51it/s]
 21%|██        | 13746/65536 [2:34:07<9:32:18,  1.51it/s]
 21%|██        | 13747/65536 [2:34:07<9:30:10,  1.51it/s]
 21%|██        | 13748/65536 [2:34:08<9:44:39,  1.48it/s]
 21%|██        | 13749/65536 [2:34:09<9:43:00,  1.48it/s]
 21%|██        | 13750/65536 [2:34:09<9:38:53,  1.49it/s]
 21%|██        | 13751/65536 [2:34:10<9:41:26,  1.48it/s]
 21%|██        | 13752/65536 [2:34:11<9:39:47,  1.49it/s]
 21%|██        | 13753/65536 [2:34:12<9:51:50,  1.46it/s]
 21%|██        | 13754/65536 [2:34:12<10:10:42,  1.41it/s]
 21%|██        | 13755/65536 [2:34:13<9:46:31,  1.47it/s] 
 21%|██        | 13756/65536 [2:34:14<10:05:59,  1.42it/s]
 21%|██        | 13757/65536 [2:34:14<10:12:53,  1.41it/s]
 21%|██        | 13758/65536 [2:34:15<10:06:12,  1.42it/s]
 21%|██        | 13759/65536 [2:34:16<9:55:44,  1.45it/s] 
 21%|██        | 13760/65536 [2:34:16<9:46:54,  1.47it/s]
                                                         
{'loss': 0.9326, 'learning_rate': 8.132117056446676e-07, 'epoch': 849.38}

 21%|██        | 13760/65536 [2:34:16<9:46:54,  1.47it/s]
 21%|██        | 13761/65536 [2:34:17<9:38:50,  1.49it/s]
 21%|██        | 13762/65536 [2:34:18<9:37:20,  1.49it/s]
 21%|██        | 13763/65536 [2:34:18<9:34:32,  1.50it/s]
 21%|██        | 13764/65536 [2:34:19<9:24:50,  1.53it/s]
 21%|██        | 13765/65536 [2:34:20<9:19:38,  1.54it/s]
 21%|██        | 13766/65536 [2:34:20<9:23:57,  1.53it/s]
 21%|██        | 13767/65536 [2:34:21<9:25:16,  1.53it/s]
 21%|██        | 13768/65536 [2:34:22<9:18:45,  1.54it/s]
 21%|██        | 13769/65536 [2:34:22<9:15:55,  1.55it/s]
 21%|██        | 13770/65536 [2:34:23<9:37:51,  1.49it/s]
 21%|██        | 13771/65536 [2:34:24<9:53:10,  1.45it/s]
 21%|██        | 13772/65536 [2:34:24<9:54:28,  1.45it/s]
 21%|██        | 13773/65536 [2:34:25<9:48:20,  1.47it/s]
 21%|██        | 13774/65536 [2:34:26<9:46:59,  1.47it/s]
 21%|██        | 13775/65536 [2:34:26<9:40:04,  1.49it/s]
 21%|██        | 13776/65536 [2:34:27<9:51:32,  1.46it/s]
 21%|██        | 13777/65536 [2:34:28<9:43:44,  1.48it/s]
 21%|██        | 13778/65536 [2:34:28<9:37:46,  1.49it/s]
 21%|██        | 13779/65536 [2:34:29<9:42:03,  1.48it/s]
 21%|██        | 13780/65536 [2:34:30<9:55:33,  1.45it/s]
                                                         
{'loss': 0.9442, 'learning_rate': 8.129362066854413e-07, 'epoch': 850.62}

 21%|██        | 13780/65536 [2:34:30<9:55:33,  1.45it/s]
 21%|██        | 13781/65536 [2:34:30<9:47:50,  1.47it/s]
 21%|██        | 13782/65536 [2:34:31<9:50:00,  1.46it/s]
 21%|██        | 13783/65536 [2:34:32<9:34:56,  1.50it/s]
 21%|██        | 13784/65536 [2:34:32<9:44:18,  1.48it/s]
 21%|██        | 13785/65536 [2:34:33<9:48:07,  1.47it/s]
 21%|██        | 13786/65536 [2:34:34<9:34:44,  1.50it/s]
 21%|██        | 13787/65536 [2:34:35<10:00:47,  1.44it/s]
 21%|██        | 13788/65536 [2:34:35<10:01:25,  1.43it/s]
 21%|██        | 13789/65536 [2:34:36<9:43:37,  1.48it/s] 
 21%|██        | 13790/65536 [2:34:37<9:43:27,  1.48it/s]
 21%|██        | 13791/65536 [2:34:37<9:46:04,  1.47it/s]
 21%|██        | 13792/65536 [2:34:38<9:54:05,  1.45it/s]
 21%|██        | 13793/65536 [2:34:39<9:51:49,  1.46it/s]
 21%|██        | 13794/65536 [2:34:39<10:01:58,  1.43it/s]
 21%|██        | 13795/65536 [2:34:40<9:48:14,  1.47it/s] 
 21%|██        | 13796/65536 [2:34:41<9:52:55,  1.45it/s]
 21%|██        | 13797/65536 [2:34:41<9:50:34,  1.46it/s]
 21%|██        | 13798/65536 [2:34:42<9:45:49,  1.47it/s]
 21%|██        | 13799/65536 [2:34:43<9:37:39,  1.49it/s]
 21%|██        | 13800/65536 [2:34:43<9:30:50,  1.51it/s]
                                                         
{'loss': 0.9232, 'learning_rate': 8.126607077262152e-07, 'epoch': 851.85}

 21%|██        | 13800/65536 [2:34:43<9:30:50,  1.51it/s]
 21%|██        | 13801/65536 [2:34:44<9:33:06,  1.50it/s]
 21%|██        | 13802/65536 [2:34:45<9:21:34,  1.54it/s]
 21%|██        | 13803/65536 [2:34:45<9:58:46,  1.44it/s]
 21%|██        | 13804/65536 [2:34:46<10:04:39,  1.43it/s]
 21%|██        | 13805/65536 [2:34:47<9:45:25,  1.47it/s] 
 21%|██        | 13806/65536 [2:34:47<9:50:02,  1.46it/s]
 21%|██        | 13807/65536 [2:34:48<10:10:51,  1.41it/s]
 21%|██        | 13808/65536 [2:34:49<9:52:29,  1.46it/s] 
 21%|██        | 13809/65536 [2:34:50<9:57:30,  1.44it/s]
 21%|██        | 13810/65536 [2:34:50<9:53:42,  1.45it/s]
 21%|██        | 13811/65536 [2:34:51<9:43:11,  1.48it/s]
 21%|██        | 13812/65536 [2:34:52<9:25:57,  1.52it/s]
 21%|██        | 13813/65536 [2:34:52<9:15:42,  1.55it/s]
 21%|██        | 13814/65536 [2:34:53<9:24:24,  1.53it/s]
 21%|██        | 13815/65536 [2:34:53<9:29:15,  1.51it/s]
 21%|██        | 13816/65536 [2:34:54<9:22:09,  1.53it/s]
 21%|██        | 13817/65536 [2:34:55<9:22:45,  1.53it/s]
 21%|██        | 13818/65536 [2:34:55<9:25:42,  1.52it/s]
 21%|██        | 13819/65536 [2:34:56<9:48:23,  1.46it/s]
 21%|██        | 13820/65536 [2:34:57<9:57:56,  1.44it/s]
                                                         
{'loss': 0.9443, 'learning_rate': 8.12385208766989e-07, 'epoch': 853.09}

 21%|██        | 13820/65536 [2:34:57<9:57:56,  1.44it/s]
 21%|██        | 13821/65536 [2:34:58<9:54:29,  1.45it/s]
 21%|██        | 13822/65536 [2:34:58<9:55:59,  1.45it/s]
 21%|██        | 13823/65536 [2:34:59<9:47:07,  1.47it/s]
 21%|██        | 13824/65536 [2:35:00<9:34:27,  1.50it/s]
 21%|██        | 13825/65536 [2:35:00<9:47:40,  1.47it/s]
 21%|██        | 13826/65536 [2:35:01<9:41:06,  1.48it/s]
 21%|██        | 13827/65536 [2:35:02<9:36:43,  1.49it/s]
 21%|██        | 13828/65536 [2:35:02<9:35:56,  1.50it/s]
 21%|██        | 13829/65536 [2:35:03<9:26:22,  1.52it/s]
 21%|██        | 13830/65536 [2:35:04<9:20:28,  1.54it/s]
 21%|██        | 13831/65536 [2:35:04<9:24:45,  1.53it/s]
 21%|██        | 13832/65536 [2:35:05<9:52:28,  1.45it/s]
 21%|██        | 13833/65536 [2:35:06<9:42:13,  1.48it/s]
 21%|██        | 13834/65536 [2:35:06<9:40:11,  1.49it/s]
 21%|██        | 13835/65536 [2:35:07<10:00:52,  1.43it/s]
 21%|██        | 13836/65536 [2:35:08<9:51:23,  1.46it/s] 
 21%|██        | 13837/65536 [2:35:08<9:43:45,  1.48it/s]
 21%|██        | 13838/65536 [2:35:09<9:51:09,  1.46it/s]
 21%|██        | 13839/65536 [2:35:10<9:46:58,  1.47it/s]
 21%|██        | 13840/65536 [2:35:10<9:44:59,  1.47it/s]
                                                         
{'loss': 0.928, 'learning_rate': 8.121097098077629e-07, 'epoch': 854.32}

 21%|██        | 13840/65536 [2:35:10<9:44:59,  1.47it/s]
 21%|██        | 13841/65536 [2:35:11<9:42:35,  1.48it/s]
 21%|██        | 13842/65536 [2:35:12<9:38:49,  1.49it/s]
 21%|██        | 13843/65536 [2:35:12<9:39:19,  1.49it/s]
 21%|██        | 13844/65536 [2:35:13<9:22:20,  1.53it/s]
 21%|██        | 13845/65536 [2:35:14<9:34:21,  1.50it/s]
 21%|██        | 13846/65536 [2:35:14<9:36:03,  1.50it/s]
 21%|██        | 13847/65536 [2:35:15<9:54:37,  1.45it/s]
 21%|██        | 13848/65536 [2:35:16<9:47:27,  1.47it/s]
 21%|██        | 13849/65536 [2:35:16<9:46:10,  1.47it/s]
 21%|██        | 13850/65536 [2:35:17<9:47:22,  1.47it/s]
 21%|██        | 13851/65536 [2:35:18<9:38:07,  1.49it/s]
 21%|██        | 13852/65536 [2:35:19<10:08:26,  1.42it/s]
 21%|██        | 13853/65536 [2:35:19<9:52:45,  1.45it/s] 
 21%|██        | 13854/65536 [2:35:20<9:50:34,  1.46it/s]
 21%|██        | 13855/65536 [2:35:21<9:55:09,  1.45it/s]
 21%|██        | 13856/65536 [2:35:21<9:55:12,  1.45it/s]
 21%|██        | 13857/65536 [2:35:22<9:53:14,  1.45it/s]
 21%|██        | 13858/65536 [2:35:23<9:46:20,  1.47it/s]
 21%|██        | 13859/65536 [2:35:23<9:45:23,  1.47it/s]
 21%|██        | 13860/65536 [2:35:24<9:46:46,  1.47it/s]
                                                         
{'loss': 0.9337, 'learning_rate': 8.118342108485368e-07, 'epoch': 855.56}

 21%|██        | 13860/65536 [2:35:24<9:46:46,  1.47it/s]
 21%|██        | 13861/65536 [2:35:25<9:40:13,  1.48it/s]
 21%|██        | 13862/65536 [2:35:25<9:33:55,  1.50it/s]
 21%|██        | 13863/65536 [2:35:26<9:36:58,  1.49it/s]
 21%|██        | 13864/65536 [2:35:27<9:42:47,  1.48it/s]
 21%|██        | 13865/65536 [2:35:27<9:41:43,  1.48it/s]
 21%|██        | 13866/65536 [2:35:28<9:32:48,  1.50it/s]
 21%|██        | 13867/65536 [2:35:29<9:29:33,  1.51it/s]
 21%|██        | 13868/65536 [2:35:29<10:02:31,  1.43it/s]
 21%|██        | 13869/65536 [2:35:30<9:57:13,  1.44it/s] 
 21%|██        | 13870/65536 [2:35:31<9:41:13,  1.48it/s]
 21%|██        | 13871/65536 [2:35:31<9:40:57,  1.48it/s]
 21%|██        | 13872/65536 [2:35:32<9:28:01,  1.52it/s]
 21%|██        | 13873/65536 [2:35:33<9:36:05,  1.49it/s]
 21%|██        | 13874/65536 [2:35:33<9:47:17,  1.47it/s]
 21%|██        | 13875/65536 [2:35:34<9:36:36,  1.49it/s]
 21%|██        | 13876/65536 [2:35:35<9:37:01,  1.49it/s]
 21%|██        | 13877/65536 [2:35:35<9:47:44,  1.46it/s]
 21%|██        | 13878/65536 [2:35:36<9:44:58,  1.47it/s]
 21%|██        | 13879/65536 [2:35:37<9:24:09,  1.53it/s]
 21%|██        | 13880/65536 [2:35:37<9:12:23,  1.56it/s]
                                                         
{'loss': 0.9466, 'learning_rate': 8.115587118893105e-07, 'epoch': 856.79}

 21%|██        | 13880/65536 [2:35:37<9:12:23,  1.56it/s]
 21%|██        | 13881/65536 [2:35:38<9:28:44,  1.51it/s]
 21%|██        | 13882/65536 [2:35:39<9:46:13,  1.47it/s]
 21%|██        | 13883/65536 [2:35:39<9:31:59,  1.51it/s]
 21%|██        | 13884/65536 [2:35:40<9:50:17,  1.46it/s]
 21%|██        | 13885/65536 [2:35:41<9:35:20,  1.50it/s]
 21%|██        | 13886/65536 [2:35:41<9:45:55,  1.47it/s]
 21%|██        | 13887/65536 [2:35:42<9:34:37,  1.50it/s]
 21%|██        | 13888/65536 [2:35:43<9:35:54,  1.49it/s]
 21%|██        | 13889/65536 [2:35:43<9:36:33,  1.49it/s]
 21%|██        | 13890/65536 [2:35:44<9:40:15,  1.48it/s]
 21%|██        | 13891/65536 [2:35:45<9:40:41,  1.48it/s]
 21%|██        | 13892/65536 [2:35:45<9:31:34,  1.51it/s]
 21%|██        | 13893/65536 [2:35:46<9:31:31,  1.51it/s]
 21%|██        | 13894/65536 [2:35:47<9:25:24,  1.52it/s]
 21%|██        | 13895/65536 [2:35:47<9:36:06,  1.49it/s]
 21%|██        | 13896/65536 [2:35:48<9:40:00,  1.48it/s]
 21%|██        | 13897/65536 [2:35:49<9:45:36,  1.47it/s]
 21%|██        | 13898/65536 [2:35:50<9:44:52,  1.47it/s]
 21%|██        | 13899/65536 [2:35:50<9:47:09,  1.47it/s]
 21%|██        | 13900/65536 [2:35:51<9:55:17,  1.45it/s]
                                                         
{'loss': 0.9389, 'learning_rate': 8.112832129300844e-07, 'epoch': 858.02}

 21%|██        | 13900/65536 [2:35:51<9:55:17,  1.45it/s]
 21%|██        | 13901/65536 [2:35:52<9:51:06,  1.46it/s]
 21%|██        | 13902/65536 [2:35:52<9:49:05,  1.46it/s]
 21%|██        | 13903/65536 [2:35:53<9:53:03,  1.45it/s]
 21%|██        | 13904/65536 [2:35:54<10:02:54,  1.43it/s]
 21%|██        | 13905/65536 [2:35:54<9:49:44,  1.46it/s] 
 21%|██        | 13906/65536 [2:35:55<10:00:13,  1.43it/s]
 21%|██        | 13907/65536 [2:35:56<9:44:27,  1.47it/s] 
 21%|██        | 13908/65536 [2:35:56<9:37:11,  1.49it/s]
 21%|██        | 13909/65536 [2:35:57<9:35:37,  1.49it/s]
 21%|██        | 13910/65536 [2:35:58<9:29:25,  1.51it/s]
 21%|██        | 13911/65536 [2:35:58<9:32:56,  1.50it/s]
 21%|██        | 13912/65536 [2:35:59<9:15:27,  1.55it/s]
 21%|██        | 13913/65536 [2:36:00<9:13:11,  1.56it/s]
 21%|██        | 13914/65536 [2:36:00<9:24:56,  1.52it/s]
 21%|██        | 13915/65536 [2:36:01<9:25:28,  1.52it/s]
 21%|██        | 13916/65536 [2:36:02<9:58:38,  1.44it/s]
 21%|██        | 13917/65536 [2:36:02<10:00:45,  1.43it/s]
 21%|██        | 13918/65536 [2:36:03<9:48:05,  1.46it/s] 
 21%|██        | 13919/65536 [2:36:04<9:46:41,  1.47it/s]
 21%|██        | 13920/65536 [2:36:04<9:47:20,  1.46it/s]
                                                         
{'loss': 0.9365, 'learning_rate': 8.110077139708582e-07, 'epoch': 859.26}

 21%|██        | 13920/65536 [2:36:04<9:47:20,  1.46it/s]
 21%|██        | 13921/65536 [2:36:05<9:49:48,  1.46it/s]
 21%|██        | 13922/65536 [2:36:06<9:24:48,  1.52it/s]
 21%|██        | 13923/65536 [2:36:06<9:27:59,  1.51it/s]
 21%|██        | 13924/65536 [2:36:07<9:21:56,  1.53it/s]
 21%|██        | 13925/65536 [2:36:08<9:43:26,  1.47it/s]
 21%|██        | 13926/65536 [2:36:08<9:35:07,  1.50it/s]
 21%|██▏       | 13927/65536 [2:36:09<9:23:43,  1.53it/s]
 21%|██▏       | 13928/65536 [2:36:10<9:30:38,  1.51it/s]
 21%|██▏       | 13929/65536 [2:36:10<9:40:14,  1.48it/s]
 21%|██▏       | 13930/65536 [2:36:11<9:37:16,  1.49it/s]
 21%|██▏       | 13931/65536 [2:36:12<9:28:59,  1.51it/s]
 21%|██▏       | 13932/65536 [2:36:12<9:35:17,  1.50it/s]
 21%|██▏       | 13933/65536 [2:36:13<10:13:25,  1.40it/s]
 21%|██▏       | 13934/65536 [2:36:14<10:18:46,  1.39it/s]
 21%|██▏       | 13935/65536 [2:36:15<10:03:09,  1.43it/s]
 21%|██▏       | 13936/65536 [2:36:15<9:48:51,  1.46it/s] 
 21%|██▏       | 13937/65536 [2:36:16<9:46:58,  1.47it/s]
 21%|██▏       | 13938/65536 [2:36:17<9:43:02,  1.47it/s]
 21%|██▏       | 13939/65536 [2:36:17<9:52:29,  1.45it/s]
 21%|██▏       | 13940/65536 [2:36:18<9:39:39,  1.48it/s]
                                                         
{'loss': 0.9359, 'learning_rate': 8.107322150116321e-07, 'epoch': 860.49}

 21%|██▏       | 13940/65536 [2:36:18<9:39:39,  1.48it/s]
 21%|██▏       | 13941/65536 [2:36:19<9:45:55,  1.47it/s]
 21%|██▏       | 13942/65536 [2:36:19<9:43:01,  1.47it/s]
 21%|██▏       | 13943/65536 [2:36:20<9:43:17,  1.47it/s]
 21%|██▏       | 13944/65536 [2:36:21<9:31:28,  1.50it/s]
 21%|██▏       | 13945/65536 [2:36:21<9:23:33,  1.53it/s]
 21%|██▏       | 13946/65536 [2:36:22<9:50:38,  1.46it/s]
 21%|██▏       | 13947/65536 [2:36:23<9:38:36,  1.49it/s]
 21%|██▏       | 13948/65536 [2:36:23<9:33:37,  1.50it/s]
 21%|██▏       | 13949/65536 [2:36:24<9:50:47,  1.46it/s]
 21%|██▏       | 13950/65536 [2:36:25<9:34:50,  1.50it/s]
 21%|██▏       | 13951/65536 [2:36:25<9:31:33,  1.50it/s]
 21%|██▏       | 13952/65536 [2:36:26<9:30:11,  1.51it/s]
 21%|██▏       | 13953/65536 [2:36:27<9:20:48,  1.53it/s]
 21%|██▏       | 13954/65536 [2:36:27<9:19:50,  1.54it/s]
 21%|██▏       | 13955/65536 [2:36:28<9:19:46,  1.54it/s]
 21%|██▏       | 13956/65536 [2:36:29<9:22:12,  1.53it/s]
 21%|██▏       | 13957/65536 [2:36:29<9:23:11,  1.53it/s]
 21%|██▏       | 13958/65536 [2:36:30<9:50:21,  1.46it/s]
 21%|██▏       | 13959/65536 [2:36:31<9:56:52,  1.44it/s]
 21%|██▏       | 13960/65536 [2:36:31<9:48:04,  1.46it/s]
                                                         
{'loss': 0.9507, 'learning_rate': 8.104567160524059e-07, 'epoch': 861.73}

 21%|██▏       | 13960/65536 [2:36:31<9:48:04,  1.46it/s]
 21%|██▏       | 13961/65536 [2:36:32<9:47:23,  1.46it/s]
 21%|██▏       | 13962/65536 [2:36:33<9:29:46,  1.51it/s]
 21%|██▏       | 13963/65536 [2:36:33<9:28:26,  1.51it/s]
 21%|██▏       | 13964/65536 [2:36:34<9:39:21,  1.48it/s]
 21%|██▏       | 13965/65536 [2:36:35<10:04:46,  1.42it/s]
 21%|██▏       | 13966/65536 [2:36:35<9:48:47,  1.46it/s] 
 21%|██▏       | 13967/65536 [2:36:36<9:54:15,  1.45it/s]
 21%|██▏       | 13968/65536 [2:36:37<9:57:31,  1.44it/s]
 21%|██▏       | 13969/65536 [2:36:37<9:40:52,  1.48it/s]
 21%|██▏       | 13970/65536 [2:36:38<9:29:36,  1.51it/s]
 21%|██▏       | 13971/65536 [2:36:39<9:22:42,  1.53it/s]
 21%|██▏       | 13972/65536 [2:36:39<9:25:27,  1.52it/s]
 21%|██▏       | 13973/65536 [2:36:40<9:15:18,  1.55it/s]
 21%|██▏       | 13974/65536 [2:36:41<9:32:18,  1.50it/s]
 21%|██▏       | 13975/65536 [2:36:41<9:39:35,  1.48it/s]
 21%|██▏       | 13976/65536 [2:36:42<9:39:28,  1.48it/s]
 21%|██▏       | 13977/65536 [2:36:43<9:30:30,  1.51it/s]
 21%|██▏       | 13978/65536 [2:36:43<9:31:40,  1.50it/s]
 21%|██▏       | 13979/65536 [2:36:44<9:36:32,  1.49it/s]
 21%|██▏       | 13980/65536 [2:36:45<9:35:47,  1.49it/s]
                                                         
{'loss': 0.9538, 'learning_rate': 8.101812170931799e-07, 'epoch': 862.96}

 21%|██▏       | 13980/65536 [2:36:45<9:35:47,  1.49it/s]
 21%|██▏       | 13981/65536 [2:36:46<9:58:39,  1.44it/s]
 21%|██▏       | 13982/65536 [2:36:46<9:58:24,  1.44it/s]
 21%|██▏       | 13983/65536 [2:36:47<9:48:38,  1.46it/s]
 21%|██▏       | 13984/65536 [2:36:48<9:48:26,  1.46it/s]
 21%|██▏       | 13985/65536 [2:36:48<9:47:26,  1.46it/s]
 21%|██▏       | 13986/65536 [2:36:49<9:45:22,  1.47it/s]
 21%|██▏       | 13987/65536 [2:36:50<9:33:26,  1.50it/s]
 21%|██▏       | 13988/65536 [2:36:50<9:37:21,  1.49it/s]
 21%|██▏       | 13989/65536 [2:36:51<9:25:07,  1.52it/s]
 21%|██▏       | 13990/65536 [2:36:52<9:22:18,  1.53it/s]
 21%|██▏       | 13991/65536 [2:36:52<9:35:10,  1.49it/s]
 21%|██▏       | 13992/65536 [2:36:53<9:37:20,  1.49it/s]
 21%|██▏       | 13993/65536 [2:36:54<9:24:00,  1.52it/s]
 21%|██▏       | 13994/65536 [2:36:54<9:29:16,  1.51it/s]
 21%|██▏       | 13995/65536 [2:36:55<9:34:33,  1.50it/s]
 21%|██▏       | 13996/65536 [2:36:56<9:32:15,  1.50it/s]
 21%|██▏       | 13997/65536 [2:36:56<10:04:19,  1.42it/s]
 21%|██▏       | 13998/65536 [2:36:57<9:59:45,  1.43it/s] 
 21%|██▏       | 13999/65536 [2:36:58<9:43:25,  1.47it/s]
 21%|██▏       | 14000/65536 [2:36:58<9:30:00,  1.51it/s]
                                                         
{'loss': 0.9557, 'learning_rate': 8.099057181339538e-07, 'epoch': 864.2}

 21%|██▏       | 14000/65536 [2:36:58<9:30:00,  1.51it/s]
 21%|██▏       | 14001/65536 [2:36:59<9:42:03,  1.48it/s]
 21%|██▏       | 14002/65536 [2:37:00<9:34:48,  1.49it/s]
 21%|██▏       | 14003/65536 [2:37:00<9:33:42,  1.50it/s]
 21%|██▏       | 14004/65536 [2:37:01<9:43:26,  1.47it/s]
 21%|██▏       | 14005/65536 [2:37:02<9:34:46,  1.49it/s]
 21%|██▏       | 14006/65536 [2:37:02<9:41:31,  1.48it/s]
 21%|██▏       | 14007/65536 [2:37:03<9:45:47,  1.47it/s]
 21%|██▏       | 14008/65536 [2:37:04<9:36:16,  1.49it/s]
 21%|██▏       | 14009/65536 [2:37:04<9:34:50,  1.49it/s]
 21%|██▏       | 14010/65536 [2:37:05<9:29:59,  1.51it/s]
 21%|██▏       | 14011/65536 [2:37:06<9:37:07,  1.49it/s]
 21%|██▏       | 14012/65536 [2:37:06<9:13:07,  1.55it/s]
 21%|██▏       | 14013/65536 [2:37:07<9:37:47,  1.49it/s]
 21%|██▏       | 14014/65536 [2:37:08<9:39:27,  1.48it/s]
 21%|██▏       | 14015/65536 [2:37:08<9:32:31,  1.50it/s]
 21%|██▏       | 14016/65536 [2:37:09<9:27:07,  1.51it/s]
 21%|██▏       | 14017/65536 [2:37:10<9:30:06,  1.51it/s]
 21%|██▏       | 14018/65536 [2:37:10<9:39:09,  1.48it/s]
 21%|██▏       | 14019/65536 [2:37:11<9:33:57,  1.50it/s]
 21%|██▏       | 14020/65536 [2:37:12<9:33:18,  1.50it/s]
                                                         
{'loss': 0.9464, 'learning_rate': 8.096302191747276e-07, 'epoch': 865.43}

 21%|██▏       | 14020/65536 [2:37:12<9:33:18,  1.50it/s]
 21%|██▏       | 14021/65536 [2:37:12<9:45:26,  1.47it/s]
 21%|██▏       | 14022/65536 [2:37:13<10:06:34,  1.42it/s]
 21%|██▏       | 14023/65536 [2:37:14<10:00:33,  1.43it/s]
 21%|██▏       | 14024/65536 [2:37:14<9:37:23,  1.49it/s] 
 21%|██▏       | 14025/65536 [2:37:15<9:50:36,  1.45it/s]
 21%|██▏       | 14026/65536 [2:37:16<9:49:32,  1.46it/s]
 21%|██▏       | 14027/65536 [2:37:17<9:40:51,  1.48it/s]
 21%|██▏       | 14028/65536 [2:37:17<9:45:23,  1.47it/s]
 21%|██▏       | 14029/65536 [2:37:18<9:38:45,  1.48it/s]
 21%|██▏       | 14030/65536 [2:37:19<10:01:25,  1.43it/s]
 21%|██▏       | 14031/65536 [2:37:19<9:47:12,  1.46it/s] 
 21%|██▏       | 14032/65536 [2:37:20<9:42:37,  1.47it/s]
 21%|██▏       | 14033/65536 [2:37:21<9:41:19,  1.48it/s]
 21%|██▏       | 14034/65536 [2:37:21<9:36:17,  1.49it/s]
 21%|██▏       | 14035/65536 [2:37:22<9:43:30,  1.47it/s]
 21%|██▏       | 14036/65536 [2:37:23<9:53:20,  1.45it/s]
 21%|██▏       | 14037/65536 [2:37:23<9:55:47,  1.44it/s]
 21%|██▏       | 14038/65536 [2:37:24<9:44:37,  1.47it/s]
 21%|██▏       | 14039/65536 [2:37:25<9:39:07,  1.48it/s]
 21%|██▏       | 14040/65536 [2:37:25<9:50:19,  1.45it/s]
                                                         
{'loss': 0.9056, 'learning_rate': 8.093547202155014e-07, 'epoch': 866.67}

 21%|██▏       | 14040/65536 [2:37:25<9:50:19,  1.45it/s]
 21%|██▏       | 14041/65536 [2:37:26<9:50:56,  1.45it/s]
 21%|██▏       | 14042/65536 [2:37:27<9:46:55,  1.46it/s]
 21%|██▏       | 14043/65536 [2:37:27<9:40:43,  1.48it/s]
 21%|██▏       | 14044/65536 [2:37:28<9:36:05,  1.49it/s]
 21%|██▏       | 14045/65536 [2:37:29<9:26:17,  1.52it/s]
 21%|██▏       | 14046/65536 [2:37:29<9:49:24,  1.46it/s]
 21%|██▏       | 14047/65536 [2:37:30<9:36:29,  1.49it/s]
 21%|██▏       | 14048/65536 [2:37:31<9:41:15,  1.48it/s]
 21%|██▏       | 14049/65536 [2:37:32<9:53:51,  1.44it/s]
 21%|██▏       | 14050/65536 [2:37:32<9:44:03,  1.47it/s]
 21%|██▏       | 14051/65536 [2:37:33<9:36:08,  1.49it/s]
 21%|██▏       | 14052/65536 [2:37:33<9:17:30,  1.54it/s]
 21%|██▏       | 14053/65536 [2:37:34<9:30:20,  1.50it/s]
 21%|██▏       | 14054/65536 [2:37:35<9:11:43,  1.56it/s]
 21%|██▏       | 14055/65536 [2:37:35<9:29:45,  1.51it/s]
 21%|██▏       | 14056/65536 [2:37:36<9:35:34,  1.49it/s]
 21%|██▏       | 14057/65536 [2:37:37<9:40:07,  1.48it/s]
 21%|██▏       | 14058/65536 [2:37:37<9:28:33,  1.51it/s]
 21%|██▏       | 14059/65536 [2:37:38<9:33:42,  1.50it/s]
 21%|██▏       | 14060/65536 [2:37:39<9:41:55,  1.47it/s]
                                                         
{'loss': 0.9608, 'learning_rate': 8.090792212562752e-07, 'epoch': 867.9}

 21%|██▏       | 14060/65536 [2:37:39<9:41:55,  1.47it/s]
 21%|██▏       | 14061/65536 [2:37:40<9:37:55,  1.48it/s]
 21%|██▏       | 14062/65536 [2:37:40<9:57:24,  1.44it/s]
 21%|██▏       | 14063/65536 [2:37:41<9:41:43,  1.47it/s]
 21%|██▏       | 14064/65536 [2:37:42<9:43:33,  1.47it/s]
 21%|██▏       | 14065/65536 [2:37:42<9:38:55,  1.48it/s]
 21%|██▏       | 14066/65536 [2:37:43<9:44:35,  1.47it/s]
 21%|██▏       | 14067/65536 [2:37:44<9:53:51,  1.44it/s]
 21%|██▏       | 14068/65536 [2:37:44<9:55:13,  1.44it/s]
 21%|██▏       | 14069/65536 [2:37:45<9:53:52,  1.44it/s]
 21%|██▏       | 14070/65536 [2:37:46<9:39:06,  1.48it/s]
 21%|██▏       | 14071/65536 [2:37:46<9:28:16,  1.51it/s]
 21%|██▏       | 14072/65536 [2:37:47<9:35:02,  1.49it/s]
 21%|██▏       | 14073/65536 [2:37:48<9:40:05,  1.48it/s]
 21%|██▏       | 14074/65536 [2:37:48<9:36:18,  1.49it/s]
 21%|██▏       | 14075/65536 [2:37:49<9:33:29,  1.50it/s]
 21%|██▏       | 14076/65536 [2:37:50<9:28:22,  1.51it/s]
 21%|██▏       | 14077/65536 [2:37:50<9:31:18,  1.50it/s]
 21%|██▏       | 14078/65536 [2:37:51<9:56:45,  1.44it/s]
 21%|██▏       | 14079/65536 [2:37:52<9:59:05,  1.43it/s]
 21%|██▏       | 14080/65536 [2:37:52<9:47:04,  1.46it/s]
                                                         
{'loss': 0.9297, 'learning_rate': 8.088037222970491e-07, 'epoch': 869.14}

 21%|██▏       | 14080/65536 [2:37:52<9:47:04,  1.46it/s]
 21%|██▏       | 14081/65536 [2:37:53<9:42:52,  1.47it/s]
 21%|██▏       | 14082/65536 [2:37:54<9:48:31,  1.46it/s]
 21%|██▏       | 14083/65536 [2:37:54<9:26:27,  1.51it/s]
 21%|██▏       | 14084/65536 [2:37:55<9:28:11,  1.51it/s]
 21%|██▏       | 14085/65536 [2:37:56<9:23:47,  1.52it/s]
 21%|██▏       | 14086/65536 [2:37:56<9:24:42,  1.52it/s]
 21%|██▏       | 14087/65536 [2:37:57<9:13:38,  1.55it/s]
 21%|██▏       | 14088/65536 [2:37:58<9:25:44,  1.52it/s]
 21%|██▏       | 14089/65536 [2:37:58<9:27:30,  1.51it/s]
 21%|██▏       | 14090/65536 [2:37:59<9:29:36,  1.51it/s]
 22%|██▏       | 14091/65536 [2:38:00<9:32:05,  1.50it/s]
 22%|██▏       | 14092/65536 [2:38:00<9:34:39,  1.49it/s]
 22%|██▏       | 14093/65536 [2:38:01<9:36:31,  1.49it/s]
 22%|██▏       | 14094/65536 [2:38:02<9:40:01,  1.48it/s]
 22%|██▏       | 14095/65536 [2:38:03<10:01:32,  1.43it/s]
 22%|██▏       | 14096/65536 [2:38:03<9:42:22,  1.47it/s] 
 22%|██▏       | 14097/65536 [2:38:04<9:54:02,  1.44it/s]
 22%|██▏       | 14098/65536 [2:38:05<9:41:48,  1.47it/s]
 22%|██▏       | 14099/65536 [2:38:05<9:35:33,  1.49it/s]
 22%|██▏       | 14100/65536 [2:38:06<9:50:57,  1.45it/s]
                                                         
{'loss': 0.9382, 'learning_rate': 8.08528223337823e-07, 'epoch': 870.37}

 22%|██▏       | 14100/65536 [2:38:06<9:50:57,  1.45it/s]
 22%|██▏       | 14101/65536 [2:38:07<9:29:36,  1.50it/s]
 22%|██▏       | 14102/65536 [2:38:07<9:46:32,  1.46it/s]
 22%|██▏       | 14103/65536 [2:38:08<9:44:57,  1.47it/s]
 22%|██▏       | 14104/65536 [2:38:09<9:23:39,  1.52it/s]
 22%|██▏       | 14105/65536 [2:38:09<9:18:52,  1.53it/s]
 22%|██▏       | 14106/65536 [2:38:10<9:11:12,  1.56it/s]
 22%|██▏       | 14107/65536 [2:38:10<9:24:53,  1.52it/s]
 22%|██▏       | 14108/65536 [2:38:11<9:21:59,  1.53it/s]
 22%|██▏       | 14109/65536 [2:38:12<9:35:21,  1.49it/s]
 22%|██▏       | 14110/65536 [2:38:13<9:38:31,  1.48it/s]
 22%|██▏       | 14111/65536 [2:38:13<9:52:19,  1.45it/s]
 22%|██▏       | 14112/65536 [2:38:14<9:46:19,  1.46it/s]
 22%|██▏       | 14113/65536 [2:38:15<9:48:06,  1.46it/s]
 22%|██▏       | 14114/65536 [2:38:15<9:53:41,  1.44it/s]
 22%|██▏       | 14115/65536 [2:38:16<9:40:45,  1.48it/s]
 22%|██▏       | 14116/65536 [2:38:17<9:39:33,  1.48it/s]
 22%|██▏       | 14117/65536 [2:38:17<9:35:35,  1.49it/s]
 22%|██▏       | 14118/65536 [2:38:18<9:41:33,  1.47it/s]
 22%|██▏       | 14119/65536 [2:38:19<9:38:46,  1.48it/s]
 22%|██▏       | 14120/65536 [2:38:19<9:51:12,  1.45it/s]
                                                         
{'loss': 0.9414, 'learning_rate': 8.082527243785968e-07, 'epoch': 871.6}

 22%|██▏       | 14120/65536 [2:38:19<9:51:12,  1.45it/s]
 22%|██▏       | 14121/65536 [2:38:20<9:56:38,  1.44it/s]
 22%|██▏       | 14122/65536 [2:38:21<9:54:58,  1.44it/s]
 22%|██▏       | 14123/65536 [2:38:21<9:48:26,  1.46it/s]
 22%|██▏       | 14124/65536 [2:38:22<9:44:02,  1.47it/s]
 22%|██▏       | 14125/65536 [2:38:23<9:39:07,  1.48it/s]
 22%|██▏       | 14126/65536 [2:38:23<9:36:58,  1.49it/s]
 22%|██▏       | 14127/65536 [2:38:24<9:58:04,  1.43it/s]
 22%|██▏       | 14128/65536 [2:38:25<9:48:25,  1.46it/s]
 22%|██▏       | 14129/65536 [2:38:26<9:41:48,  1.47it/s]
 22%|██▏       | 14130/65536 [2:38:26<9:57:21,  1.43it/s]
 22%|██▏       | 14131/65536 [2:38:27<9:41:07,  1.47it/s]
 22%|██▏       | 14132/65536 [2:38:28<9:29:47,  1.50it/s]
 22%|██▏       | 14133/65536 [2:38:28<9:38:53,  1.48it/s]
 22%|██▏       | 14134/65536 [2:38:29<9:29:43,  1.50it/s]
 22%|██▏       | 14135/65536 [2:38:30<9:25:26,  1.52it/s]
 22%|██▏       | 14136/65536 [2:38:30<9:20:59,  1.53it/s]
 22%|██▏       | 14137/65536 [2:38:31<9:36:07,  1.49it/s]
 22%|██▏       | 14138/65536 [2:38:31<9:21:19,  1.53it/s]
 22%|██▏       | 14139/65536 [2:38:32<9:39:27,  1.48it/s]
 22%|██▏       | 14140/65536 [2:38:33<9:49:00,  1.45it/s]
                                                         
{'loss': 0.9149, 'learning_rate': 8.079772254193706e-07, 'epoch': 872.84}

 22%|██▏       | 14140/65536 [2:38:33<9:49:00,  1.45it/s]
 22%|██▏       | 14141/65536 [2:38:34<9:41:47,  1.47it/s]
 22%|██▏       | 14142/65536 [2:38:34<9:47:59,  1.46it/s]
 22%|██▏       | 14143/65536 [2:38:35<10:03:48,  1.42it/s]
 22%|██▏       | 14144/65536 [2:38:36<9:54:26,  1.44it/s] 
 22%|██▏       | 14145/65536 [2:38:36<9:49:45,  1.45it/s]
 22%|██▏       | 14146/65536 [2:38:37<9:50:07,  1.45it/s]
 22%|██▏       | 14147/65536 [2:38:38<9:45:57,  1.46it/s]
 22%|██▏       | 14148/65536 [2:38:38<9:36:54,  1.48it/s]
 22%|██▏       | 14149/65536 [2:38:39<9:33:09,  1.49it/s]
 22%|██▏       | 14150/65536 [2:38:40<9:35:41,  1.49it/s]
 22%|██▏       | 14151/65536 [2:38:40<9:29:43,  1.50it/s]
 22%|██▏       | 14152/65536 [2:38:41<9:38:55,  1.48it/s]
 22%|██▏       | 14153/65536 [2:38:42<9:45:55,  1.46it/s]
 22%|██▏       | 14154/65536 [2:38:42<9:39:01,  1.48it/s]
 22%|██▏       | 14155/65536 [2:38:43<9:32:27,  1.50it/s]
 22%|██▏       | 14156/65536 [2:38:44<9:29:26,  1.50it/s]
 22%|██▏       | 14157/65536 [2:38:44<9:33:02,  1.49it/s]
 22%|██▏       | 14158/65536 [2:38:45<9:30:02,  1.50it/s]
 22%|██▏       | 14159/65536 [2:38:46<9:52:04,  1.45it/s]
 22%|██▏       | 14160/65536 [2:38:47<9:57:40,  1.43it/s]
                                                         
{'loss': 0.9278, 'learning_rate': 8.077017264601444e-07, 'epoch': 874.07}

 22%|██▏       | 14160/65536 [2:38:47<9:57:40,  1.43it/s]
 22%|██▏       | 14161/65536 [2:38:47<9:48:57,  1.45it/s]
 22%|██▏       | 14162/65536 [2:38:48<9:32:28,  1.50it/s]
 22%|██▏       | 14163/65536 [2:38:48<9:26:38,  1.51it/s]
 22%|██▏       | 14164/65536 [2:38:49<9:26:13,  1.51it/s]
 22%|██▏       | 14165/65536 [2:38:50<9:30:49,  1.50it/s]
 22%|██▏       | 14166/65536 [2:38:51<9:41:19,  1.47it/s]
 22%|██▏       | 14167/65536 [2:38:51<9:32:17,  1.50it/s]
 22%|██▏       | 14168/65536 [2:38:52<9:17:25,  1.54it/s]
 22%|██▏       | 14169/65536 [2:38:52<9:18:54,  1.53it/s]
 22%|██▏       | 14170/65536 [2:38:53<9:26:44,  1.51it/s]
 22%|██▏       | 14171/65536 [2:38:54<9:22:37,  1.52it/s]
 22%|██▏       | 14172/65536 [2:38:54<9:19:13,  1.53it/s]
 22%|██▏       | 14173/65536 [2:38:55<9:32:56,  1.49it/s]
 22%|██▏       | 14174/65536 [2:38:56<9:53:07,  1.44it/s]
 22%|██▏       | 14175/65536 [2:38:57<9:43:20,  1.47it/s]
 22%|██▏       | 14176/65536 [2:38:57<10:05:53,  1.41it/s]
 22%|██▏       | 14177/65536 [2:38:58<9:49:40,  1.45it/s] 
 22%|██▏       | 14178/65536 [2:38:59<9:54:18,  1.44it/s]
 22%|██▏       | 14179/65536 [2:38:59<9:54:37,  1.44it/s]
 22%|██▏       | 14180/65536 [2:39:00<9:53:58,  1.44it/s]
                                                         
{'loss': 0.9235, 'learning_rate': 8.074262275009183e-07, 'epoch': 875.31}

 22%|██▏       | 14180/65536 [2:39:00<9:53:58,  1.44it/s]
 22%|██▏       | 14181/65536 [2:39:01<9:46:08,  1.46it/s]
 22%|██▏       | 14182/65536 [2:39:01<9:33:25,  1.49it/s]
 22%|██▏       | 14183/65536 [2:39:02<9:25:04,  1.51it/s]
 22%|██▏       | 14184/65536 [2:39:03<9:27:05,  1.51it/s]
 22%|██▏       | 14185/65536 [2:39:03<9:38:37,  1.48it/s]
 22%|██▏       | 14186/65536 [2:39:04<9:33:09,  1.49it/s]
 22%|██▏       | 14187/65536 [2:39:05<9:50:39,  1.45it/s]
 22%|██▏       | 14188/65536 [2:39:05<9:30:52,  1.50it/s]
 22%|██▏       | 14189/65536 [2:39:06<9:18:38,  1.53it/s]
 22%|██▏       | 14190/65536 [2:39:07<9:20:24,  1.53it/s]
 22%|██▏       | 14191/65536 [2:39:07<9:22:47,  1.52it/s]
 22%|██▏       | 14192/65536 [2:39:08<10:03:56,  1.42it/s]
 22%|██▏       | 14193/65536 [2:39:09<9:48:38,  1.45it/s] 
 22%|██▏       | 14194/65536 [2:39:09<9:54:35,  1.44it/s]
 22%|██▏       | 14195/65536 [2:39:10<9:37:10,  1.48it/s]
 22%|██▏       | 14196/65536 [2:39:11<9:38:21,  1.48it/s]
 22%|██▏       | 14197/65536 [2:39:11<9:19:39,  1.53it/s]
 22%|██▏       | 14198/65536 [2:39:12<9:24:10,  1.52it/s]
 22%|██▏       | 14199/65536 [2:39:13<9:24:49,  1.51it/s]
 22%|██▏       | 14200/65536 [2:39:13<9:21:52,  1.52it/s]
                                                         
{'loss': 0.952, 'learning_rate': 8.071507285416921e-07, 'epoch': 876.54}

 22%|██▏       | 14200/65536 [2:39:13<9:21:52,  1.52it/s]
 22%|██▏       | 14201/65536 [2:39:14<9:17:05,  1.54it/s]
 22%|██▏       | 14202/65536 [2:39:15<9:22:45,  1.52it/s]
 22%|██▏       | 14203/65536 [2:39:15<9:46:30,  1.46it/s]
 22%|██▏       | 14204/65536 [2:39:16<9:39:54,  1.48it/s]
 22%|██▏       | 14205/65536 [2:39:17<9:44:30,  1.46it/s]
 22%|██▏       | 14206/65536 [2:39:17<9:36:32,  1.48it/s]
 22%|██▏       | 14207/65536 [2:39:18<9:30:52,  1.50it/s]
 22%|██▏       | 14208/65536 [2:39:19<9:55:25,  1.44it/s]
 22%|██▏       | 14209/65536 [2:39:19<9:44:48,  1.46it/s]
 22%|██▏       | 14210/65536 [2:39:20<9:44:33,  1.46it/s]
 22%|██▏       | 14211/65536 [2:39:21<9:47:14,  1.46it/s]
 22%|██▏       | 14212/65536 [2:39:22<9:52:16,  1.44it/s]
 22%|██▏       | 14213/65536 [2:39:22<9:36:58,  1.48it/s]
 22%|██▏       | 14214/65536 [2:39:23<9:44:47,  1.46it/s]
 22%|██▏       | 14215/65536 [2:39:24<9:37:20,  1.48it/s]
 22%|██▏       | 14216/65536 [2:39:24<9:46:56,  1.46it/s]
 22%|██▏       | 14217/65536 [2:39:25<9:37:14,  1.48it/s]
 22%|██▏       | 14218/65536 [2:39:26<9:30:35,  1.50it/s]
 22%|██▏       | 14219/65536 [2:39:26<9:43:57,  1.46it/s]
 22%|██▏       | 14220/65536 [2:39:27<9:19:52,  1.53it/s]
                                                         
{'loss': 0.9238, 'learning_rate': 8.06875229582466e-07, 'epoch': 877.78}

 22%|██▏       | 14220/65536 [2:39:27<9:19:52,  1.53it/s]
 22%|██▏       | 14221/65536 [2:39:28<9:23:58,  1.52it/s]
 22%|██▏       | 14222/65536 [2:39:28<9:18:18,  1.53it/s]
 22%|██▏       | 14223/65536 [2:39:29<9:13:19,  1.55it/s]
 22%|██▏       | 14224/65536 [2:39:30<9:33:15,  1.49it/s]
 22%|██▏       | 14225/65536 [2:39:30<9:28:09,  1.51it/s]
 22%|██▏       | 14226/65536 [2:39:31<9:40:06,  1.47it/s]
 22%|██▏       | 14227/65536 [2:39:32<9:22:19,  1.52it/s]
 22%|██▏       | 14228/65536 [2:39:32<9:28:39,  1.50it/s]
 22%|██▏       | 14229/65536 [2:39:33<9:24:29,  1.51it/s]
 22%|██▏       | 14230/65536 [2:39:34<9:33:49,  1.49it/s]
 22%|██▏       | 14231/65536 [2:39:34<9:24:20,  1.52it/s]
 22%|██▏       | 14232/65536 [2:39:35<9:13:04,  1.55it/s]
 22%|██▏       | 14233/65536 [2:39:35<9:16:21,  1.54it/s]
 22%|██▏       | 14234/65536 [2:39:36<9:29:46,  1.50it/s]
 22%|██▏       | 14235/65536 [2:39:37<9:22:39,  1.52it/s]
 22%|██▏       | 14236/65536 [2:39:38<9:33:10,  1.49it/s]
 22%|██▏       | 14237/65536 [2:39:38<9:21:29,  1.52it/s]
 22%|██▏       | 14238/65536 [2:39:39<9:29:00,  1.50it/s]
 22%|██▏       | 14239/65536 [2:39:39<9:29:22,  1.50it/s]
 22%|██▏       | 14240/65536 [2:39:40<9:57:51,  1.43it/s]
                                                         
{'loss': 0.9389, 'learning_rate': 8.065997306232399e-07, 'epoch': 879.01}

 22%|██▏       | 14240/65536 [2:39:40<9:57:51,  1.43it/s]
 22%|██▏       | 14241/65536 [2:39:41<9:52:40,  1.44it/s]
 22%|██▏       | 14242/65536 [2:39:42<10:00:43,  1.42it/s]
 22%|██▏       | 14243/65536 [2:39:42<9:50:02,  1.45it/s] 
 22%|██▏       | 14244/65536 [2:39:43<9:44:03,  1.46it/s]
 22%|██▏       | 14245/65536 [2:39:44<9:46:25,  1.46it/s]
 22%|██▏       | 14246/65536 [2:39:44<9:42:25,  1.47it/s]
 22%|██▏       | 14247/65536 [2:39:45<9:56:05,  1.43it/s]
 22%|██▏       | 14248/65536 [2:39:46<9:41:06,  1.47it/s]
 22%|██▏       | 14249/65536 [2:39:46<9:32:52,  1.49it/s]
 22%|██▏       | 14250/65536 [2:39:47<9:38:39,  1.48it/s]
 22%|██▏       | 14251/65536 [2:39:48<9:25:12,  1.51it/s]
 22%|██▏       | 14252/65536 [2:39:48<9:21:23,  1.52it/s]
 22%|██▏       | 14253/65536 [2:39:49<9:19:35,  1.53it/s]
 22%|██▏       | 14254/65536 [2:39:50<9:21:17,  1.52it/s]
 22%|██▏       | 14255/65536 [2:39:50<9:26:20,  1.51it/s]
 22%|██▏       | 14256/65536 [2:39:51<9:33:44,  1.49it/s]
 22%|██▏       | 14257/65536 [2:39:52<9:44:12,  1.46it/s]
 22%|██▏       | 14258/65536 [2:39:52<9:34:38,  1.49it/s]
 22%|██▏       | 14259/65536 [2:39:53<9:27:50,  1.51it/s]
 22%|██▏       | 14260/65536 [2:39:54<9:10:39,  1.55it/s]
                                                         
{'loss': 0.9386, 'learning_rate': 8.063242316640137e-07, 'epoch': 880.25}

 22%|██▏       | 14260/65536 [2:39:54<9:10:39,  1.55it/s]
 22%|██▏       | 14261/65536 [2:39:54<9:09:33,  1.56it/s]
 22%|██▏       | 14262/65536 [2:39:55<9:17:40,  1.53it/s]
 22%|██▏       | 14263/65536 [2:39:56<9:20:22,  1.52it/s]
 22%|██▏       | 14264/65536 [2:39:56<9:18:31,  1.53it/s]
 22%|██▏       | 14265/65536 [2:39:57<9:20:54,  1.52it/s]
 22%|██▏       | 14266/65536 [2:39:58<9:31:15,  1.50it/s]
 22%|██▏       | 14267/65536 [2:39:58<9:36:31,  1.48it/s]
 22%|██▏       | 14268/65536 [2:39:59<9:32:02,  1.49it/s]
 22%|██▏       | 14269/65536 [2:40:00<9:53:37,  1.44it/s]
 22%|██▏       | 14270/65536 [2:40:00<9:49:07,  1.45it/s]
 22%|██▏       | 14271/65536 [2:40:01<9:32:57,  1.49it/s]
 22%|██▏       | 14272/65536 [2:40:02<9:33:58,  1.49it/s]
 22%|██▏       | 14273/65536 [2:40:02<10:02:28,  1.42it/s]
 22%|██▏       | 14274/65536 [2:40:03<9:47:16,  1.45it/s] 
 22%|██▏       | 14275/65536 [2:40:04<9:43:17,  1.46it/s]
 22%|██▏       | 14276/65536 [2:40:04<9:43:48,  1.46it/s]
 22%|██▏       | 14277/65536 [2:40:05<9:40:15,  1.47it/s]
 22%|██▏       | 14278/65536 [2:40:06<9:32:17,  1.49it/s]
 22%|██▏       | 14279/65536 [2:40:06<9:36:04,  1.48it/s]
 22%|██▏       | 14280/65536 [2:40:07<9:33:56,  1.49it/s]
                                                         
{'loss': 0.9533, 'learning_rate': 8.060487327047876e-07, 'epoch': 881.48}

 22%|██▏       | 14280/65536 [2:40:07<9:33:56,  1.49it/s]
 22%|██▏       | 14281/65536 [2:40:08<9:43:54,  1.46it/s]
 22%|██▏       | 14282/65536 [2:40:09<9:38:35,  1.48it/s]
 22%|██▏       | 14283/65536 [2:40:09<9:28:07,  1.50it/s]
 22%|██▏       | 14284/65536 [2:40:10<9:26:57,  1.51it/s]
 22%|██▏       | 14285/65536 [2:40:10<9:25:47,  1.51it/s]
 22%|██▏       | 14286/65536 [2:40:11<9:27:29,  1.51it/s]
 22%|██▏       | 14287/65536 [2:40:12<9:23:03,  1.52it/s]
 22%|██▏       | 14288/65536 [2:40:12<9:17:53,  1.53it/s]
 22%|██▏       | 14289/65536 [2:40:13<9:46:50,  1.46it/s]
 22%|██▏       | 14290/65536 [2:40:14<9:32:08,  1.49it/s]
 22%|██▏       | 14291/65536 [2:40:14<9:19:42,  1.53it/s]
 22%|██▏       | 14292/65536 [2:40:15<9:22:43,  1.52it/s]
 22%|██▏       | 14293/65536 [2:40:16<9:20:41,  1.52it/s]
 22%|██▏       | 14294/65536 [2:40:17<9:43:50,  1.46it/s]
 22%|██▏       | 14295/65536 [2:40:17<9:39:00,  1.47it/s]
 22%|██▏       | 14296/65536 [2:40:18<9:31:04,  1.50it/s]
 22%|██▏       | 14297/65536 [2:40:18<9:28:18,  1.50it/s]
 22%|██▏       | 14298/65536 [2:40:19<9:30:19,  1.50it/s]
 22%|██▏       | 14299/65536 [2:40:20<9:40:02,  1.47it/s]
 22%|██▏       | 14300/65536 [2:40:21<9:55:55,  1.43it/s]
                                                         
{'loss': 0.9207, 'learning_rate': 8.057732337455613e-07, 'epoch': 882.72}

 22%|██▏       | 14300/65536 [2:40:21<9:55:55,  1.43it/s]
 22%|██▏       | 14301/65536 [2:40:21<9:35:43,  1.48it/s]
 22%|██▏       | 14302/65536 [2:40:22<9:35:24,  1.48it/s]
 22%|██▏       | 14303/65536 [2:40:23<9:44:49,  1.46it/s]
 22%|██▏       | 14304/65536 [2:40:23<9:30:22,  1.50it/s]
 22%|██▏       | 14305/65536 [2:40:24<9:53:24,  1.44it/s]
 22%|██▏       | 14306/65536 [2:40:25<9:48:17,  1.45it/s]
 22%|██▏       | 14307/65536 [2:40:25<9:35:28,  1.48it/s]
 22%|██▏       | 14308/65536 [2:40:26<9:42:25,  1.47it/s]
 22%|██▏       | 14309/65536 [2:40:27<9:51:08,  1.44it/s]
 22%|██▏       | 14310/65536 [2:40:27<9:55:12,  1.43it/s]
 22%|██▏       | 14311/65536 [2:40:28<9:35:58,  1.48it/s]
 22%|██▏       | 14312/65536 [2:40:29<9:25:01,  1.51it/s]
 22%|██▏       | 14313/65536 [2:40:29<9:24:31,  1.51it/s]
 22%|██▏       | 14314/65536 [2:40:30<9:12:39,  1.54it/s]
 22%|██▏       | 14315/65536 [2:40:31<9:20:29,  1.52it/s]
 22%|██▏       | 14316/65536 [2:40:31<9:34:34,  1.49it/s]
 22%|██▏       | 14317/65536 [2:40:32<9:36:13,  1.48it/s]
 22%|██▏       | 14318/65536 [2:40:33<9:33:35,  1.49it/s]
 22%|██▏       | 14319/65536 [2:40:33<9:36:28,  1.48it/s]
 22%|██▏       | 14320/65536 [2:40:34<9:28:39,  1.50it/s]
                                                         
{'loss': 0.9379, 'learning_rate': 8.054977347863352e-07, 'epoch': 883.95}

 22%|██▏       | 14320/65536 [2:40:34<9:28:39,  1.50it/s]
 22%|██▏       | 14321/65536 [2:40:35<9:46:51,  1.45it/s]
 22%|██▏       | 14322/65536 [2:40:35<9:39:03,  1.47it/s]
 22%|██▏       | 14323/65536 [2:40:36<9:26:39,  1.51it/s]
 22%|██▏       | 14324/65536 [2:40:37<9:21:09,  1.52it/s]
 22%|██▏       | 14325/65536 [2:40:37<9:18:21,  1.53it/s]
 22%|██▏       | 14326/65536 [2:40:38<9:29:06,  1.50it/s]
 22%|██▏       | 14327/65536 [2:40:39<9:33:28,  1.49it/s]
 22%|██▏       | 14328/65536 [2:40:39<9:31:19,  1.49it/s]
 22%|██▏       | 14329/65536 [2:40:40<9:24:06,  1.51it/s]
 22%|██▏       | 14330/65536 [2:40:41<9:36:12,  1.48it/s]
 22%|██▏       | 14331/65536 [2:40:41<9:31:20,  1.49it/s]
 22%|██▏       | 14332/65536 [2:40:42<9:43:11,  1.46it/s]
 22%|██▏       | 14333/65536 [2:40:43<9:42:48,  1.46it/s]
 22%|██▏       | 14334/65536 [2:40:43<9:44:59,  1.46it/s]
 22%|██▏       | 14335/65536 [2:40:44<9:26:23,  1.51it/s]
 22%|██▏       | 14336/65536 [2:40:45<9:21:06,  1.52it/s]
 22%|██▏       | 14337/65536 [2:40:45<9:42:38,  1.46it/s]
 22%|██▏       | 14338/65536 [2:40:46<9:54:34,  1.44it/s]
 22%|██▏       | 14339/65536 [2:40:47<9:46:19,  1.46it/s]
 22%|██▏       | 14340/65536 [2:40:48<9:45:17,  1.46it/s]
                                                         
{'loss': 0.9324, 'learning_rate': 8.05222235827109e-07, 'epoch': 885.19}

 22%|██▏       | 14340/65536 [2:40:48<9:45:17,  1.46it/s]
 22%|██▏       | 14341/65536 [2:40:48<9:40:44,  1.47it/s]
 22%|██▏       | 14342/65536 [2:40:49<9:41:48,  1.47it/s]
 22%|██▏       | 14343/65536 [2:40:50<9:38:28,  1.47it/s]
 22%|██▏       | 14344/65536 [2:40:50<9:40:46,  1.47it/s]
 22%|██▏       | 14345/65536 [2:40:51<9:26:58,  1.50it/s]
 22%|██▏       | 14346/65536 [2:40:52<9:29:57,  1.50it/s]
 22%|██▏       | 14347/65536 [2:40:52<9:22:12,  1.52it/s]
 22%|██▏       | 14348/65536 [2:40:53<9:31:32,  1.49it/s]
 22%|██▏       | 14349/65536 [2:40:54<9:50:00,  1.45it/s]
 22%|██▏       | 14350/65536 [2:40:54<9:42:45,  1.46it/s]
 22%|██▏       | 14351/65536 [2:40:55<9:37:20,  1.48it/s]
 22%|██▏       | 14352/65536 [2:40:56<9:25:07,  1.51it/s]
 22%|██▏       | 14353/65536 [2:40:56<9:37:09,  1.48it/s]
 22%|██▏       | 14354/65536 [2:40:57<9:55:19,  1.43it/s]
 22%|██▏       | 14355/65536 [2:40:58<9:44:19,  1.46it/s]
 22%|██▏       | 14356/65536 [2:40:58<9:37:22,  1.48it/s]
 22%|██▏       | 14357/65536 [2:40:59<9:40:03,  1.47it/s]
 22%|██▏       | 14358/65536 [2:41:00<9:51:41,  1.44it/s]
 22%|██▏       | 14359/65536 [2:41:00<9:38:32,  1.47it/s]
 22%|██▏       | 14360/65536 [2:41:01<9:41:08,  1.47it/s]
                                                         
{'loss': 0.9148, 'learning_rate': 8.049467368678829e-07, 'epoch': 886.42}

 22%|██▏       | 14360/65536 [2:41:01<9:41:08,  1.47it/s]
 22%|██▏       | 14361/65536 [2:41:02<9:41:48,  1.47it/s]
 22%|██▏       | 14362/65536 [2:41:02<9:28:51,  1.50it/s]
 22%|██▏       | 14363/65536 [2:41:03<9:24:43,  1.51it/s]
 22%|██▏       | 14364/65536 [2:41:04<9:19:39,  1.52it/s]
 22%|██▏       | 14365/65536 [2:41:04<9:22:33,  1.52it/s]
 22%|██▏       | 14366/65536 [2:41:05<9:26:42,  1.50it/s]
 22%|██▏       | 14367/65536 [2:41:06<9:40:23,  1.47it/s]
 22%|██▏       | 14368/65536 [2:41:06<9:44:29,  1.46it/s]
 22%|██▏       | 14369/65536 [2:41:07<9:31:16,  1.49it/s]
 22%|██▏       | 14370/65536 [2:41:08<9:52:04,  1.44it/s]
 22%|██▏       | 14371/65536 [2:41:09<9:46:53,  1.45it/s]
 22%|██▏       | 14372/65536 [2:41:09<9:39:04,  1.47it/s]
 22%|██▏       | 14373/65536 [2:41:10<9:44:37,  1.46it/s]
 22%|██▏       | 14374/65536 [2:41:11<9:39:47,  1.47it/s]
 22%|██▏       | 14375/65536 [2:41:11<9:38:02,  1.48it/s]
 22%|██▏       | 14376/65536 [2:41:12<9:35:27,  1.48it/s]
 22%|██▏       | 14377/65536 [2:41:13<9:39:11,  1.47it/s]
 22%|██▏       | 14378/65536 [2:41:13<9:25:44,  1.51it/s]
 22%|██▏       | 14379/65536 [2:41:14<9:29:47,  1.50it/s]
 22%|██▏       | 14380/65536 [2:41:15<9:18:10,  1.53it/s]
                                                         
{'loss': 0.9427, 'learning_rate': 8.046712379086568e-07, 'epoch': 887.65}

 22%|██▏       | 14380/65536 [2:41:15<9:18:10,  1.53it/s]
 22%|██▏       | 14381/65536 [2:41:15<9:24:25,  1.51it/s]
 22%|██▏       | 14382/65536 [2:41:16<9:23:54,  1.51it/s]
 22%|██▏       | 14383/65536 [2:41:17<9:23:24,  1.51it/s]
 22%|██▏       | 14384/65536 [2:41:17<9:10:18,  1.55it/s]
 22%|██▏       | 14385/65536 [2:41:18<9:24:52,  1.51it/s]
 22%|██▏       | 14386/65536 [2:41:19<9:36:47,  1.48it/s]
 22%|██▏       | 14387/65536 [2:41:19<9:32:11,  1.49it/s]
 22%|██▏       | 14388/65536 [2:41:20<9:32:19,  1.49it/s]
 22%|██▏       | 14389/65536 [2:41:21<9:34:27,  1.48it/s]
 22%|██▏       | 14390/65536 [2:41:21<9:19:24,  1.52it/s]
 22%|██▏       | 14391/65536 [2:41:22<9:29:33,  1.50it/s]
 22%|██▏       | 14392/65536 [2:41:22<9:08:54,  1.55it/s]
 22%|██▏       | 14393/65536 [2:41:23<9:10:56,  1.55it/s]
 22%|██▏       | 14394/65536 [2:41:24<9:15:29,  1.53it/s]
 22%|██▏       | 14395/65536 [2:41:24<9:20:09,  1.52it/s]
 22%|██▏       | 14396/65536 [2:41:25<9:44:14,  1.46it/s]
 22%|██▏       | 14397/65536 [2:41:26<9:33:05,  1.49it/s]
 22%|██▏       | 14398/65536 [2:41:26<9:33:03,  1.49it/s]
 22%|██▏       | 14399/65536 [2:41:27<9:44:36,  1.46it/s]
 22%|██▏       | 14400/65536 [2:41:28<9:46:49,  1.45it/s]
                                                         
{'loss': 0.9237, 'learning_rate': 8.043957389494306e-07, 'epoch': 888.89}

 22%|██▏       | 14400/65536 [2:41:28<9:46:49,  1.45it/s]
 22%|██▏       | 14401/65536 [2:41:29<9:47:38,  1.45it/s]
 22%|██▏       | 14402/65536 [2:41:29<9:59:15,  1.42it/s]
 22%|██▏       | 14403/65536 [2:41:30<9:41:03,  1.47it/s]
 22%|██▏       | 14404/65536 [2:41:31<9:38:24,  1.47it/s]
 22%|██▏       | 14405/65536 [2:41:31<9:55:06,  1.43it/s]
 22%|██▏       | 14406/65536 [2:41:32<9:47:21,  1.45it/s]
 22%|██▏       | 14407/65536 [2:41:33<9:35:49,  1.48it/s]
 22%|██▏       | 14408/65536 [2:41:33<9:41:11,  1.47it/s]
 22%|██▏       | 14409/65536 [2:41:34<9:21:53,  1.52it/s]
 22%|██▏       | 14410/65536 [2:41:35<9:25:02,  1.51it/s]
 22%|██▏       | 14411/65536 [2:41:35<9:40:12,  1.47it/s]
 22%|██▏       | 14412/65536 [2:41:36<9:49:15,  1.45it/s]
 22%|██▏       | 14413/65536 [2:41:37<9:33:01,  1.49it/s]
 22%|██▏       | 14414/65536 [2:41:37<9:54:04,  1.43it/s]
 22%|██▏       | 14415/65536 [2:41:38<9:49:36,  1.45it/s]
 22%|██▏       | 14416/65536 [2:41:39<9:36:27,  1.48it/s]
 22%|██▏       | 14417/65536 [2:41:39<9:31:44,  1.49it/s]
 22%|██▏       | 14418/65536 [2:41:40<9:26:23,  1.50it/s]
 22%|██▏       | 14419/65536 [2:41:41<9:46:25,  1.45it/s]
 22%|██▏       | 14420/65536 [2:41:42<9:36:03,  1.48it/s]
                                                         
{'loss': 0.9222, 'learning_rate': 8.041202399902044e-07, 'epoch': 890.12}

 22%|██▏       | 14420/65536 [2:41:42<9:36:03,  1.48it/s]
 22%|██▏       | 14421/65536 [2:41:42<9:33:56,  1.48it/s]
 22%|██▏       | 14422/65536 [2:41:43<9:43:47,  1.46it/s]
 22%|██▏       | 14423/65536 [2:41:44<9:30:26,  1.49it/s]
 22%|██▏       | 14424/65536 [2:41:44<9:31:09,  1.49it/s]
 22%|██▏       | 14425/65536 [2:41:45<9:24:33,  1.51it/s]
 22%|██▏       | 14426/65536 [2:41:45<9:08:10,  1.55it/s]
 22%|██▏       | 14427/65536 [2:41:46<9:16:53,  1.53it/s]
 22%|██▏       | 14428/65536 [2:41:47<9:12:07,  1.54it/s]
 22%|██▏       | 14429/65536 [2:41:47<9:20:01,  1.52it/s]
 22%|██▏       | 14430/65536 [2:41:48<9:30:01,  1.49it/s]
 22%|██▏       | 14431/65536 [2:41:49<9:35:52,  1.48it/s]
 22%|██▏       | 14432/65536 [2:41:49<9:23:47,  1.51it/s]
 22%|██▏       | 14433/65536 [2:41:50<9:27:44,  1.50it/s]
 22%|██▏       | 14434/65536 [2:41:51<9:39:05,  1.47it/s]
 22%|██▏       | 14435/65536 [2:41:52<10:08:09,  1.40it/s]
 22%|██▏       | 14436/65536 [2:41:52<9:57:09,  1.43it/s] 
 22%|██▏       | 14437/65536 [2:41:53<9:55:01,  1.43it/s]
 22%|██▏       | 14438/65536 [2:41:54<9:35:24,  1.48it/s]
 22%|██▏       | 14439/65536 [2:41:54<9:23:54,  1.51it/s]
 22%|██▏       | 14440/65536 [2:41:55<9:25:04,  1.51it/s]
                                                         
{'loss': 0.9295, 'learning_rate': 8.038447410309782e-07, 'epoch': 891.36}

 22%|██▏       | 14440/65536 [2:41:55<9:25:04,  1.51it/s]
 22%|██▏       | 14441/65536 [2:41:56<9:30:13,  1.49it/s]
 22%|██▏       | 14442/65536 [2:41:56<9:15:49,  1.53it/s]
 22%|██▏       | 14443/65536 [2:41:57<9:30:53,  1.49it/s]
 22%|██▏       | 14444/65536 [2:41:58<9:36:14,  1.48it/s]
 22%|██▏       | 14445/65536 [2:41:58<9:31:06,  1.49it/s]
 22%|██▏       | 14446/65536 [2:41:59<9:30:33,  1.49it/s]
 22%|██▏       | 14447/65536 [2:42:00<9:39:41,  1.47it/s]
 22%|██▏       | 14448/65536 [2:42:00<9:29:36,  1.49it/s]
 22%|██▏       | 14449/65536 [2:42:01<9:33:19,  1.49it/s]
 22%|██▏       | 14450/65536 [2:42:02<9:19:25,  1.52it/s]
 22%|██▏       | 14451/65536 [2:42:02<9:42:38,  1.46it/s]
 22%|██▏       | 14452/65536 [2:42:03<9:34:26,  1.48it/s]
 22%|██▏       | 14453/65536 [2:42:04<9:36:19,  1.48it/s]
 22%|██▏       | 14454/65536 [2:42:04<9:47:35,  1.45it/s]
 22%|██▏       | 14455/65536 [2:42:05<10:00:10,  1.42it/s]
 22%|██▏       | 14456/65536 [2:42:06<9:41:23,  1.46it/s] 
 22%|██▏       | 14457/65536 [2:42:06<9:23:07,  1.51it/s]
 22%|██▏       | 14458/65536 [2:42:07<9:19:12,  1.52it/s]
 22%|██▏       | 14459/65536 [2:42:08<9:26:11,  1.50it/s]
 22%|██▏       | 14460/65536 [2:42:08<9:35:47,  1.48it/s]
                                                         
{'loss': 0.9156, 'learning_rate': 8.035692420717521e-07, 'epoch': 892.59}

 22%|██▏       | 14460/65536 [2:42:08<9:35:47,  1.48it/s]
 22%|██▏       | 14461/65536 [2:42:09<9:38:19,  1.47it/s]
 22%|██▏       | 14462/65536 [2:42:10<9:36:51,  1.48it/s]
 22%|██▏       | 14463/65536 [2:42:10<9:32:02,  1.49it/s]
 22%|██▏       | 14464/65536 [2:42:11<9:28:05,  1.50it/s]
 22%|██▏       | 14465/65536 [2:42:12<9:22:26,  1.51it/s]
 22%|██▏       | 14466/65536 [2:42:12<9:30:44,  1.49it/s]
 22%|██▏       | 14467/65536 [2:42:13<9:46:17,  1.45it/s]
 22%|██▏       | 14468/65536 [2:42:14<9:46:21,  1.45it/s]
 22%|██▏       | 14469/65536 [2:42:15<9:37:56,  1.47it/s]
 22%|██▏       | 14470/65536 [2:42:15<9:25:46,  1.50it/s]
 22%|██▏       | 14471/65536 [2:42:16<9:21:33,  1.52it/s]
 22%|██▏       | 14472/65536 [2:42:16<9:36:11,  1.48it/s]
 22%|██▏       | 14473/65536 [2:42:17<9:29:30,  1.49it/s]
 22%|██▏       | 14474/65536 [2:42:18<9:45:24,  1.45it/s]
 22%|██▏       | 14475/65536 [2:42:19<9:44:33,  1.46it/s]
 22%|██▏       | 14476/65536 [2:42:19<9:37:54,  1.47it/s]
 22%|██▏       | 14477/65536 [2:42:20<9:31:44,  1.49it/s]
 22%|██▏       | 14478/65536 [2:42:21<9:49:37,  1.44it/s]
 22%|██▏       | 14479/65536 [2:42:21<9:38:38,  1.47it/s]
 22%|██▏       | 14480/65536 [2:42:22<9:38:07,  1.47it/s]
                                                         
{'loss': 0.907, 'learning_rate': 8.03293743112526e-07, 'epoch': 893.83}

 22%|██▏       | 14480/65536 [2:42:22<9:38:07,  1.47it/s]
 22%|██▏       | 14481/65536 [2:42:23<9:29:21,  1.49it/s]
 22%|██▏       | 14482/65536 [2:42:23<9:32:09,  1.49it/s]
 22%|██▏       | 14483/65536 [2:42:24<9:39:51,  1.47it/s]
 22%|██▏       | 14484/65536 [2:42:25<9:33:02,  1.48it/s]
 22%|██▏       | 14485/65536 [2:42:25<9:46:27,  1.45it/s]
 22%|██▏       | 14486/65536 [2:42:26<9:54:08,  1.43it/s]
 22%|██▏       | 14487/65536 [2:42:27<9:40:23,  1.47it/s]
 22%|██▏       | 14488/65536 [2:42:27<9:29:32,  1.49it/s]
 22%|██▏       | 14489/65536 [2:42:28<9:22:21,  1.51it/s]
 22%|██▏       | 14490/65536 [2:42:29<9:24:07,  1.51it/s]
 22%|██▏       | 14491/65536 [2:42:29<9:37:22,  1.47it/s]
 22%|██▏       | 14492/65536 [2:42:30<9:41:07,  1.46it/s]
 22%|██▏       | 14493/65536 [2:42:31<9:48:25,  1.45it/s]
 22%|██▏       | 14494/65536 [2:42:31<9:37:27,  1.47it/s]
 22%|██▏       | 14495/65536 [2:42:32<9:31:17,  1.49it/s]
 22%|██▏       | 14496/65536 [2:42:33<9:28:39,  1.50it/s]
 22%|██▏       | 14497/65536 [2:42:33<9:23:14,  1.51it/s]
 22%|██▏       | 14498/65536 [2:42:34<9:10:40,  1.54it/s]
 22%|██▏       | 14499/65536 [2:42:35<9:15:16,  1.53it/s]
 22%|██▏       | 14500/65536 [2:42:36<10:07:59,  1.40it/s]
                                                          
{'loss': 0.9386, 'learning_rate': 8.030182441532998e-07, 'epoch': 895.06}

 22%|██▏       | 14500/65536 [2:42:36<10:07:59,  1.40it/s]
 22%|██▏       | 14501/65536 [2:42:36<9:47:04,  1.45it/s] 
 22%|██▏       | 14502/65536 [2:42:37<9:29:19,  1.49it/s]
 22%|██▏       | 14503/65536 [2:42:37<9:19:44,  1.52it/s]
 22%|██▏       | 14504/65536 [2:42:38<9:19:07,  1.52it/s]
 22%|██▏       | 14505/65536 [2:42:39<9:23:35,  1.51it/s]
 22%|██▏       | 14506/65536 [2:42:39<9:31:32,  1.49it/s]
 22%|██▏       | 14507/65536 [2:42:40<9:37:16,  1.47it/s]
 22%|██▏       | 14508/65536 [2:42:41<9:37:40,  1.47it/s]
 22%|██▏       | 14509/65536 [2:42:42<9:45:17,  1.45it/s]
 22%|██▏       | 14510/65536 [2:42:42<9:46:58,  1.45it/s]
 22%|██▏       | 14511/65536 [2:42:43<9:32:47,  1.48it/s]
 22%|██▏       | 14512/65536 [2:42:44<9:29:48,  1.49it/s]
 22%|██▏       | 14513/65536 [2:42:44<9:30:38,  1.49it/s]
 22%|██▏       | 14514/65536 [2:42:45<9:21:20,  1.51it/s]
 22%|██▏       | 14515/65536 [2:42:45<9:18:56,  1.52it/s]
 22%|██▏       | 14516/65536 [2:42:46<9:33:46,  1.48it/s]
 22%|██▏       | 14517/65536 [2:42:47<9:28:07,  1.50it/s]
 22%|██▏       | 14518/65536 [2:42:48<9:27:12,  1.50it/s]
 22%|██▏       | 14519/65536 [2:42:48<9:27:29,  1.50it/s]
 22%|██▏       | 14520/65536 [2:42:49<9:47:34,  1.45it/s]
                                                         
{'loss': 0.9228, 'learning_rate': 8.027427451940737e-07, 'epoch': 896.3}

 22%|██▏       | 14520/65536 [2:42:49<9:47:34,  1.45it/s]
 22%|██▏       | 14521/65536 [2:42:50<9:50:34,  1.44it/s]
 22%|██▏       | 14522/65536 [2:42:50<9:48:41,  1.44it/s]
 22%|██▏       | 14523/65536 [2:42:51<9:34:59,  1.48it/s]
 22%|██▏       | 14524/65536 [2:42:52<9:30:42,  1.49it/s]
 22%|██▏       | 14525/65536 [2:42:52<9:34:14,  1.48it/s]
 22%|██▏       | 14526/65536 [2:42:53<9:19:02,  1.52it/s]
 22%|██▏       | 14527/65536 [2:42:54<9:20:31,  1.52it/s]
 22%|██▏       | 14528/65536 [2:42:54<9:23:35,  1.51it/s]
 22%|██▏       | 14529/65536 [2:42:55<9:27:51,  1.50it/s]
 22%|██▏       | 14530/65536 [2:42:56<9:27:05,  1.50it/s]
 22%|██▏       | 14531/65536 [2:42:56<9:18:07,  1.52it/s]
 22%|██▏       | 14532/65536 [2:42:57<9:53:21,  1.43it/s]
 22%|██▏       | 14533/65536 [2:42:58<9:34:44,  1.48it/s]
 22%|██▏       | 14534/65536 [2:42:58<9:32:48,  1.48it/s]
 22%|██▏       | 14535/65536 [2:42:59<9:28:08,  1.50it/s]
 22%|██▏       | 14536/65536 [2:43:00<9:31:01,  1.49it/s]
 22%|██▏       | 14537/65536 [2:43:00<9:33:36,  1.48it/s]
 22%|██▏       | 14538/65536 [2:43:01<9:29:07,  1.49it/s]
 22%|██▏       | 14539/65536 [2:43:02<9:26:03,  1.50it/s]
 22%|██▏       | 14540/65536 [2:43:02<9:25:29,  1.50it/s]
                                                         
{'loss': 0.9243, 'learning_rate': 8.024672462348475e-07, 'epoch': 897.53}

 22%|██▏       | 14540/65536 [2:43:02<9:25:29,  1.50it/s]
 22%|██▏       | 14541/65536 [2:43:03<9:29:34,  1.49it/s]
 22%|██▏       | 14542/65536 [2:43:04<9:45:24,  1.45it/s]
 22%|██▏       | 14543/65536 [2:43:04<9:40:14,  1.46it/s]
 22%|██▏       | 14544/65536 [2:43:05<9:24:09,  1.51it/s]
 22%|██▏       | 14545/65536 [2:43:06<9:07:58,  1.55it/s]
 22%|██▏       | 14546/65536 [2:43:06<9:21:09,  1.51it/s]
 22%|██▏       | 14547/65536 [2:43:07<9:15:12,  1.53it/s]
 22%|██▏       | 14548/65536 [2:43:08<9:46:18,  1.45it/s]
 22%|██▏       | 14549/65536 [2:43:08<9:39:37,  1.47it/s]
 22%|██▏       | 14550/65536 [2:43:09<9:35:28,  1.48it/s]
 22%|██▏       | 14551/65536 [2:43:10<9:37:33,  1.47it/s]
 22%|██▏       | 14552/65536 [2:43:10<9:55:33,  1.43it/s]
 22%|██▏       | 14553/65536 [2:43:11<9:49:57,  1.44it/s]
 22%|██▏       | 14554/65536 [2:43:12<9:48:22,  1.44it/s]
 22%|██▏       | 14555/65536 [2:43:13<9:59:43,  1.42it/s]
 22%|██▏       | 14556/65536 [2:43:13<9:50:59,  1.44it/s]
 22%|██▏       | 14557/65536 [2:43:14<9:32:16,  1.48it/s]
 22%|██▏       | 14558/65536 [2:43:15<9:25:18,  1.50it/s]
 22%|██▏       | 14559/65536 [2:43:15<9:31:19,  1.49it/s]
 22%|██▏       | 14560/65536 [2:43:16<9:22:31,  1.51it/s]
                                                         
{'loss': 0.9336, 'learning_rate': 8.021917472756214e-07, 'epoch': 898.77}

 22%|██▏       | 14560/65536 [2:43:16<9:22:31,  1.51it/s]
 22%|██▏       | 14561/65536 [2:43:16<9:13:18,  1.54it/s]
 22%|██▏       | 14562/65536 [2:43:17<9:12:01,  1.54it/s]
 22%|██▏       | 14563/65536 [2:43:18<9:14:20,  1.53it/s]
 22%|██▏       | 14564/65536 [2:43:19<9:43:09,  1.46it/s]
 22%|██▏       | 14565/65536 [2:43:19<9:52:45,  1.43it/s]
 22%|██▏       | 14566/65536 [2:43:20<9:42:06,  1.46it/s]
 22%|██▏       | 14567/65536 [2:43:21<9:40:08,  1.46it/s]
 22%|██▏       | 14568/65536 [2:43:21<9:33:42,  1.48it/s]
 22%|██▏       | 14569/65536 [2:43:22<9:32:20,  1.48it/s]
 22%|██▏       | 14570/65536 [2:43:23<9:41:45,  1.46it/s]
 22%|██▏       | 14571/65536 [2:43:23<9:28:59,  1.49it/s]
 22%|██▏       | 14572/65536 [2:43:24<9:26:23,  1.50it/s]
 22%|██▏       | 14573/65536 [2:43:25<9:31:21,  1.49it/s]
 22%|██▏       | 14574/65536 [2:43:25<9:22:26,  1.51it/s]
 22%|██▏       | 14575/65536 [2:43:26<9:21:20,  1.51it/s]
 22%|██▏       | 14576/65536 [2:43:27<9:20:10,  1.52it/s]
 22%|██▏       | 14577/65536 [2:43:27<9:17:02,  1.52it/s]
 22%|██▏       | 14578/65536 [2:43:28<9:12:01,  1.54it/s]
 22%|██▏       | 14579/65536 [2:43:29<9:15:10,  1.53it/s]
 22%|██▏       | 14580/65536 [2:43:29<9:30:00,  1.49it/s]
                                                         
{'loss': 0.9287, 'learning_rate': 8.019162483163951e-07, 'epoch': 900.0}

 22%|██▏       | 14580/65536 [2:43:29<9:30:00,  1.49it/s]
 22%|██▏       | 14581/65536 [2:43:30<9:51:07,  1.44it/s]
 22%|██▏       | 14582/65536 [2:43:31<9:36:06,  1.47it/s]
 22%|██▏       | 14583/65536 [2:43:31<9:25:26,  1.50it/s]
 22%|██▏       | 14584/65536 [2:43:32<9:26:22,  1.50it/s]
 22%|██▏       | 14585/65536 [2:43:33<9:26:21,  1.50it/s]
 22%|██▏       | 14586/65536 [2:43:33<9:43:41,  1.45it/s]
 22%|██▏       | 14587/65536 [2:43:34<9:46:47,  1.45it/s]
 22%|██▏       | 14588/65536 [2:43:35<9:53:48,  1.43it/s]
 22%|██▏       | 14589/65536 [2:43:35<9:34:36,  1.48it/s]
 22%|██▏       | 14590/65536 [2:43:36<9:38:32,  1.47it/s]
 22%|██▏       | 14591/65536 [2:43:37<9:24:45,  1.50it/s]
 22%|██▏       | 14592/65536 [2:43:37<9:23:58,  1.51it/s]
 22%|██▏       | 14593/65536 [2:43:38<9:34:33,  1.48it/s]
 22%|██▏       | 14594/65536 [2:43:39<9:35:09,  1.48it/s]
 22%|██▏       | 14595/65536 [2:43:39<9:25:08,  1.50it/s]
 22%|██▏       | 14596/65536 [2:43:40<9:21:37,  1.51it/s]
 22%|██▏       | 14597/65536 [2:43:41<9:42:59,  1.46it/s]
 22%|██▏       | 14598/65536 [2:43:41<9:32:23,  1.48it/s]
 22%|██▏       | 14599/65536 [2:43:42<9:29:07,  1.49it/s]
 22%|██▏       | 14600/65536 [2:43:43<9:37:47,  1.47it/s]
                                                         
{'loss': 0.9217, 'learning_rate': 8.01640749357169e-07, 'epoch': 901.23}

 22%|██▏       | 14600/65536 [2:43:43<9:37:47,  1.47it/s]
 22%|██▏       | 14601/65536 [2:43:44<9:45:58,  1.45it/s]
 22%|██▏       | 14602/65536 [2:43:44<9:37:08,  1.47it/s]
 22%|██▏       | 14603/65536 [2:43:45<9:29:16,  1.49it/s]
 22%|██▏       | 14604/65536 [2:43:45<9:20:55,  1.51it/s]
 22%|██▏       | 14605/65536 [2:43:46<9:28:52,  1.49it/s]
 22%|██▏       | 14606/65536 [2:43:47<9:40:32,  1.46it/s]
 22%|██▏       | 14607/65536 [2:43:48<9:30:30,  1.49it/s]
 22%|██▏       | 14608/65536 [2:43:48<9:22:00,  1.51it/s]
 22%|██▏       | 14609/65536 [2:43:49<9:13:10,  1.53it/s]
 22%|██▏       | 14610/65536 [2:43:49<9:25:17,  1.50it/s]
 22%|██▏       | 14611/65536 [2:43:50<9:24:55,  1.50it/s]
 22%|██▏       | 14612/65536 [2:43:51<9:32:02,  1.48it/s]
 22%|██▏       | 14613/65536 [2:43:52<9:49:49,  1.44it/s]
 22%|██▏       | 14614/65536 [2:43:52<9:52:26,  1.43it/s]
 22%|██▏       | 14615/65536 [2:43:53<9:44:10,  1.45it/s]
 22%|██▏       | 14616/65536 [2:43:54<9:31:41,  1.48it/s]
 22%|██▏       | 14617/65536 [2:43:54<9:19:02,  1.52it/s]
 22%|██▏       | 14618/65536 [2:43:55<9:17:23,  1.52it/s]
 22%|██▏       | 14619/65536 [2:43:56<9:20:34,  1.51it/s]
 22%|██▏       | 14620/65536 [2:43:56<9:44:34,  1.45it/s]
                                                         
{'loss': 0.9226, 'learning_rate': 8.013652503979429e-07, 'epoch': 902.47}

 22%|██▏       | 14620/65536 [2:43:56<9:44:34,  1.45it/s]
 22%|██▏       | 14621/65536 [2:43:57<9:33:12,  1.48it/s]
 22%|██▏       | 14622/65536 [2:43:58<9:24:45,  1.50it/s]
 22%|██▏       | 14623/65536 [2:43:58<9:34:04,  1.48it/s]
 22%|██▏       | 14624/65536 [2:43:59<9:38:31,  1.47it/s]
 22%|██▏       | 14625/65536 [2:44:00<9:24:21,  1.50it/s]
 22%|██▏       | 14626/65536 [2:44:00<9:23:32,  1.51it/s]
 22%|██▏       | 14627/65536 [2:44:01<9:29:19,  1.49it/s]
 22%|██▏       | 14628/65536 [2:44:02<9:22:56,  1.51it/s]
 22%|██▏       | 14629/65536 [2:44:02<9:36:23,  1.47it/s]
 22%|██▏       | 14630/65536 [2:44:03<9:34:50,  1.48it/s]
 22%|██▏       | 14631/65536 [2:44:04<9:36:31,  1.47it/s]
 22%|██▏       | 14632/65536 [2:44:04<9:34:44,  1.48it/s]
 22%|██▏       | 14633/65536 [2:44:05<9:22:12,  1.51it/s]
 22%|██▏       | 14634/65536 [2:44:06<9:20:42,  1.51it/s]
 22%|██▏       | 14635/65536 [2:44:06<9:07:13,  1.55it/s]
 22%|██▏       | 14636/65536 [2:44:07<9:19:44,  1.52it/s]
 22%|██▏       | 14637/65536 [2:44:08<9:11:18,  1.54it/s]
 22%|██▏       | 14638/65536 [2:44:08<9:15:24,  1.53it/s]
 22%|██▏       | 14639/65536 [2:44:09<9:25:49,  1.50it/s]
 22%|██▏       | 14640/65536 [2:44:10<9:21:02,  1.51it/s]
                                                         
{'loss': 0.9282, 'learning_rate': 8.010897514387167e-07, 'epoch': 903.7}

 22%|██▏       | 14640/65536 [2:44:10<9:21:02,  1.51it/s]
 22%|██▏       | 14641/65536 [2:44:10<9:06:12,  1.55it/s]
 22%|██▏       | 14642/65536 [2:44:11<9:08:49,  1.55it/s]
 22%|██▏       | 14643/65536 [2:44:12<9:22:16,  1.51it/s]
 22%|██▏       | 14644/65536 [2:44:12<9:29:39,  1.49it/s]
 22%|██▏       | 14645/65536 [2:44:13<10:09:43,  1.39it/s]
 22%|██▏       | 14646/65536 [2:44:14<10:00:00,  1.41it/s]
 22%|██▏       | 14647/65536 [2:44:14<9:50:02,  1.44it/s] 
 22%|██▏       | 14648/65536 [2:44:15<9:31:59,  1.48it/s]
 22%|██▏       | 14649/65536 [2:44:16<9:38:51,  1.47it/s]
 22%|██▏       | 14650/65536 [2:44:16<9:24:04,  1.50it/s]
 22%|██▏       | 14651/65536 [2:44:17<9:37:20,  1.47it/s]
 22%|██▏       | 14652/65536 [2:44:18<9:21:57,  1.51it/s]
 22%|██▏       | 14653/65536 [2:44:18<9:26:58,  1.50it/s]
 22%|██▏       | 14654/65536 [2:44:19<9:29:32,  1.49it/s]
 22%|██▏       | 14655/65536 [2:44:20<9:27:32,  1.49it/s]
 22%|██▏       | 14656/65536 [2:44:20<9:29:14,  1.49it/s]
 22%|██▏       | 14657/65536 [2:44:21<9:27:08,  1.50it/s]
 22%|██▏       | 14658/65536 [2:44:22<9:26:02,  1.50it/s]
 22%|██▏       | 14659/65536 [2:44:22<9:29:09,  1.49it/s]
 22%|██▏       | 14660/65536 [2:44:23<9:13:00,  1.53it/s]
                                                         
{'loss': 0.9481, 'learning_rate': 8.008142524794907e-07, 'epoch': 904.94}

 22%|██▏       | 14660/65536 [2:44:23<9:13:00,  1.53it/s]
 22%|██▏       | 14661/65536 [2:44:24<9:09:13,  1.54it/s]
 22%|██▏       | 14662/65536 [2:44:24<9:22:24,  1.51it/s]
 22%|██▏       | 14663/65536 [2:44:25<9:22:53,  1.51it/s]
 22%|██▏       | 14664/65536 [2:44:26<9:25:01,  1.50it/s]
 22%|██▏       | 14665/65536 [2:44:26<9:14:51,  1.53it/s]
 22%|██▏       | 14666/65536 [2:44:27<9:25:53,  1.50it/s]
 22%|██▏       | 14667/65536 [2:44:28<9:19:56,  1.51it/s]
 22%|██▏       | 14668/65536 [2:44:28<9:18:21,  1.52it/s]
 22%|██▏       | 14669/65536 [2:44:29<9:30:54,  1.48it/s]
 22%|██▏       | 14670/65536 [2:44:30<9:22:14,  1.51it/s]
 22%|██▏       | 14671/65536 [2:44:30<9:33:05,  1.48it/s]
 22%|██▏       | 14672/65536 [2:44:31<9:30:16,  1.49it/s]
 22%|██▏       | 14673/65536 [2:44:32<9:42:52,  1.45it/s]
 22%|██▏       | 14674/65536 [2:44:32<9:38:52,  1.46it/s]
 22%|██▏       | 14675/65536 [2:44:33<9:39:41,  1.46it/s]
 22%|██▏       | 14676/65536 [2:44:34<9:28:43,  1.49it/s]
 22%|██▏       | 14677/65536 [2:44:34<9:34:43,  1.47it/s]
 22%|██▏       | 14678/65536 [2:44:35<9:54:34,  1.43it/s]
 22%|██▏       | 14679/65536 [2:44:36<9:30:40,  1.49it/s]
 22%|██▏       | 14680/65536 [2:44:37<9:47:31,  1.44it/s]
                                                         
{'loss': 0.9313, 'learning_rate': 8.005387535202643e-07, 'epoch': 906.17}

 22%|██▏       | 14680/65536 [2:44:37<9:47:31,  1.44it/s]
 22%|██▏       | 14681/65536 [2:44:37<9:59:17,  1.41it/s]
 22%|██▏       | 14682/65536 [2:44:38<9:51:35,  1.43it/s]
 22%|██▏       | 14683/65536 [2:44:39<9:44:55,  1.45it/s]
 22%|██▏       | 14684/65536 [2:44:39<9:48:10,  1.44it/s]
 22%|██▏       | 14685/65536 [2:44:40<9:36:35,  1.47it/s]
 22%|██▏       | 14686/65536 [2:44:41<9:37:25,  1.47it/s]
 22%|██▏       | 14687/65536 [2:44:41<9:31:17,  1.48it/s]
 22%|██▏       | 14688/65536 [2:44:42<9:17:59,  1.52it/s]
 22%|██▏       | 14689/65536 [2:44:43<9:10:08,  1.54it/s]
 22%|██▏       | 14690/65536 [2:44:43<9:16:34,  1.52it/s]
 22%|██▏       | 14691/65536 [2:44:44<9:13:38,  1.53it/s]
 22%|██▏       | 14692/65536 [2:44:45<9:20:09,  1.51it/s]
 22%|██▏       | 14693/65536 [2:44:45<9:21:13,  1.51it/s]
 22%|██▏       | 14694/65536 [2:44:46<9:35:59,  1.47it/s]
 22%|██▏       | 14695/65536 [2:44:47<9:38:03,  1.47it/s]
 22%|██▏       | 14696/65536 [2:44:47<9:41:49,  1.46it/s]
 22%|██▏       | 14697/65536 [2:44:48<9:38:42,  1.46it/s]
 22%|██▏       | 14698/65536 [2:44:49<9:28:11,  1.49it/s]
 22%|██▏       | 14699/65536 [2:44:49<9:31:31,  1.48it/s]
 22%|██▏       | 14700/65536 [2:44:50<9:28:51,  1.49it/s]
                                                         
{'loss': 0.9263, 'learning_rate': 8.002632545610383e-07, 'epoch': 907.41}

 22%|██▏       | 14700/65536 [2:44:50<9:28:51,  1.49it/s]
 22%|██▏       | 14701/65536 [2:44:51<9:23:11,  1.50it/s]
 22%|██▏       | 14702/65536 [2:44:51<9:17:06,  1.52it/s]
 22%|██▏       | 14703/65536 [2:44:52<9:11:30,  1.54it/s]
 22%|██▏       | 14704/65536 [2:44:53<9:22:09,  1.51it/s]
 22%|██▏       | 14705/65536 [2:44:53<9:27:37,  1.49it/s]
 22%|██▏       | 14706/65536 [2:44:54<9:54:55,  1.42it/s]
 22%|██▏       | 14707/65536 [2:44:55<10:01:22,  1.41it/s]
 22%|██▏       | 14708/65536 [2:44:55<9:32:37,  1.48it/s] 
 22%|██▏       | 14709/65536 [2:44:56<9:16:11,  1.52it/s]
 22%|██▏       | 14710/65536 [2:44:57<9:47:29,  1.44it/s]
 22%|██▏       | 14711/65536 [2:44:57<9:39:26,  1.46it/s]
 22%|██▏       | 14712/65536 [2:44:58<9:27:47,  1.49it/s]
 22%|██▏       | 14713/65536 [2:44:59<9:23:29,  1.50it/s]
 22%|██▏       | 14714/65536 [2:44:59<9:26:48,  1.49it/s]
 22%|██▏       | 14715/65536 [2:45:00<9:22:32,  1.51it/s]
 22%|██▏       | 14716/65536 [2:45:01<9:33:24,  1.48it/s]
 22%|██▏       | 14717/65536 [2:45:01<9:23:22,  1.50it/s]
 22%|██▏       | 14718/65536 [2:45:02<9:35:25,  1.47it/s]
 22%|██▏       | 14719/65536 [2:45:03<9:30:12,  1.49it/s]
 22%|██▏       | 14720/65536 [2:45:03<9:22:35,  1.51it/s]
                                                         
{'loss': 0.9471, 'learning_rate': 7.999877556018122e-07, 'epoch': 908.64}

 22%|██▏       | 14720/65536 [2:45:03<9:22:35,  1.51it/s]
 22%|██▏       | 14721/65536 [2:45:04<9:23:05,  1.50it/s]
 22%|██▏       | 14722/65536 [2:45:05<9:24:50,  1.50it/s]
 22%|██▏       | 14723/65536 [2:45:05<9:23:33,  1.50it/s]
 22%|██▏       | 14724/65536 [2:45:06<9:07:13,  1.55it/s]
 22%|██▏       | 14725/65536 [2:45:07<9:31:16,  1.48it/s]
 22%|██▏       | 14726/65536 [2:45:07<9:41:57,  1.46it/s]
 22%|██▏       | 14727/65536 [2:45:08<9:31:00,  1.48it/s]
 22%|██▏       | 14728/65536 [2:45:09<9:27:59,  1.49it/s]
 22%|██▏       | 14729/65536 [2:45:09<9:20:52,  1.51it/s]
 22%|██▏       | 14730/65536 [2:45:10<9:22:13,  1.51it/s]
 22%|██▏       | 14731/65536 [2:45:11<9:36:02,  1.47it/s]
 22%|██▏       | 14732/65536 [2:45:11<9:31:40,  1.48it/s]
 22%|██▏       | 14733/65536 [2:45:12<9:26:09,  1.50it/s]
 22%|██▏       | 14734/65536 [2:45:13<9:24:50,  1.50it/s]
 22%|██▏       | 14735/65536 [2:45:13<9:22:42,  1.50it/s]
 22%|██▏       | 14736/65536 [2:45:14<9:22:18,  1.51it/s]
 22%|██▏       | 14737/65536 [2:45:15<9:20:19,  1.51it/s]
 22%|██▏       | 14738/65536 [2:45:15<9:22:59,  1.50it/s]
 22%|██▏       | 14739/65536 [2:45:16<9:25:48,  1.50it/s]
 22%|██▏       | 14740/65536 [2:45:17<9:22:28,  1.51it/s]
                                                         
{'loss': 0.9377, 'learning_rate': 7.99712256642586e-07, 'epoch': 909.88}

 22%|██▏       | 14740/65536 [2:45:17<9:22:28,  1.51it/s]
 22%|██▏       | 14741/65536 [2:45:18<9:36:59,  1.47it/s]
 22%|██▏       | 14742/65536 [2:45:18<9:35:40,  1.47it/s]
 22%|██▏       | 14743/65536 [2:45:19<9:49:31,  1.44it/s]
 22%|██▏       | 14744/65536 [2:45:20<9:51:20,  1.43it/s]
 22%|██▏       | 14745/65536 [2:45:20<9:51:29,  1.43it/s]
 23%|██▎       | 14746/65536 [2:45:21<9:41:01,  1.46it/s]
 23%|██▎       | 14747/65536 [2:45:22<9:22:02,  1.51it/s]
 23%|██▎       | 14748/65536 [2:45:22<9:32:43,  1.48it/s]
 23%|██▎       | 14749/65536 [2:45:23<9:33:30,  1.48it/s]
 23%|██▎       | 14750/65536 [2:45:24<9:23:12,  1.50it/s]
 23%|██▎       | 14751/65536 [2:45:24<9:12:55,  1.53it/s]
 23%|██▎       | 14752/65536 [2:45:25<9:10:11,  1.54it/s]
 23%|██▎       | 14753/65536 [2:45:26<9:16:54,  1.52it/s]
 23%|██▎       | 14754/65536 [2:45:26<9:16:44,  1.52it/s]
 23%|██▎       | 14755/65536 [2:45:27<9:28:48,  1.49it/s]
 23%|██▎       | 14756/65536 [2:45:28<9:31:09,  1.48it/s]
 23%|██▎       | 14757/65536 [2:45:28<9:40:21,  1.46it/s]
 23%|██▎       | 14758/65536 [2:45:29<9:34:14,  1.47it/s]
 23%|██▎       | 14759/65536 [2:45:30<9:55:53,  1.42it/s]
 23%|██▎       | 14760/65536 [2:45:30<9:39:21,  1.46it/s]
                                                         
{'loss': 0.9278, 'learning_rate': 7.994367576833599e-07, 'epoch': 911.11}

 23%|██▎       | 14760/65536 [2:45:30<9:39:21,  1.46it/s]
 23%|██▎       | 14761/65536 [2:45:31<9:32:37,  1.48it/s]
 23%|██▎       | 14762/65536 [2:45:32<9:26:33,  1.49it/s]
 23%|██▎       | 14763/65536 [2:45:32<9:24:44,  1.50it/s]
 23%|██▎       | 14764/65536 [2:45:33<9:42:35,  1.45it/s]
 23%|██▎       | 14765/65536 [2:45:34<9:30:39,  1.48it/s]
 23%|██▎       | 14766/65536 [2:45:34<9:35:04,  1.47it/s]
 23%|██▎       | 14767/65536 [2:45:35<9:33:42,  1.47it/s]
 23%|██▎       | 14768/65536 [2:45:36<9:23:46,  1.50it/s]
 23%|██▎       | 14769/65536 [2:45:36<9:29:15,  1.49it/s]
 23%|██▎       | 14770/65536 [2:45:37<9:22:34,  1.50it/s]
 23%|██▎       | 14771/65536 [2:45:38<9:39:26,  1.46it/s]
 23%|██▎       | 14772/65536 [2:45:38<9:39:42,  1.46it/s]
 23%|██▎       | 14773/65536 [2:45:39<9:35:09,  1.47it/s]
 23%|██▎       | 14774/65536 [2:45:40<9:29:09,  1.49it/s]
 23%|██▎       | 14775/65536 [2:45:41<9:45:10,  1.45it/s]
 23%|██▎       | 14776/65536 [2:45:41<9:49:20,  1.44it/s]
 23%|██▎       | 14777/65536 [2:45:42<9:35:21,  1.47it/s]
 23%|██▎       | 14778/65536 [2:45:43<9:31:08,  1.48it/s]
 23%|██▎       | 14779/65536 [2:45:43<9:25:22,  1.50it/s]
 23%|██▎       | 14780/65536 [2:45:44<9:16:44,  1.52it/s]
                                                         
{'loss': 0.928, 'learning_rate': 7.991612587241337e-07, 'epoch': 912.35}

 23%|██▎       | 14780/65536 [2:45:44<9:16:44,  1.52it/s]
 23%|██▎       | 14781/65536 [2:45:44<9:06:24,  1.55it/s]
 23%|██▎       | 14782/65536 [2:45:45<9:02:04,  1.56it/s]
 23%|██▎       | 14783/65536 [2:45:46<9:27:09,  1.49it/s]
 23%|██▎       | 14784/65536 [2:45:47<9:25:32,  1.50it/s]
 23%|██▎       | 14785/65536 [2:45:47<9:14:57,  1.52it/s]
 23%|██▎       | 14786/65536 [2:45:48<9:23:51,  1.50it/s]
 23%|██▎       | 14787/65536 [2:45:48<9:26:03,  1.49it/s]
 23%|██▎       | 14788/65536 [2:45:49<9:18:19,  1.51it/s]
 23%|██▎       | 14789/65536 [2:45:50<9:18:51,  1.51it/s]
 23%|██▎       | 14790/65536 [2:45:51<9:41:44,  1.45it/s]
 23%|██▎       | 14791/65536 [2:45:51<9:55:48,  1.42it/s]
 23%|██▎       | 14792/65536 [2:45:52<9:50:31,  1.43it/s]
 23%|██▎       | 14793/65536 [2:45:53<9:51:17,  1.43it/s]
 23%|██▎       | 14794/65536 [2:45:53<9:49:38,  1.43it/s]
 23%|██▎       | 14795/65536 [2:45:54<9:34:09,  1.47it/s]
 23%|██▎       | 14796/65536 [2:45:55<9:47:21,  1.44it/s]
 23%|██▎       | 14797/65536 [2:45:55<9:50:52,  1.43it/s]
 23%|██▎       | 14798/65536 [2:45:56<9:38:30,  1.46it/s]
 23%|██▎       | 14799/65536 [2:45:57<9:26:43,  1.49it/s]
 23%|██▎       | 14800/65536 [2:45:57<9:33:58,  1.47it/s]
                                                         
{'loss': 0.9105, 'learning_rate': 7.988857597649076e-07, 'epoch': 913.58}

 23%|██▎       | 14800/65536 [2:45:57<9:33:58,  1.47it/s]
 23%|██▎       | 14801/65536 [2:45:58<9:23:35,  1.50it/s]
 23%|██▎       | 14802/65536 [2:45:59<9:24:11,  1.50it/s]
 23%|██▎       | 14803/65536 [2:45:59<9:26:51,  1.49it/s]
 23%|██▎       | 14804/65536 [2:46:00<9:12:31,  1.53it/s]
 23%|██▎       | 14805/65536 [2:46:01<9:13:21,  1.53it/s]
 23%|██▎       | 14806/65536 [2:46:01<9:16:15,  1.52it/s]
 23%|██▎       | 14807/65536 [2:46:02<9:36:11,  1.47it/s]
 23%|██▎       | 14808/65536 [2:46:03<9:23:23,  1.50it/s]
 23%|██▎       | 14809/65536 [2:46:03<9:19:54,  1.51it/s]
 23%|██▎       | 14810/65536 [2:46:04<9:20:29,  1.51it/s]
 23%|██▎       | 14811/65536 [2:46:05<9:31:15,  1.48it/s]
 23%|██▎       | 14812/65536 [2:46:05<9:34:24,  1.47it/s]
 23%|██▎       | 14813/65536 [2:46:06<9:17:12,  1.52it/s]
 23%|██▎       | 14814/65536 [2:46:07<9:16:53,  1.52it/s]
 23%|██▎       | 14815/65536 [2:46:07<9:26:50,  1.49it/s]
 23%|██▎       | 14816/65536 [2:46:08<9:19:27,  1.51it/s]
 23%|██▎       | 14817/65536 [2:46:09<9:32:24,  1.48it/s]
 23%|██▎       | 14818/65536 [2:46:09<9:33:19,  1.47it/s]
 23%|██▎       | 14819/65536 [2:46:10<9:42:51,  1.45it/s]
 23%|██▎       | 14820/65536 [2:46:11<9:32:28,  1.48it/s]
                                                         
{'loss': 0.9532, 'learning_rate': 7.986102608056815e-07, 'epoch': 914.81}

 23%|██▎       | 14820/65536 [2:46:11<9:32:28,  1.48it/s]
 23%|██▎       | 14821/65536 [2:46:11<9:19:11,  1.51it/s]
 23%|██▎       | 14822/65536 [2:46:12<9:10:59,  1.53it/s]
 23%|██▎       | 14823/65536 [2:46:13<9:17:39,  1.52it/s]
 23%|██▎       | 14824/65536 [2:46:13<9:42:06,  1.45it/s]
 23%|██▎       | 14825/65536 [2:46:14<9:24:53,  1.50it/s]
 23%|██▎       | 14826/65536 [2:46:15<9:31:01,  1.48it/s]
 23%|██▎       | 14827/65536 [2:46:15<9:36:22,  1.47it/s]
 23%|██▎       | 14828/65536 [2:46:16<9:36:32,  1.47it/s]
 23%|██▎       | 14829/65536 [2:46:17<9:50:16,  1.43it/s]
 23%|██▎       | 14830/65536 [2:46:18<9:22:06,  1.50it/s]
 23%|██▎       | 14831/65536 [2:46:18<9:24:49,  1.50it/s]
 23%|██▎       | 14832/65536 [2:46:19<9:24:46,  1.50it/s]
 23%|██▎       | 14833/65536 [2:46:20<9:25:25,  1.49it/s]
 23%|██▎       | 14834/65536 [2:46:20<9:08:55,  1.54it/s]
 23%|██▎       | 14835/65536 [2:46:21<9:21:42,  1.50it/s]
 23%|██▎       | 14836/65536 [2:46:22<9:30:45,  1.48it/s]
 23%|██▎       | 14837/65536 [2:46:22<9:28:51,  1.49it/s]
 23%|██▎       | 14838/65536 [2:46:23<9:18:01,  1.51it/s]
 23%|██▎       | 14839/65536 [2:46:23<9:20:32,  1.51it/s]
 23%|██▎       | 14840/65536 [2:46:24<9:41:58,  1.45it/s]
                                                         
{'loss': 0.9285, 'learning_rate': 7.983347618464552e-07, 'epoch': 916.05}

 23%|██▎       | 14840/65536 [2:46:24<9:41:58,  1.45it/s]
 23%|██▎       | 14841/65536 [2:46:25<9:35:46,  1.47it/s]
 23%|██▎       | 14842/65536 [2:46:26<9:39:24,  1.46it/s]
 23%|██▎       | 14843/65536 [2:46:26<9:35:08,  1.47it/s]
 23%|██▎       | 14844/65536 [2:46:27<9:32:23,  1.48it/s]
 23%|██▎       | 14845/65536 [2:46:28<9:35:50,  1.47it/s]
 23%|██▎       | 14846/65536 [2:46:28<9:26:05,  1.49it/s]
 23%|██▎       | 14847/65536 [2:46:29<9:16:43,  1.52it/s]
 23%|██▎       | 14848/65536 [2:46:30<9:50:41,  1.43it/s]
 23%|██▎       | 14849/65536 [2:46:30<9:47:22,  1.44it/s]
 23%|██▎       | 14850/65536 [2:46:31<9:29:46,  1.48it/s]
 23%|██▎       | 14851/65536 [2:46:32<9:31:08,  1.48it/s]
 23%|██▎       | 14852/65536 [2:46:32<9:28:34,  1.49it/s]
 23%|██▎       | 14853/65536 [2:46:33<9:16:26,  1.52it/s]
 23%|██▎       | 14854/65536 [2:46:34<9:12:39,  1.53it/s]
 23%|██▎       | 14855/65536 [2:46:34<9:21:55,  1.50it/s]
 23%|██▎       | 14856/65536 [2:46:35<9:54:15,  1.42it/s]
 23%|██▎       | 14857/65536 [2:46:36<9:49:29,  1.43it/s]
 23%|██▎       | 14858/65536 [2:46:36<9:48:23,  1.44it/s]
 23%|██▎       | 14859/65536 [2:46:37<9:38:05,  1.46it/s]
 23%|██▎       | 14860/65536 [2:46:38<9:30:57,  1.48it/s]
                                                         
{'loss': 0.9217, 'learning_rate': 7.980592628872291e-07, 'epoch': 917.28}

 23%|██▎       | 14860/65536 [2:46:38<9:30:57,  1.48it/s]
 23%|██▎       | 14861/65536 [2:46:38<9:29:30,  1.48it/s]
 23%|██▎       | 14862/65536 [2:46:39<9:25:57,  1.49it/s]
 23%|██▎       | 14863/65536 [2:46:40<9:18:50,  1.51it/s]
 23%|██▎       | 14864/65536 [2:46:41<9:37:24,  1.46it/s]
 23%|██▎       | 14865/65536 [2:46:41<9:29:42,  1.48it/s]
 23%|██▎       | 14866/65536 [2:46:42<9:12:09,  1.53it/s]
 23%|██▎       | 14867/65536 [2:46:42<9:18:07,  1.51it/s]
 23%|██▎       | 14868/65536 [2:46:43<9:25:11,  1.49it/s]
 23%|██▎       | 14869/65536 [2:46:44<9:25:00,  1.49it/s]
 23%|██▎       | 14870/65536 [2:46:44<8:58:11,  1.57it/s]
 23%|██▎       | 14871/65536 [2:46:45<9:15:23,  1.52it/s]
 23%|██▎       | 14872/65536 [2:46:46<9:45:26,  1.44it/s]
 23%|██▎       | 14873/65536 [2:46:47<9:38:35,  1.46it/s]
 23%|██▎       | 14874/65536 [2:46:47<9:51:43,  1.43it/s]
 23%|██▎       | 14875/65536 [2:46:48<9:44:43,  1.44it/s]
 23%|██▎       | 14876/65536 [2:46:49<9:46:36,  1.44it/s]
 23%|██▎       | 14877/65536 [2:46:49<9:45:34,  1.44it/s]
 23%|██▎       | 14878/65536 [2:46:50<9:30:54,  1.48it/s]
 23%|██▎       | 14879/65536 [2:46:51<9:30:33,  1.48it/s]
 23%|██▎       | 14880/65536 [2:46:51<9:17:17,  1.51it/s]
                                                         
{'loss': 0.9206, 'learning_rate': 7.977837639280029e-07, 'epoch': 918.52}

 23%|██▎       | 14880/65536 [2:46:51<9:17:17,  1.51it/s]
 23%|██▎       | 14881/65536 [2:46:52<9:19:50,  1.51it/s]
 23%|██▎       | 14882/65536 [2:46:53<9:27:52,  1.49it/s]
 23%|██▎       | 14883/65536 [2:46:53<9:28:23,  1.49it/s]
 23%|██▎       | 14884/65536 [2:46:54<9:16:39,  1.52it/s]
 23%|██▎       | 14885/65536 [2:46:55<9:24:17,  1.50it/s]
 23%|██▎       | 14886/65536 [2:46:55<9:10:12,  1.53it/s]
 23%|██▎       | 14887/65536 [2:46:56<9:23:02,  1.50it/s]
 23%|██▎       | 14888/65536 [2:46:57<9:45:12,  1.44it/s]
 23%|██▎       | 14889/65536 [2:46:57<9:46:18,  1.44it/s]
 23%|██▎       | 14890/65536 [2:46:58<9:36:13,  1.46it/s]
 23%|██▎       | 14891/65536 [2:46:59<9:40:34,  1.45it/s]
 23%|██▎       | 14892/65536 [2:46:59<9:24:04,  1.50it/s]
 23%|██▎       | 14893/65536 [2:47:00<9:31:32,  1.48it/s]
 23%|██▎       | 14894/65536 [2:47:01<9:29:22,  1.48it/s]
 23%|██▎       | 14895/65536 [2:47:01<9:41:41,  1.45it/s]
 23%|██▎       | 14896/65536 [2:47:02<9:39:10,  1.46it/s]
 23%|██▎       | 14897/65536 [2:47:03<9:22:35,  1.50it/s]
 23%|██▎       | 14898/65536 [2:47:03<9:11:10,  1.53it/s]
 23%|██▎       | 14899/65536 [2:47:04<9:09:04,  1.54it/s]
 23%|██▎       | 14900/65536 [2:47:05<9:05:52,  1.55it/s]
                                                         
{'loss': 0.9196, 'learning_rate': 7.975082649687768e-07, 'epoch': 919.75}

 23%|██▎       | 14900/65536 [2:47:05<9:05:52,  1.55it/s]
 23%|██▎       | 14901/65536 [2:47:05<9:13:53,  1.52it/s]
 23%|██▎       | 14902/65536 [2:47:06<9:21:09,  1.50it/s]
 23%|██▎       | 14903/65536 [2:47:07<9:26:03,  1.49it/s]
 23%|██▎       | 14904/65536 [2:47:07<9:39:54,  1.46it/s]
 23%|██▎       | 14905/65536 [2:47:08<10:05:17,  1.39it/s]
 23%|██▎       | 14906/65536 [2:47:09<10:03:05,  1.40it/s]
 23%|██▎       | 14907/65536 [2:47:10<9:41:55,  1.45it/s] 
 23%|██▎       | 14908/65536 [2:47:10<9:26:18,  1.49it/s]
 23%|██▎       | 14909/65536 [2:47:11<9:27:06,  1.49it/s]
 23%|██▎       | 14910/65536 [2:47:12<9:22:07,  1.50it/s]
 23%|██▎       | 14911/65536 [2:47:12<9:09:03,  1.54it/s]
 23%|██▎       | 14912/65536 [2:47:13<9:11:38,  1.53it/s]
 23%|██▎       | 14913/65536 [2:47:13<9:24:26,  1.49it/s]
 23%|██▎       | 14914/65536 [2:47:14<9:27:53,  1.49it/s]
 23%|██▎       | 14915/65536 [2:47:15<9:35:45,  1.47it/s]
 23%|██▎       | 14916/65536 [2:47:15<9:22:01,  1.50it/s]
 23%|██▎       | 14917/65536 [2:47:16<9:35:10,  1.47it/s]
 23%|██▎       | 14918/65536 [2:47:17<9:25:17,  1.49it/s]
 23%|██▎       | 14919/65536 [2:47:18<9:20:51,  1.50it/s]
 23%|██▎       | 14920/65536 [2:47:18<9:11:39,  1.53it/s]
                                                         
{'loss': 0.9401, 'learning_rate': 7.972327660095507e-07, 'epoch': 920.99}

 23%|██▎       | 14920/65536 [2:47:18<9:11:39,  1.53it/s]
 23%|██▎       | 14921/65536 [2:47:19<9:34:37,  1.47it/s]
 23%|██▎       | 14922/65536 [2:47:20<9:30:35,  1.48it/s]
 23%|██▎       | 14923/65536 [2:47:20<9:17:01,  1.51it/s]
 23%|██▎       | 14924/65536 [2:47:21<9:26:59,  1.49it/s]
 23%|██▎       | 14925/65536 [2:47:22<9:46:41,  1.44it/s]
 23%|██▎       | 14926/65536 [2:47:22<9:40:35,  1.45it/s]
 23%|██▎       | 14927/65536 [2:47:23<9:37:45,  1.46it/s]
 23%|██▎       | 14928/65536 [2:47:24<9:38:46,  1.46it/s]
 23%|██▎       | 14929/65536 [2:47:24<9:26:30,  1.49it/s]
 23%|██▎       | 14930/65536 [2:47:25<9:11:35,  1.53it/s]
 23%|██▎       | 14931/65536 [2:47:26<9:16:55,  1.51it/s]
 23%|██▎       | 14932/65536 [2:47:26<9:22:09,  1.50it/s]
 23%|██▎       | 14933/65536 [2:47:27<9:31:04,  1.48it/s]
 23%|██▎       | 14934/65536 [2:47:28<9:17:41,  1.51it/s]
 23%|██▎       | 14935/65536 [2:47:28<9:18:30,  1.51it/s]
 23%|██▎       | 14936/65536 [2:47:29<9:13:47,  1.52it/s]
 23%|██▎       | 14937/65536 [2:47:30<9:33:50,  1.47it/s]
 23%|██▎       | 14938/65536 [2:47:30<9:51:26,  1.43it/s]
 23%|██▎       | 14939/65536 [2:47:31<9:54:18,  1.42it/s]
 23%|██▎       | 14940/65536 [2:47:32<9:43:33,  1.45it/s]
                                                         
{'loss': 0.9283, 'learning_rate': 7.969572670503245e-07, 'epoch': 922.22}

 23%|██▎       | 14940/65536 [2:47:32<9:43:33,  1.45it/s]
 23%|██▎       | 14941/65536 [2:47:32<9:45:31,  1.44it/s]
 23%|██▎       | 14942/65536 [2:47:33<9:34:32,  1.47it/s]
 23%|██▎       | 14943/65536 [2:47:34<9:27:42,  1.49it/s]
 23%|██▎       | 14944/65536 [2:47:34<9:18:19,  1.51it/s]
 23%|██▎       | 14945/65536 [2:47:35<9:20:46,  1.50it/s]
 23%|██▎       | 14946/65536 [2:47:36<9:33:10,  1.47it/s]
 23%|██▎       | 14947/65536 [2:47:36<9:23:26,  1.50it/s]
 23%|██▎       | 14948/65536 [2:47:37<9:14:04,  1.52it/s]
 23%|██▎       | 14949/65536 [2:47:38<9:11:35,  1.53it/s]
 23%|██▎       | 14950/65536 [2:47:38<9:08:10,  1.54it/s]
 23%|██▎       | 14951/65536 [2:47:39<9:05:03,  1.55it/s]
 23%|██▎       | 14952/65536 [2:47:40<9:15:16,  1.52it/s]
 23%|██▎       | 14953/65536 [2:47:40<9:34:36,  1.47it/s]
 23%|██▎       | 14954/65536 [2:47:41<9:33:35,  1.47it/s]
 23%|██▎       | 14955/65536 [2:47:42<9:43:10,  1.45it/s]
 23%|██▎       | 14956/65536 [2:47:43<9:46:42,  1.44it/s]
 23%|██▎       | 14957/65536 [2:47:43<9:37:33,  1.46it/s]
 23%|██▎       | 14958/65536 [2:47:44<9:39:55,  1.45it/s]
 23%|██▎       | 14959/65536 [2:47:45<9:30:49,  1.48it/s]
 23%|██▎       | 14960/65536 [2:47:45<9:23:02,  1.50it/s]
                                                         
{'loss': 0.9364, 'learning_rate': 7.966817680910983e-07, 'epoch': 923.46}

 23%|██▎       | 14960/65536 [2:47:45<9:23:02,  1.50it/s]
 23%|██▎       | 14961/65536 [2:47:46<9:19:05,  1.51it/s]
 23%|██▎       | 14962/65536 [2:47:46<9:16:42,  1.51it/s]
 23%|██▎       | 14963/65536 [2:47:47<9:19:47,  1.51it/s]
 23%|██▎       | 14964/65536 [2:47:48<9:26:12,  1.49it/s]
 23%|██▎       | 14965/65536 [2:47:48<9:25:16,  1.49it/s]
 23%|██▎       | 14966/65536 [2:47:49<9:14:59,  1.52it/s]
 23%|██▎       | 14967/65536 [2:47:50<9:15:31,  1.52it/s]
 23%|██▎       | 14968/65536 [2:47:50<9:15:28,  1.52it/s]
 23%|██▎       | 14969/65536 [2:47:51<9:23:49,  1.49it/s]
 23%|██▎       | 14970/65536 [2:47:52<9:25:02,  1.49it/s]
 23%|██▎       | 14971/65536 [2:47:52<9:23:39,  1.50it/s]
 23%|██▎       | 14972/65536 [2:47:53<9:20:13,  1.50it/s]
 23%|██▎       | 14973/65536 [2:47:54<9:29:29,  1.48it/s]
 23%|██▎       | 14974/65536 [2:47:55<9:33:00,  1.47it/s]
 23%|██▎       | 14975/65536 [2:47:55<9:24:09,  1.49it/s]
 23%|██▎       | 14976/65536 [2:47:56<9:08:59,  1.53it/s]
 23%|██▎       | 14977/65536 [2:47:56<8:59:49,  1.56it/s]
 23%|██▎       | 14978/65536 [2:47:57<9:08:41,  1.54it/s]
 23%|██▎       | 14979/65536 [2:47:58<9:02:55,  1.55it/s]
 23%|██▎       | 14980/65536 [2:47:58<9:07:48,  1.54it/s]
                                                         
{'loss': 0.9281, 'learning_rate': 7.964062691318721e-07, 'epoch': 924.69}

 23%|██▎       | 14980/65536 [2:47:58<9:07:48,  1.54it/s]
 23%|██▎       | 14981/65536 [2:47:59<9:05:18,  1.55it/s]
 23%|██▎       | 14982/65536 [2:48:00<9:05:17,  1.55it/s]
 23%|██▎       | 14983/65536 [2:48:00<9:28:54,  1.48it/s]
 23%|██▎       | 14984/65536 [2:48:01<9:25:15,  1.49it/s]
 23%|██▎       | 14985/65536 [2:48:02<9:29:33,  1.48it/s]
 23%|██▎       | 14986/65536 [2:48:02<9:49:32,  1.43it/s]
 23%|██▎       | 14987/65536 [2:48:03<9:32:04,  1.47it/s]
 23%|██▎       | 14988/65536 [2:48:04<9:12:14,  1.53it/s]
 23%|██▎       | 14989/65536 [2:48:04<9:25:37,  1.49it/s]
 23%|██▎       | 14990/65536 [2:48:05<9:28:32,  1.48it/s]
 23%|██▎       | 14991/65536 [2:48:06<9:25:50,  1.49it/s]
 23%|██▎       | 14992/65536 [2:48:06<9:28:18,  1.48it/s]
 23%|██▎       | 14993/65536 [2:48:07<9:25:24,  1.49it/s]
 23%|██▎       | 14994/65536 [2:48:08<9:41:28,  1.45it/s]
 23%|██▎       | 14995/65536 [2:48:09<9:50:29,  1.43it/s]
 23%|██▎       | 14996/65536 [2:48:09<9:41:16,  1.45it/s]
 23%|██▎       | 14997/65536 [2:48:10<9:33:40,  1.47it/s]
 23%|██▎       | 14998/65536 [2:48:11<9:27:13,  1.48it/s]
 23%|██▎       | 14999/65536 [2:48:11<9:42:41,  1.45it/s]
 23%|██▎       | 15000/65536 [2:48:12<9:32:06,  1.47it/s]
                                                         
{'loss': 0.9207, 'learning_rate': 7.96130770172646e-07, 'epoch': 925.93}

 23%|██▎       | 15000/65536 [2:48:12<9:32:06,  1.47it/s]
 23%|██▎       | 15001/65536 [2:48:13<9:23:05,  1.50it/s]
 23%|██▎       | 15002/65536 [2:48:13<9:38:40,  1.46it/s]
 23%|██▎       | 15003/65536 [2:48:14<9:41:37,  1.45it/s]
 23%|██▎       | 15004/65536 [2:48:15<9:24:43,  1.49it/s]
 23%|██▎       | 15005/65536 [2:48:15<9:34:19,  1.47it/s]
 23%|██▎       | 15006/65536 [2:48:16<9:26:07,  1.49it/s]
 23%|██▎       | 15007/65536 [2:48:17<9:17:33,  1.51it/s]
 23%|██▎       | 15008/65536 [2:48:17<9:21:11,  1.50it/s]
 23%|██▎       | 15009/65536 [2:48:18<9:24:15,  1.49it/s]
 23%|██▎       | 15010/65536 [2:48:19<9:22:50,  1.50it/s]
 23%|██▎       | 15011/65536 [2:48:19<9:27:10,  1.48it/s]
 23%|██▎       | 15012/65536 [2:48:20<9:16:16,  1.51it/s]
 23%|██▎       | 15013/65536 [2:48:21<9:24:15,  1.49it/s]
 23%|██▎       | 15014/65536 [2:48:21<9:23:54,  1.49it/s]
 23%|██▎       | 15015/65536 [2:48:22<9:25:48,  1.49it/s]
 23%|██▎       | 15016/65536 [2:48:23<9:21:18,  1.50it/s]
 23%|██▎       | 15017/65536 [2:48:23<9:21:54,  1.50it/s]
 23%|██▎       | 15018/65536 [2:48:24<9:48:51,  1.43it/s]
 23%|██▎       | 15019/65536 [2:48:25<9:44:31,  1.44it/s]
 23%|██▎       | 15020/65536 [2:48:25<9:31:42,  1.47it/s]
                                                         
{'loss': 0.9241, 'learning_rate': 7.958552712134197e-07, 'epoch': 927.16}

 23%|██▎       | 15020/65536 [2:48:25<9:31:42,  1.47it/s]
 23%|██▎       | 15021/65536 [2:48:26<9:31:18,  1.47it/s]
 23%|██▎       | 15022/65536 [2:48:27<9:32:03,  1.47it/s]
 23%|██▎       | 15023/65536 [2:48:27<9:36:08,  1.46it/s]
 23%|██▎       | 15024/65536 [2:48:28<9:31:17,  1.47it/s]
 23%|██▎       | 15025/65536 [2:48:29<9:30:00,  1.48it/s]
 23%|██▎       | 15026/65536 [2:48:29<9:22:37,  1.50it/s]
 23%|██▎       | 15027/65536 [2:48:30<9:22:05,  1.50it/s]
 23%|██▎       | 15028/65536 [2:48:31<9:25:39,  1.49it/s]
 23%|██▎       | 15029/65536 [2:48:31<9:20:46,  1.50it/s]
 23%|██▎       | 15030/65536 [2:48:32<9:17:12,  1.51it/s]
 23%|██▎       | 15031/65536 [2:48:33<9:21:49,  1.50it/s]
 23%|██▎       | 15032/65536 [2:48:34<9:38:58,  1.45it/s]
 23%|██▎       | 15033/65536 [2:48:34<9:35:39,  1.46it/s]
 23%|██▎       | 15034/65536 [2:48:35<9:47:15,  1.43it/s]
 23%|██▎       | 15035/65536 [2:48:36<9:47:09,  1.43it/s]
 23%|██▎       | 15036/65536 [2:48:36<9:32:17,  1.47it/s]
 23%|██▎       | 15037/65536 [2:48:37<9:12:53,  1.52it/s]
 23%|██▎       | 15038/65536 [2:48:38<9:28:33,  1.48it/s]
 23%|██▎       | 15039/65536 [2:48:38<9:24:49,  1.49it/s]
 23%|██▎       | 15040/65536 [2:48:39<9:36:30,  1.46it/s]
                                                         
{'loss': 0.9149, 'learning_rate': 7.955797722541937e-07, 'epoch': 928.4}

 23%|██▎       | 15040/65536 [2:48:39<9:36:30,  1.46it/s]
 23%|██▎       | 15041/65536 [2:48:40<9:38:49,  1.45it/s]
 23%|██▎       | 15042/65536 [2:48:40<9:32:27,  1.47it/s]
 23%|██▎       | 15043/65536 [2:48:41<9:36:48,  1.46it/s]
 23%|██▎       | 15044/65536 [2:48:42<9:27:31,  1.48it/s]
 23%|██▎       | 15045/65536 [2:48:42<9:21:52,  1.50it/s]
 23%|██▎       | 15046/65536 [2:48:43<9:12:00,  1.52it/s]
 23%|██▎       | 15047/65536 [2:48:44<9:22:58,  1.49it/s]
 23%|██▎       | 15048/65536 [2:48:44<9:24:41,  1.49it/s]
 23%|██▎       | 15049/65536 [2:48:45<9:27:19,  1.48it/s]
 23%|██▎       | 15050/65536 [2:48:46<9:48:33,  1.43it/s]
 23%|██▎       | 15051/65536 [2:48:46<9:45:48,  1.44it/s]
 23%|██▎       | 15052/65536 [2:48:47<9:33:24,  1.47it/s]
 23%|██▎       | 15053/65536 [2:48:48<9:36:47,  1.46it/s]
 23%|██▎       | 15054/65536 [2:48:48<9:28:34,  1.48it/s]
 23%|██▎       | 15055/65536 [2:48:49<9:15:15,  1.52it/s]
 23%|██▎       | 15056/65536 [2:48:50<9:29:35,  1.48it/s]
 23%|██▎       | 15057/65536 [2:48:50<9:18:35,  1.51it/s]
 23%|██▎       | 15058/65536 [2:48:51<9:04:56,  1.54it/s]
 23%|██▎       | 15059/65536 [2:48:52<9:08:53,  1.53it/s]
 23%|██▎       | 15060/65536 [2:48:52<9:18:31,  1.51it/s]
                                                         
{'loss': 0.9328, 'learning_rate': 7.953042732949675e-07, 'epoch': 929.63}

 23%|██▎       | 15060/65536 [2:48:52<9:18:31,  1.51it/s]
 23%|██▎       | 15061/65536 [2:48:53<9:17:08,  1.51it/s]
 23%|██▎       | 15062/65536 [2:48:54<9:18:27,  1.51it/s]
 23%|██▎       | 15063/65536 [2:48:54<9:05:43,  1.54it/s]
 23%|██▎       | 15064/65536 [2:48:55<9:25:30,  1.49it/s]
 23%|██▎       | 15065/65536 [2:48:56<9:21:24,  1.50it/s]
 23%|██▎       | 15066/65536 [2:48:56<9:23:46,  1.49it/s]
 23%|██▎       | 15067/65536 [2:48:57<9:34:38,  1.46it/s]
 23%|██▎       | 15068/65536 [2:48:58<9:17:53,  1.51it/s]
 23%|██▎       | 15069/65536 [2:48:58<9:23:37,  1.49it/s]
 23%|██▎       | 15070/65536 [2:48:59<9:23:21,  1.49it/s]
 23%|██▎       | 15071/65536 [2:49:00<9:32:11,  1.47it/s]
 23%|██▎       | 15072/65536 [2:49:01<9:42:15,  1.44it/s]
 23%|██▎       | 15073/65536 [2:49:01<9:44:36,  1.44it/s]
 23%|██▎       | 15074/65536 [2:49:02<9:39:44,  1.45it/s]
 23%|██▎       | 15075/65536 [2:49:03<9:41:14,  1.45it/s]
 23%|██▎       | 15076/65536 [2:49:03<9:33:13,  1.47it/s]
 23%|██▎       | 15077/65536 [2:49:04<9:13:16,  1.52it/s]
 23%|██▎       | 15078/65536 [2:49:05<9:16:03,  1.51it/s]
 23%|██▎       | 15079/65536 [2:49:05<9:16:02,  1.51it/s]
 23%|██▎       | 15080/65536 [2:49:06<9:15:29,  1.51it/s]
                                                         
{'loss': 0.9235, 'learning_rate': 7.950287743357414e-07, 'epoch': 930.86}

 23%|██▎       | 15080/65536 [2:49:06<9:15:29,  1.51it/s]
 23%|██▎       | 15081/65536 [2:49:07<9:21:07,  1.50it/s]
 23%|██▎       | 15082/65536 [2:49:07<9:15:36,  1.51it/s]
 23%|██▎       | 15083/65536 [2:49:08<9:37:24,  1.46it/s]
 23%|██▎       | 15084/65536 [2:49:09<9:15:29,  1.51it/s]
 23%|██▎       | 15085/65536 [2:49:09<9:15:15,  1.51it/s]
 23%|██▎       | 15086/65536 [2:49:10<9:05:21,  1.54it/s]
 23%|██▎       | 15087/65536 [2:49:11<9:25:59,  1.49it/s]
 23%|██▎       | 15088/65536 [2:49:11<9:17:36,  1.51it/s]
 23%|██▎       | 15089/65536 [2:49:12<9:15:58,  1.51it/s]
 23%|██▎       | 15090/65536 [2:49:13<9:35:51,  1.46it/s]
 23%|██▎       | 15091/65536 [2:49:13<9:29:50,  1.48it/s]
 23%|██▎       | 15092/65536 [2:49:14<9:17:49,  1.51it/s]
 23%|██▎       | 15093/65536 [2:49:15<9:15:58,  1.51it/s]
 23%|██▎       | 15094/65536 [2:49:15<9:23:58,  1.49it/s]
 23%|██▎       | 15095/65536 [2:49:16<9:23:46,  1.49it/s]
 23%|██▎       | 15096/65536 [2:49:17<9:20:36,  1.50it/s]
 23%|██▎       | 15097/65536 [2:49:17<9:39:21,  1.45it/s]
 23%|██▎       | 15098/65536 [2:49:18<9:49:20,  1.43it/s]
 23%|██▎       | 15099/65536 [2:49:19<10:04:54,  1.39it/s]
 23%|██▎       | 15100/65536 [2:49:19<9:45:57,  1.43it/s] 
                                                         
{'loss': 0.9263, 'learning_rate': 7.947532753765153e-07, 'epoch': 932.1}

 23%|██▎       | 15100/65536 [2:49:19<9:45:57,  1.43it/s]
 23%|██▎       | 15101/65536 [2:49:20<9:41:44,  1.44it/s]
 23%|██▎       | 15102/65536 [2:49:21<9:41:11,  1.45it/s]
 23%|██▎       | 15103/65536 [2:49:21<9:27:56,  1.48it/s]
 23%|██▎       | 15104/65536 [2:49:22<9:35:35,  1.46it/s]
 23%|██▎       | 15105/65536 [2:49:23<9:44:03,  1.44it/s]
 23%|██▎       | 15106/65536 [2:49:24<9:47:19,  1.43it/s]
 23%|██▎       | 15107/65536 [2:49:24<9:36:51,  1.46it/s]
 23%|██▎       | 15108/65536 [2:49:25<9:35:42,  1.46it/s]
 23%|██▎       | 15109/65536 [2:49:26<9:29:07,  1.48it/s]
 23%|██▎       | 15110/65536 [2:49:26<9:19:32,  1.50it/s]
 23%|██▎       | 15111/65536 [2:49:27<9:06:00,  1.54it/s]
 23%|██▎       | 15112/65536 [2:49:27<8:57:18,  1.56it/s]
 23%|██▎       | 15113/65536 [2:49:28<9:12:52,  1.52it/s]
 23%|██▎       | 15114/65536 [2:49:29<9:11:50,  1.52it/s]
 23%|██▎       | 15115/65536 [2:49:29<9:24:40,  1.49it/s]
 23%|██▎       | 15116/65536 [2:49:30<9:24:55,  1.49it/s]
 23%|██▎       | 15117/65536 [2:49:31<9:23:03,  1.49it/s]
 23%|██▎       | 15118/65536 [2:49:32<9:41:42,  1.44it/s]
 23%|██▎       | 15119/65536 [2:49:32<9:35:32,  1.46it/s]
 23%|██▎       | 15120/65536 [2:49:33<9:23:13,  1.49it/s]
                                                         
{'loss': 0.9289, 'learning_rate': 7.94477776417289e-07, 'epoch': 933.33}

 23%|██▎       | 15120/65536 [2:49:33<9:23:13,  1.49it/s]
 23%|██▎       | 15121/65536 [2:49:34<9:24:39,  1.49it/s]
 23%|██▎       | 15122/65536 [2:49:34<9:39:16,  1.45it/s]
 23%|██▎       | 15123/65536 [2:49:35<9:27:07,  1.48it/s]
 23%|██▎       | 15124/65536 [2:49:36<9:20:18,  1.50it/s]
 23%|██▎       | 15125/65536 [2:49:36<9:20:43,  1.50it/s]
 23%|██▎       | 15126/65536 [2:49:37<9:11:45,  1.52it/s]
 23%|██▎       | 15127/65536 [2:49:38<9:18:53,  1.50it/s]
 23%|██▎       | 15128/65536 [2:49:38<9:21:15,  1.50it/s]
 23%|██▎       | 15129/65536 [2:49:39<9:21:46,  1.50it/s]
 23%|██▎       | 15130/65536 [2:49:40<9:23:07,  1.49it/s]
 23%|██▎       | 15131/65536 [2:49:40<9:41:31,  1.44it/s]
 23%|██▎       | 15132/65536 [2:49:41<9:39:29,  1.45it/s]
 23%|██▎       | 15133/65536 [2:49:42<9:31:06,  1.47it/s]
 23%|██▎       | 15134/65536 [2:49:42<9:30:40,  1.47it/s]
 23%|██▎       | 15135/65536 [2:49:43<9:47:13,  1.43it/s]
 23%|██▎       | 15136/65536 [2:49:44<9:35:26,  1.46it/s]
 23%|██▎       | 15137/65536 [2:49:44<9:36:05,  1.46it/s]
 23%|██▎       | 15138/65536 [2:49:45<9:29:05,  1.48it/s]
 23%|██▎       | 15139/65536 [2:49:46<9:21:49,  1.50it/s]
 23%|██▎       | 15140/65536 [2:49:46<9:22:40,  1.49it/s]
                                                         
{'loss': 0.9243, 'learning_rate': 7.942022774580629e-07, 'epoch': 934.57}

 23%|██▎       | 15140/65536 [2:49:46<9:22:40,  1.49it/s]
 23%|██▎       | 15141/65536 [2:49:47<9:16:26,  1.51it/s]
 23%|██▎       | 15142/65536 [2:49:48<9:27:48,  1.48it/s]
 23%|██▎       | 15143/65536 [2:49:48<9:37:28,  1.45it/s]
 23%|██▎       | 15144/65536 [2:49:49<9:35:41,  1.46it/s]
 23%|██▎       | 15145/65536 [2:49:50<9:22:25,  1.49it/s]
 23%|██▎       | 15146/65536 [2:49:50<9:19:15,  1.50it/s]
 23%|██▎       | 15147/65536 [2:49:51<9:29:23,  1.47it/s]
 23%|██▎       | 15148/65536 [2:49:52<9:47:52,  1.43it/s]
 23%|██▎       | 15149/65536 [2:49:53<9:44:51,  1.44it/s]
 23%|██▎       | 15150/65536 [2:49:53<9:44:26,  1.44it/s]
 23%|██▎       | 15151/65536 [2:49:54<9:38:08,  1.45it/s]
 23%|██▎       | 15152/65536 [2:49:55<9:30:47,  1.47it/s]
 23%|██▎       | 15153/65536 [2:49:55<9:32:37,  1.47it/s]
 23%|██▎       | 15154/65536 [2:49:56<9:27:18,  1.48it/s]
 23%|██▎       | 15155/65536 [2:49:57<9:05:53,  1.54it/s]
 23%|██▎       | 15156/65536 [2:49:57<9:02:41,  1.55it/s]
 23%|██▎       | 15157/65536 [2:49:58<9:10:57,  1.52it/s]
 23%|██▎       | 15158/65536 [2:49:59<9:11:51,  1.52it/s]
 23%|██▎       | 15159/65536 [2:49:59<9:11:59,  1.52it/s]
 23%|██▎       | 15160/65536 [2:50:00<9:33:48,  1.46it/s]
                                                         
{'loss': 0.901, 'learning_rate': 7.939267784988367e-07, 'epoch': 935.8}

 23%|██▎       | 15160/65536 [2:50:00<9:33:48,  1.46it/s]
 23%|██▎       | 15161/65536 [2:50:01<9:41:09,  1.44it/s]
 23%|██▎       | 15162/65536 [2:50:01<9:25:54,  1.48it/s]
 23%|██▎       | 15163/65536 [2:50:02<9:28:02,  1.48it/s]
 23%|██▎       | 15164/65536 [2:50:03<9:52:34,  1.42it/s]
 23%|██▎       | 15165/65536 [2:50:03<9:40:24,  1.45it/s]
 23%|██▎       | 15166/65536 [2:50:04<9:21:14,  1.50it/s]
 23%|██▎       | 15167/65536 [2:50:05<9:16:24,  1.51it/s]
 23%|██▎       | 15168/65536 [2:50:05<9:31:14,  1.47it/s]
 23%|██▎       | 15169/65536 [2:50:06<9:11:25,  1.52it/s]
 23%|██▎       | 15170/65536 [2:50:07<9:07:15,  1.53it/s]
 23%|██▎       | 15171/65536 [2:50:07<9:23:33,  1.49it/s]
 23%|██▎       | 15172/65536 [2:50:08<9:19:48,  1.50it/s]
 23%|██▎       | 15173/65536 [2:50:09<9:33:33,  1.46it/s]
 23%|██▎       | 15174/65536 [2:50:09<9:18:00,  1.50it/s]
 23%|██▎       | 15175/65536 [2:50:10<9:18:44,  1.50it/s]
 23%|██▎       | 15176/65536 [2:50:11<9:28:27,  1.48it/s]
 23%|██▎       | 15177/65536 [2:50:11<9:37:14,  1.45it/s]
 23%|██▎       | 15178/65536 [2:50:12<9:32:52,  1.47it/s]
 23%|██▎       | 15179/65536 [2:50:13<9:23:34,  1.49it/s]
 23%|██▎       | 15180/65536 [2:50:13<9:45:03,  1.43it/s]
                                                         
{'loss': 0.9257, 'learning_rate': 7.936512795396106e-07, 'epoch': 937.04}

 23%|██▎       | 15180/65536 [2:50:13<9:45:03,  1.43it/s]
 23%|██▎       | 15181/65536 [2:50:14<9:45:27,  1.43it/s]
 23%|██▎       | 15182/65536 [2:50:15<9:38:57,  1.45it/s]
 23%|██▎       | 15183/65536 [2:50:16<9:37:20,  1.45it/s]
 23%|██▎       | 15184/65536 [2:50:16<9:23:57,  1.49it/s]
 23%|██▎       | 15185/65536 [2:50:17<9:12:24,  1.52it/s]
 23%|██▎       | 15186/65536 [2:50:17<9:16:25,  1.51it/s]
 23%|██▎       | 15187/65536 [2:50:18<9:23:28,  1.49it/s]
 23%|██▎       | 15188/65536 [2:50:19<9:25:46,  1.48it/s]
 23%|██▎       | 15189/65536 [2:50:20<9:20:56,  1.50it/s]
 23%|██▎       | 15190/65536 [2:50:20<9:19:05,  1.50it/s]
 23%|██▎       | 15191/65536 [2:50:21<9:20:06,  1.50it/s]
 23%|██▎       | 15192/65536 [2:50:21<9:18:33,  1.50it/s]
 23%|██▎       | 15193/65536 [2:50:22<9:28:12,  1.48it/s]
 23%|██▎       | 15194/65536 [2:50:23<9:06:01,  1.54it/s]
 23%|██▎       | 15195/65536 [2:50:23<9:05:43,  1.54it/s]
 23%|██▎       | 15196/65536 [2:50:24<9:34:48,  1.46it/s]
 23%|██▎       | 15197/65536 [2:50:25<9:20:04,  1.50it/s]
 23%|██▎       | 15198/65536 [2:50:25<9:19:16,  1.50it/s]
 23%|██▎       | 15199/65536 [2:50:26<9:12:48,  1.52it/s]
 23%|██▎       | 15200/65536 [2:50:27<9:24:44,  1.49it/s]
                                                         
{'loss': 0.9401, 'learning_rate': 7.933757805803845e-07, 'epoch': 938.27}

 23%|██▎       | 15200/65536 [2:50:27<9:24:44,  1.49it/s]
 23%|██▎       | 15201/65536 [2:50:28<9:35:20,  1.46it/s]
 23%|██▎       | 15202/65536 [2:50:28<9:33:10,  1.46it/s]
 23%|██▎       | 15203/65536 [2:50:29<9:18:56,  1.50it/s]
 23%|██▎       | 15204/65536 [2:50:30<9:20:21,  1.50it/s]
 23%|██▎       | 15205/65536 [2:50:30<9:04:14,  1.54it/s]
 23%|██▎       | 15206/65536 [2:50:31<9:11:15,  1.52it/s]
 23%|██▎       | 15207/65536 [2:50:32<9:26:19,  1.48it/s]
 23%|██▎       | 15208/65536 [2:50:32<9:18:03,  1.50it/s]
 23%|██▎       | 15209/65536 [2:50:33<9:18:29,  1.50it/s]
 23%|██▎       | 15210/65536 [2:50:34<9:18:35,  1.50it/s]
 23%|██▎       | 15211/65536 [2:50:34<9:31:02,  1.47it/s]
 23%|██▎       | 15212/65536 [2:50:35<9:48:24,  1.43it/s]
 23%|██▎       | 15213/65536 [2:50:36<9:22:01,  1.49it/s]
 23%|██▎       | 15214/65536 [2:50:36<9:18:41,  1.50it/s]
 23%|██▎       | 15215/65536 [2:50:37<9:17:39,  1.50it/s]
 23%|██▎       | 15216/65536 [2:50:38<9:24:06,  1.49it/s]
 23%|██▎       | 15217/65536 [2:50:38<9:16:12,  1.51it/s]
 23%|██▎       | 15218/65536 [2:50:39<9:28:17,  1.48it/s]
 23%|██▎       | 15219/65536 [2:50:40<9:21:09,  1.49it/s]
 23%|██▎       | 15220/65536 [2:50:40<9:37:52,  1.45it/s]
                                                         
{'loss': 0.9275, 'learning_rate': 7.931002816211582e-07, 'epoch': 939.51}

 23%|██▎       | 15220/65536 [2:50:40<9:37:52,  1.45it/s]
 23%|██▎       | 15221/65536 [2:50:41<9:31:49,  1.47it/s]
 23%|██▎       | 15222/65536 [2:50:42<9:20:03,  1.50it/s]
 23%|██▎       | 15223/65536 [2:50:42<9:24:56,  1.48it/s]
 23%|██▎       | 15224/65536 [2:50:43<9:10:21,  1.52it/s]
 23%|██▎       | 15225/65536 [2:50:44<9:10:32,  1.52it/s]
 23%|██▎       | 15226/65536 [2:50:44<8:54:27,  1.57it/s]
 23%|██▎       | 15227/65536 [2:50:45<9:08:16,  1.53it/s]
 23%|██▎       | 15228/65536 [2:50:46<9:25:25,  1.48it/s]
 23%|██▎       | 15229/65536 [2:50:46<9:35:57,  1.46it/s]
 23%|██▎       | 15230/65536 [2:50:47<9:40:52,  1.44it/s]
 23%|██▎       | 15231/65536 [2:50:48<9:38:06,  1.45it/s]
 23%|██▎       | 15232/65536 [2:50:48<9:42:57,  1.44it/s]
 23%|██▎       | 15233/65536 [2:50:49<9:25:02,  1.48it/s]
 23%|██▎       | 15234/65536 [2:50:50<9:29:29,  1.47it/s]
 23%|██▎       | 15235/65536 [2:50:50<9:24:36,  1.48it/s]
 23%|██▎       | 15236/65536 [2:50:51<9:20:11,  1.50it/s]
 23%|██▎       | 15237/65536 [2:50:52<9:17:26,  1.50it/s]
 23%|██▎       | 15238/65536 [2:50:52<9:27:31,  1.48it/s]
 23%|██▎       | 15239/65536 [2:50:53<9:23:29,  1.49it/s]
 23%|██▎       | 15240/65536 [2:50:54<9:17:53,  1.50it/s]
                                                         
{'loss': 0.9412, 'learning_rate': 7.928247826619321e-07, 'epoch': 940.74}

 23%|██▎       | 15240/65536 [2:50:54<9:17:53,  1.50it/s]
 23%|██▎       | 15241/65536 [2:50:54<9:18:16,  1.50it/s]
 23%|██▎       | 15242/65536 [2:50:55<9:06:06,  1.53it/s]
 23%|██▎       | 15243/65536 [2:50:56<9:20:24,  1.50it/s]
 23%|██▎       | 15244/65536 [2:50:56<9:20:52,  1.49it/s]
 23%|██▎       | 15245/65536 [2:50:57<9:33:05,  1.46it/s]
 23%|██▎       | 15246/65536 [2:50:58<9:26:45,  1.48it/s]
 23%|██▎       | 15247/65536 [2:50:58<9:19:12,  1.50it/s]
 23%|██▎       | 15248/65536 [2:50:59<9:28:18,  1.47it/s]
 23%|██▎       | 15249/65536 [2:51:00<9:22:03,  1.49it/s]
 23%|██▎       | 15250/65536 [2:51:00<9:09:11,  1.53it/s]
 23%|██▎       | 15251/65536 [2:51:01<9:09:54,  1.52it/s]
 23%|██▎       | 15252/65536 [2:51:02<9:07:57,  1.53it/s]
 23%|██▎       | 15253/65536 [2:51:02<9:25:52,  1.48it/s]
 23%|██▎       | 15254/65536 [2:51:03<9:17:38,  1.50it/s]
 23%|██▎       | 15255/65536 [2:51:04<9:31:41,  1.47it/s]
 23%|██▎       | 15256/65536 [2:51:04<9:20:55,  1.49it/s]
 23%|██▎       | 15257/65536 [2:51:05<9:26:31,  1.48it/s]
 23%|██▎       | 15258/65536 [2:51:06<9:31:49,  1.47it/s]
 23%|██▎       | 15259/65536 [2:51:06<9:23:24,  1.49it/s]
 23%|██▎       | 15260/65536 [2:51:07<9:19:21,  1.50it/s]
                                                         
{'loss': 0.9298, 'learning_rate': 7.925492837027059e-07, 'epoch': 941.98}

 23%|██▎       | 15260/65536 [2:51:07<9:19:21,  1.50it/s]
 23%|██▎       | 15261/65536 [2:51:08<9:45:16,  1.43it/s]
 23%|██▎       | 15262/65536 [2:51:09<9:31:57,  1.46it/s]
 23%|██▎       | 15263/65536 [2:51:09<9:23:25,  1.49it/s]
 23%|██▎       | 15264/65536 [2:51:10<9:23:18,  1.49it/s]
 23%|██▎       | 15265/65536 [2:51:10<9:00:18,  1.55it/s]
 23%|██▎       | 15266/65536 [2:51:11<9:09:28,  1.52it/s]
 23%|██▎       | 15267/65536 [2:51:12<9:03:49,  1.54it/s]
 23%|██▎       | 15268/65536 [2:51:12<9:09:22,  1.53it/s]
 23%|██▎       | 15269/65536 [2:51:13<9:07:59,  1.53it/s]
 23%|██▎       | 15270/65536 [2:51:14<9:36:46,  1.45it/s]
 23%|██▎       | 15271/65536 [2:51:14<9:20:36,  1.49it/s]
 23%|██▎       | 15272/65536 [2:51:15<9:30:00,  1.47it/s]
 23%|██▎       | 15273/65536 [2:51:16<9:32:46,  1.46it/s]
 23%|██▎       | 15274/65536 [2:51:17<9:29:15,  1.47it/s]
 23%|██▎       | 15275/65536 [2:51:17<9:22:35,  1.49it/s]
 23%|██▎       | 15276/65536 [2:51:18<9:28:17,  1.47it/s]
 23%|██▎       | 15277/65536 [2:51:19<9:57:58,  1.40it/s]
 23%|██▎       | 15278/65536 [2:51:19<9:53:14,  1.41it/s]
 23%|██▎       | 15279/65536 [2:51:20<9:45:20,  1.43it/s]
 23%|██▎       | 15280/65536 [2:51:21<9:34:22,  1.46it/s]
                                                         
{'loss': 0.9342, 'learning_rate': 7.922737847434798e-07, 'epoch': 943.21}

 23%|██▎       | 15280/65536 [2:51:21<9:34:22,  1.46it/s]
 23%|██▎       | 15281/65536 [2:51:21<9:42:32,  1.44it/s]
 23%|██▎       | 15282/65536 [2:51:22<9:44:02,  1.43it/s]
 23%|██▎       | 15283/65536 [2:51:23<9:33:41,  1.46it/s]
 23%|██▎       | 15284/65536 [2:51:23<9:20:28,  1.49it/s]
 23%|██▎       | 15285/65536 [2:51:24<9:17:37,  1.50it/s]
 23%|██▎       | 15286/65536 [2:51:25<9:15:11,  1.51it/s]
 23%|██▎       | 15287/65536 [2:51:25<9:22:38,  1.49it/s]
 23%|██▎       | 15288/65536 [2:51:26<9:15:26,  1.51it/s]
 23%|██▎       | 15289/65536 [2:51:27<9:11:10,  1.52it/s]
 23%|██▎       | 15290/65536 [2:51:27<9:04:35,  1.54it/s]
 23%|██▎       | 15291/65536 [2:51:28<8:53:31,  1.57it/s]
 23%|██▎       | 15292/65536 [2:51:29<9:01:25,  1.55it/s]
 23%|██▎       | 15293/65536 [2:51:29<9:26:03,  1.48it/s]
 23%|██▎       | 15294/65536 [2:51:30<9:24:37,  1.48it/s]
 23%|██▎       | 15295/65536 [2:51:31<9:15:47,  1.51it/s]
 23%|██▎       | 15296/65536 [2:51:31<9:09:10,  1.52it/s]
 23%|██▎       | 15297/65536 [2:51:32<9:13:32,  1.51it/s]
 23%|██▎       | 15298/65536 [2:51:33<9:28:05,  1.47it/s]
 23%|██▎       | 15299/65536 [2:51:33<9:09:24,  1.52it/s]
 23%|██▎       | 15300/65536 [2:51:34<9:06:27,  1.53it/s]
                                                         
{'loss': 0.9299, 'learning_rate': 7.919982857842536e-07, 'epoch': 944.44}

 23%|██▎       | 15300/65536 [2:51:34<9:06:27,  1.53it/s]
 23%|██▎       | 15301/65536 [2:51:35<8:55:08,  1.56it/s]
 23%|██▎       | 15302/65536 [2:51:35<8:57:21,  1.56it/s]
 23%|██▎       | 15303/65536 [2:51:36<9:08:39,  1.53it/s]
 23%|██▎       | 15304/65536 [2:51:36<9:01:44,  1.55it/s]
 23%|██▎       | 15305/65536 [2:51:37<9:07:44,  1.53it/s]
 23%|██▎       | 15306/65536 [2:51:38<9:27:08,  1.48it/s]
 23%|██▎       | 15307/65536 [2:51:39<9:39:54,  1.44it/s]
 23%|██▎       | 15308/65536 [2:51:39<9:39:24,  1.44it/s]
 23%|██▎       | 15309/65536 [2:51:40<9:30:33,  1.47it/s]
 23%|██▎       | 15310/65536 [2:51:41<9:51:34,  1.42it/s]
 23%|██▎       | 15311/65536 [2:51:41<9:50:30,  1.42it/s]
 23%|██▎       | 15312/65536 [2:51:42<9:45:01,  1.43it/s]
 23%|██▎       | 15313/65536 [2:51:43<9:34:33,  1.46it/s]
 23%|██▎       | 15314/65536 [2:51:43<9:30:15,  1.47it/s]
 23%|██▎       | 15315/65536 [2:51:44<9:29:31,  1.47it/s]
 23%|██▎       | 15316/65536 [2:51:45<9:23:40,  1.48it/s]
 23%|██▎       | 15317/65536 [2:51:45<9:24:05,  1.48it/s]
 23%|██▎       | 15318/65536 [2:51:46<9:14:30,  1.51it/s]
 23%|██▎       | 15319/65536 [2:51:47<9:05:51,  1.53it/s]
 23%|██▎       | 15320/65536 [2:51:47<9:00:52,  1.55it/s]
                                                         
{'loss': 0.9284, 'learning_rate': 7.917227868250275e-07, 'epoch': 945.68}

 23%|██▎       | 15320/65536 [2:51:47<9:00:52,  1.55it/s]
 23%|██▎       | 15321/65536 [2:51:48<9:09:32,  1.52it/s]
 23%|██▎       | 15322/65536 [2:51:49<9:18:15,  1.50it/s]
 23%|██▎       | 15323/65536 [2:51:49<9:14:47,  1.51it/s]
 23%|██▎       | 15324/65536 [2:51:50<9:15:40,  1.51it/s]
 23%|██▎       | 15325/65536 [2:51:51<9:26:48,  1.48it/s]
 23%|██▎       | 15326/65536 [2:51:51<9:40:45,  1.44it/s]
 23%|██▎       | 15327/65536 [2:51:52<9:39:24,  1.44it/s]
 23%|██▎       | 15328/65536 [2:51:53<9:23:26,  1.49it/s]
 23%|██▎       | 15329/65536 [2:51:53<9:12:24,  1.51it/s]
 23%|██▎       | 15330/65536 [2:51:54<9:12:25,  1.51it/s]
 23%|██▎       | 15331/65536 [2:51:55<9:26:30,  1.48it/s]
 23%|██▎       | 15332/65536 [2:51:55<9:24:08,  1.48it/s]
 23%|██▎       | 15333/65536 [2:51:56<9:26:35,  1.48it/s]
 23%|██▎       | 15334/65536 [2:51:57<9:22:57,  1.49it/s]
 23%|██▎       | 15335/65536 [2:51:58<9:35:19,  1.45it/s]
 23%|██▎       | 15336/65536 [2:51:58<9:21:10,  1.49it/s]
 23%|██▎       | 15337/65536 [2:51:59<9:11:45,  1.52it/s]
 23%|██▎       | 15338/65536 [2:51:59<9:08:43,  1.52it/s]
 23%|██▎       | 15339/65536 [2:52:00<9:03:25,  1.54it/s]
 23%|██▎       | 15340/65536 [2:52:01<8:54:06,  1.57it/s]
                                                         
{'loss': 0.9399, 'learning_rate': 7.914472878658014e-07, 'epoch': 946.91}

 23%|██▎       | 15340/65536 [2:52:01<8:54:06,  1.57it/s]
 23%|██▎       | 15341/65536 [2:52:01<8:58:40,  1.55it/s]
 23%|██▎       | 15342/65536 [2:52:02<9:31:14,  1.46it/s]
 23%|██▎       | 15343/65536 [2:52:03<9:30:09,  1.47it/s]
 23%|██▎       | 15344/65536 [2:52:03<9:03:32,  1.54it/s]
 23%|██▎       | 15345/65536 [2:52:04<9:01:47,  1.54it/s]
 23%|██▎       | 15346/65536 [2:52:05<9:03:01,  1.54it/s]
 23%|██▎       | 15347/65536 [2:52:05<9:15:50,  1.50it/s]
 23%|██▎       | 15348/65536 [2:52:06<9:26:38,  1.48it/s]
 23%|██▎       | 15349/65536 [2:52:07<9:19:17,  1.50it/s]
 23%|██▎       | 15350/65536 [2:52:07<9:11:51,  1.52it/s]
 23%|██▎       | 15351/65536 [2:52:08<9:14:36,  1.51it/s]
 23%|██▎       | 15352/65536 [2:52:09<9:08:52,  1.52it/s]
 23%|██▎       | 15353/65536 [2:52:09<9:21:28,  1.49it/s]
 23%|██▎       | 15354/65536 [2:52:10<9:12:47,  1.51it/s]
 23%|██▎       | 15355/65536 [2:52:11<9:26:12,  1.48it/s]
 23%|██▎       | 15356/65536 [2:52:11<9:28:48,  1.47it/s]
 23%|██▎       | 15357/65536 [2:52:12<9:29:23,  1.47it/s]
 23%|██▎       | 15358/65536 [2:52:13<9:38:52,  1.44it/s]
 23%|██▎       | 15359/65536 [2:52:13<9:14:50,  1.51it/s]
 23%|██▎       | 15360/65536 [2:52:14<9:21:49,  1.49it/s]
                                                         
{'loss': 0.9506, 'learning_rate': 7.911717889065752e-07, 'epoch': 948.15}

 23%|██▎       | 15360/65536 [2:52:14<9:21:49,  1.49it/s]
 23%|██▎       | 15361/65536 [2:52:15<9:29:34,  1.47it/s]
 23%|██▎       | 15362/65536 [2:52:16<9:28:02,  1.47it/s]
 23%|██▎       | 15363/65536 [2:52:16<9:23:33,  1.48it/s]
 23%|██▎       | 15364/65536 [2:52:17<9:27:51,  1.47it/s]
 23%|██▎       | 15365/65536 [2:52:17<9:16:08,  1.50it/s]
 23%|██▎       | 15366/65536 [2:52:18<9:31:37,  1.46it/s]
 23%|██▎       | 15367/65536 [2:52:19<9:40:36,  1.44it/s]
 23%|██▎       | 15368/65536 [2:52:20<9:29:47,  1.47it/s]
 23%|██▎       | 15369/65536 [2:52:20<9:19:48,  1.49it/s]
 23%|██▎       | 15370/65536 [2:52:21<9:00:14,  1.55it/s]
 23%|██▎       | 15371/65536 [2:52:21<9:05:37,  1.53it/s]
 23%|██▎       | 15372/65536 [2:52:22<9:05:14,  1.53it/s]
 23%|██▎       | 15373/65536 [2:52:23<9:18:00,  1.50it/s]
 23%|██▎       | 15374/65536 [2:52:24<9:28:00,  1.47it/s]
 23%|██▎       | 15375/65536 [2:52:24<9:22:34,  1.49it/s]
 23%|██▎       | 15376/65536 [2:52:25<9:31:41,  1.46it/s]
 23%|██▎       | 15377/65536 [2:52:26<9:34:15,  1.46it/s]
 23%|██▎       | 15378/65536 [2:52:26<9:34:52,  1.45it/s]
 23%|██▎       | 15379/65536 [2:52:27<9:31:38,  1.46it/s]
 23%|██▎       | 15380/65536 [2:52:28<9:33:11,  1.46it/s]
                                                         
{'loss': 0.9079, 'learning_rate': 7.908962899473489e-07, 'epoch': 949.38}

 23%|██▎       | 15380/65536 [2:52:28<9:33:11,  1.46it/s]
 23%|██▎       | 15381/65536 [2:52:28<9:37:38,  1.45it/s]
 23%|██▎       | 15382/65536 [2:52:29<9:20:21,  1.49it/s]
 23%|██▎       | 15383/65536 [2:52:30<9:08:35,  1.52it/s]
 23%|██▎       | 15384/65536 [2:52:30<9:06:12,  1.53it/s]
 23%|██▎       | 15385/65536 [2:52:31<9:05:44,  1.53it/s]
 23%|██▎       | 15386/65536 [2:52:32<9:06:36,  1.53it/s]
 23%|██▎       | 15387/65536 [2:52:32<9:09:17,  1.52it/s]
 23%|██▎       | 15388/65536 [2:52:33<9:08:24,  1.52it/s]
 23%|██▎       | 15389/65536 [2:52:34<9:10:16,  1.52it/s]
 23%|██▎       | 15390/65536 [2:52:34<9:04:30,  1.53it/s]
 23%|██▎       | 15391/65536 [2:52:35<9:49:16,  1.42it/s]
 23%|██▎       | 15392/65536 [2:52:36<9:53:09,  1.41it/s]
 23%|██▎       | 15393/65536 [2:52:36<9:27:05,  1.47it/s]
 23%|██▎       | 15394/65536 [2:52:37<9:14:04,  1.51it/s]
 23%|██▎       | 15395/65536 [2:52:38<9:16:52,  1.50it/s]
 23%|██▎       | 15396/65536 [2:52:38<9:15:52,  1.50it/s]
 23%|██▎       | 15397/65536 [2:52:39<9:10:06,  1.52it/s]
 23%|██▎       | 15398/65536 [2:52:40<8:59:20,  1.55it/s]
 23%|██▎       | 15399/65536 [2:52:40<9:16:59,  1.50it/s]
 23%|██▎       | 15400/65536 [2:52:41<9:27:52,  1.47it/s]
                                                         
{'loss': 0.9495, 'learning_rate': 7.906207909881228e-07, 'epoch': 950.62}

 23%|██▎       | 15400/65536 [2:52:41<9:27:52,  1.47it/s]
 24%|██▎       | 15401/65536 [2:52:42<9:35:41,  1.45it/s]
 24%|██▎       | 15402/65536 [2:52:42<9:27:11,  1.47it/s]
 24%|██▎       | 15403/65536 [2:52:43<9:18:26,  1.50it/s]
 24%|██▎       | 15404/65536 [2:52:44<9:21:06,  1.49it/s]
 24%|██▎       | 15405/65536 [2:52:44<9:11:24,  1.52it/s]
 24%|██▎       | 15406/65536 [2:52:45<9:02:19,  1.54it/s]
 24%|██▎       | 15407/65536 [2:52:46<9:46:59,  1.42it/s]
 24%|██▎       | 15408/65536 [2:52:46<9:39:28,  1.44it/s]
 24%|██▎       | 15409/65536 [2:52:47<9:24:08,  1.48it/s]
 24%|██▎       | 15410/65536 [2:52:48<9:35:07,  1.45it/s]
 24%|██▎       | 15411/65536 [2:52:48<9:25:58,  1.48it/s]
 24%|██▎       | 15412/65536 [2:52:49<9:12:20,  1.51it/s]
 24%|██▎       | 15413/65536 [2:52:50<9:11:49,  1.51it/s]
 24%|██▎       | 15414/65536 [2:52:50<9:14:17,  1.51it/s]
 24%|██▎       | 15415/65536 [2:52:51<9:16:08,  1.50it/s]
 24%|██▎       | 15416/65536 [2:52:52<9:22:21,  1.49it/s]
 24%|██▎       | 15417/65536 [2:52:52<9:21:40,  1.49it/s]
 24%|██▎       | 15418/65536 [2:52:53<9:20:34,  1.49it/s]
 24%|██▎       | 15419/65536 [2:52:54<9:10:21,  1.52it/s]
 24%|██▎       | 15420/65536 [2:52:54<9:10:58,  1.52it/s]
                                                         
{'loss': 0.9285, 'learning_rate': 7.903452920288967e-07, 'epoch': 951.85}

 24%|██▎       | 15420/65536 [2:52:54<9:10:58,  1.52it/s]
 24%|██▎       | 15421/65536 [2:52:55<9:23:16,  1.48it/s]
 24%|██▎       | 15422/65536 [2:52:56<9:12:00,  1.51it/s]
 24%|██▎       | 15423/65536 [2:52:56<9:34:13,  1.45it/s]
 24%|██▎       | 15424/65536 [2:52:57<9:45:13,  1.43it/s]
 24%|██▎       | 15425/65536 [2:52:58<9:19:06,  1.49it/s]
 24%|██▎       | 15426/65536 [2:52:58<9:11:17,  1.51it/s]
 24%|██▎       | 15427/65536 [2:52:59<9:03:11,  1.54it/s]
 24%|██▎       | 15428/65536 [2:53:00<9:04:26,  1.53it/s]
 24%|██▎       | 15429/65536 [2:53:00<9:05:10,  1.53it/s]
 24%|██▎       | 15430/65536 [2:53:01<9:04:40,  1.53it/s]
 24%|██▎       | 15431/65536 [2:53:02<9:02:09,  1.54it/s]
 24%|██▎       | 15432/65536 [2:53:02<9:10:51,  1.52it/s]
 24%|██▎       | 15433/65536 [2:53:03<9:15:19,  1.50it/s]
 24%|██▎       | 15434/65536 [2:53:04<9:05:42,  1.53it/s]
 24%|██▎       | 15435/65536 [2:53:04<9:06:17,  1.53it/s]
 24%|██▎       | 15436/65536 [2:53:05<9:28:08,  1.47it/s]
 24%|██▎       | 15437/65536 [2:53:06<9:30:56,  1.46it/s]
 24%|██▎       | 15438/65536 [2:53:06<9:22:23,  1.48it/s]
 24%|██▎       | 15439/65536 [2:53:07<9:38:54,  1.44it/s]
 24%|██▎       | 15440/65536 [2:53:08<9:36:01,  1.45it/s]
                                                         
{'loss': 0.9368, 'learning_rate': 7.900697930696705e-07, 'epoch': 953.09}

 24%|██▎       | 15440/65536 [2:53:08<9:36:01,  1.45it/s]
 24%|██▎       | 15441/65536 [2:53:09<9:50:10,  1.41it/s]
 24%|██▎       | 15442/65536 [2:53:09<9:35:33,  1.45it/s]
 24%|██▎       | 15443/65536 [2:53:10<9:27:01,  1.47it/s]
 24%|██▎       | 15444/65536 [2:53:10<9:08:54,  1.52it/s]
 24%|██▎       | 15445/65536 [2:53:11<9:12:49,  1.51it/s]
 24%|██▎       | 15446/65536 [2:53:12<9:18:34,  1.49it/s]
 24%|██▎       | 15447/65536 [2:53:12<9:15:01,  1.50it/s]
 24%|██▎       | 15448/65536 [2:53:13<9:06:29,  1.53it/s]
 24%|██▎       | 15449/65536 [2:53:14<9:07:07,  1.53it/s]
 24%|██▎       | 15450/65536 [2:53:14<9:11:11,  1.51it/s]
 24%|██▎       | 15451/65536 [2:53:15<9:16:52,  1.50it/s]
 24%|██▎       | 15452/65536 [2:53:16<9:26:13,  1.47it/s]
 24%|██▎       | 15453/65536 [2:53:17<9:41:30,  1.44it/s]
 24%|██▎       | 15454/65536 [2:53:17<9:31:25,  1.46it/s]
 24%|██▎       | 15455/65536 [2:53:18<9:36:21,  1.45it/s]
 24%|██▎       | 15456/65536 [2:53:19<9:49:47,  1.42it/s]
 24%|██▎       | 15457/65536 [2:53:19<9:45:28,  1.43it/s]
 24%|██▎       | 15458/65536 [2:53:20<9:22:13,  1.48it/s]
 24%|██▎       | 15459/65536 [2:53:21<9:24:46,  1.48it/s]
 24%|██▎       | 15460/65536 [2:53:21<9:27:26,  1.47it/s]
                                                         
{'loss': 0.9071, 'learning_rate': 7.897942941104444e-07, 'epoch': 954.32}

 24%|██▎       | 15460/65536 [2:53:21<9:27:26,  1.47it/s]
 24%|██▎       | 15461/65536 [2:53:22<9:32:31,  1.46it/s]
 24%|██▎       | 15462/65536 [2:53:23<9:29:33,  1.47it/s]
 24%|██▎       | 15463/65536 [2:53:23<9:21:41,  1.49it/s]
 24%|██▎       | 15464/65536 [2:53:24<9:18:04,  1.50it/s]
 24%|██▎       | 15465/65536 [2:53:25<9:17:22,  1.50it/s]
 24%|██▎       | 15466/65536 [2:53:25<9:20:10,  1.49it/s]
 24%|██▎       | 15467/65536 [2:53:26<9:27:32,  1.47it/s]
 24%|██▎       | 15468/65536 [2:53:27<9:17:36,  1.50it/s]
 24%|██▎       | 15469/65536 [2:53:27<9:04:03,  1.53it/s]
 24%|██▎       | 15470/65536 [2:53:28<9:18:10,  1.49it/s]
 24%|██▎       | 15471/65536 [2:53:29<9:19:20,  1.49it/s]
 24%|██▎       | 15472/65536 [2:53:29<9:29:48,  1.46it/s]
 24%|██▎       | 15473/65536 [2:53:30<9:19:13,  1.49it/s]
 24%|██▎       | 15474/65536 [2:53:31<9:32:28,  1.46it/s]
 24%|██▎       | 15475/65536 [2:53:31<9:25:07,  1.48it/s]
 24%|██▎       | 15476/65536 [2:53:32<9:12:51,  1.51it/s]
 24%|██▎       | 15477/65536 [2:53:33<9:10:29,  1.52it/s]
 24%|██▎       | 15478/65536 [2:53:33<9:27:57,  1.47it/s]
 24%|██▎       | 15479/65536 [2:53:34<9:27:43,  1.47it/s]
 24%|██▎       | 15480/65536 [2:53:35<9:21:46,  1.49it/s]
                                                         
{'loss': 0.9466, 'learning_rate': 7.895187951512183e-07, 'epoch': 955.56}

 24%|██▎       | 15480/65536 [2:53:35<9:21:46,  1.49it/s]
 24%|██▎       | 15481/65536 [2:53:35<9:13:30,  1.51it/s]
 24%|██▎       | 15482/65536 [2:53:36<9:12:29,  1.51it/s]
 24%|██▎       | 15483/65536 [2:53:37<9:16:07,  1.50it/s]
 24%|██▎       | 15484/65536 [2:53:37<9:12:46,  1.51it/s]
 24%|██▎       | 15485/65536 [2:53:38<9:18:00,  1.49it/s]
 24%|██▎       | 15486/65536 [2:53:39<9:23:02,  1.48it/s]
 24%|██▎       | 15487/65536 [2:53:39<9:05:02,  1.53it/s]
 24%|██▎       | 15488/65536 [2:53:40<9:29:13,  1.47it/s]
 24%|██▎       | 15489/65536 [2:53:41<9:13:21,  1.51it/s]
 24%|██▎       | 15490/65536 [2:53:41<9:21:29,  1.49it/s]
 24%|██▎       | 15491/65536 [2:53:42<9:22:37,  1.48it/s]
 24%|██▎       | 15492/65536 [2:53:43<9:19:39,  1.49it/s]
 24%|██▎       | 15493/65536 [2:53:43<9:11:05,  1.51it/s]
 24%|██▎       | 15494/65536 [2:53:44<9:20:45,  1.49it/s]
 24%|██▎       | 15495/65536 [2:53:45<9:04:21,  1.53it/s]
 24%|██▎       | 15496/65536 [2:53:45<9:09:50,  1.52it/s]
 24%|██▎       | 15497/65536 [2:53:46<9:19:11,  1.49it/s]
 24%|██▎       | 15498/65536 [2:53:47<9:05:07,  1.53it/s]
 24%|██▎       | 15499/65536 [2:53:47<9:16:59,  1.50it/s]
 24%|██▎       | 15500/65536 [2:53:48<9:16:15,  1.50it/s]
                                                         
{'loss': 0.9453, 'learning_rate': 7.892432961919921e-07, 'epoch': 956.79}

 24%|██▎       | 15500/65536 [2:53:48<9:16:15,  1.50it/s]
 24%|██▎       | 15501/65536 [2:53:49<9:30:30,  1.46it/s]
 24%|██▎       | 15502/65536 [2:53:49<9:20:14,  1.49it/s]
 24%|██▎       | 15503/65536 [2:53:50<9:12:31,  1.51it/s]
 24%|██▎       | 15504/65536 [2:53:51<9:37:06,  1.44it/s]
 24%|██▎       | 15505/65536 [2:53:52<9:37:08,  1.44it/s]
 24%|██▎       | 15506/65536 [2:53:52<9:29:09,  1.47it/s]
 24%|██▎       | 15507/65536 [2:53:53<9:37:15,  1.44it/s]
 24%|██▎       | 15508/65536 [2:53:54<9:25:39,  1.47it/s]
 24%|██▎       | 15509/65536 [2:53:54<9:27:02,  1.47it/s]
 24%|██▎       | 15510/65536 [2:53:55<9:29:35,  1.46it/s]
 24%|██▎       | 15511/65536 [2:53:56<9:20:23,  1.49it/s]
 24%|██▎       | 15512/65536 [2:53:56<9:07:43,  1.52it/s]
 24%|██▎       | 15513/65536 [2:53:57<9:14:08,  1.50it/s]
 24%|██▎       | 15514/65536 [2:53:58<9:09:26,  1.52it/s]
 24%|██▎       | 15515/65536 [2:53:58<9:17:49,  1.49it/s]
 24%|██▎       | 15516/65536 [2:53:59<9:10:52,  1.51it/s]
 24%|██▎       | 15517/65536 [2:54:00<9:16:00,  1.50it/s]
 24%|██▎       | 15518/65536 [2:54:00<9:24:19,  1.48it/s]
 24%|██▎       | 15519/65536 [2:54:01<9:13:43,  1.51it/s]
 24%|██▎       | 15520/65536 [2:54:02<9:38:22,  1.44it/s]
                                                         
{'loss': 0.9201, 'learning_rate': 7.88967797232766e-07, 'epoch': 958.02}

 24%|██▎       | 15520/65536 [2:54:02<9:38:22,  1.44it/s]
 24%|██▎       | 15521/65536 [2:54:02<9:27:23,  1.47it/s]
 24%|██▎       | 15522/65536 [2:54:03<9:17:13,  1.50it/s]
 24%|██▎       | 15523/65536 [2:54:04<9:06:54,  1.52it/s]
 24%|██▎       | 15524/65536 [2:54:04<9:17:45,  1.49it/s]
 24%|██▎       | 15525/65536 [2:54:05<9:13:54,  1.50it/s]
 24%|██▎       | 15526/65536 [2:54:06<9:06:15,  1.53it/s]
 24%|██▎       | 15527/65536 [2:54:06<8:55:47,  1.56it/s]
 24%|██▎       | 15528/65536 [2:54:07<9:18:00,  1.49it/s]
 24%|██▎       | 15529/65536 [2:54:08<9:18:41,  1.49it/s]
 24%|██▎       | 15530/65536 [2:54:08<9:08:28,  1.52it/s]
 24%|██▎       | 15531/65536 [2:54:09<9:09:04,  1.52it/s]
 24%|██▎       | 15532/65536 [2:54:10<9:04:24,  1.53it/s]
 24%|██▎       | 15533/65536 [2:54:10<9:22:17,  1.48it/s]
 24%|██▎       | 15534/65536 [2:54:11<9:22:08,  1.48it/s]
 24%|██▎       | 15535/65536 [2:54:12<9:29:22,  1.46it/s]
 24%|██▎       | 15536/65536 [2:54:12<9:53:33,  1.40it/s]
 24%|██▎       | 15537/65536 [2:54:13<9:46:44,  1.42it/s]
 24%|██▎       | 15538/65536 [2:54:14<9:53:45,  1.40it/s]
 24%|██▎       | 15539/65536 [2:54:14<9:42:25,  1.43it/s]
 24%|██▎       | 15540/65536 [2:54:15<9:31:31,  1.46it/s]
                                                         
{'loss': 0.9268, 'learning_rate': 7.886922982735398e-07, 'epoch': 959.26}

 24%|██▎       | 15540/65536 [2:54:15<9:31:31,  1.46it/s]
 24%|██▎       | 15541/65536 [2:54:16<9:16:01,  1.50it/s]
 24%|██▎       | 15542/65536 [2:54:16<9:17:29,  1.49it/s]
 24%|██▎       | 15543/65536 [2:54:17<9:31:18,  1.46it/s]
 24%|██▎       | 15544/65536 [2:54:18<9:32:50,  1.45it/s]
 24%|██▎       | 15545/65536 [2:54:19<9:20:15,  1.49it/s]
 24%|██▎       | 15546/65536 [2:54:19<9:20:28,  1.49it/s]
 24%|██▎       | 15547/65536 [2:54:20<9:08:57,  1.52it/s]
 24%|██▎       | 15548/65536 [2:54:20<8:53:38,  1.56it/s]
 24%|██▎       | 15549/65536 [2:54:21<8:54:38,  1.56it/s]
 24%|██▎       | 15550/65536 [2:54:22<8:50:56,  1.57it/s]
 24%|██▎       | 15551/65536 [2:54:22<8:56:49,  1.55it/s]
 24%|██▎       | 15552/65536 [2:54:23<9:08:40,  1.52it/s]
 24%|██▎       | 15553/65536 [2:54:24<9:34:28,  1.45it/s]
 24%|██▎       | 15554/65536 [2:54:24<9:29:00,  1.46it/s]
 24%|██▎       | 15555/65536 [2:54:25<9:15:50,  1.50it/s]
 24%|██▎       | 15556/65536 [2:54:26<9:18:25,  1.49it/s]
 24%|██▎       | 15557/65536 [2:54:26<9:11:35,  1.51it/s]
 24%|██▎       | 15558/65536 [2:54:27<9:22:48,  1.48it/s]
 24%|██▎       | 15559/65536 [2:54:28<9:16:23,  1.50it/s]
 24%|██▎       | 15560/65536 [2:54:28<9:25:37,  1.47it/s]
                                                         
{'loss': 0.9492, 'learning_rate': 7.884167993143137e-07, 'epoch': 960.49}

 24%|██▎       | 15560/65536 [2:54:28<9:25:37,  1.47it/s]
 24%|██▎       | 15561/65536 [2:54:29<9:32:22,  1.46it/s]
 24%|██▎       | 15562/65536 [2:54:30<9:23:05,  1.48it/s]
 24%|██▎       | 15563/65536 [2:54:30<9:15:30,  1.50it/s]
 24%|██▎       | 15564/65536 [2:54:31<9:11:24,  1.51it/s]
 24%|██▍       | 15565/65536 [2:54:32<9:11:23,  1.51it/s]
 24%|██▍       | 15566/65536 [2:54:32<9:13:40,  1.50it/s]
 24%|██▍       | 15567/65536 [2:54:33<9:13:53,  1.50it/s]
 24%|██▍       | 15568/65536 [2:54:34<9:14:56,  1.50it/s]
 24%|██▍       | 15569/65536 [2:54:35<9:43:44,  1.43it/s]
 24%|██▍       | 15570/65536 [2:54:35<9:32:43,  1.45it/s]
 24%|██▍       | 15571/65536 [2:54:36<9:35:39,  1.45it/s]
 24%|██▍       | 15572/65536 [2:54:37<9:17:13,  1.49it/s]
 24%|██▍       | 15573/65536 [2:54:37<9:15:01,  1.50it/s]
 24%|██▍       | 15574/65536 [2:54:38<9:10:15,  1.51it/s]
 24%|██▍       | 15575/65536 [2:54:38<9:03:40,  1.53it/s]
 24%|██▍       | 15576/65536 [2:54:39<9:13:12,  1.51it/s]
 24%|██▍       | 15577/65536 [2:54:40<9:14:38,  1.50it/s]
 24%|██▍       | 15578/65536 [2:54:41<9:17:53,  1.49it/s]
 24%|██▍       | 15579/65536 [2:54:41<9:23:11,  1.48it/s]
 24%|██▍       | 15580/65536 [2:54:42<9:24:03,  1.48it/s]
                                                         
{'loss': 0.9268, 'learning_rate': 7.881413003550876e-07, 'epoch': 961.73}

 24%|██▍       | 15580/65536 [2:54:42<9:24:03,  1.48it/s]
 24%|██▍       | 15581/65536 [2:54:43<9:34:46,  1.45it/s]
 24%|██▍       | 15582/65536 [2:54:43<9:23:52,  1.48it/s]
 24%|██▍       | 15583/65536 [2:54:44<9:13:27,  1.50it/s]
 24%|██▍       | 15584/65536 [2:54:45<9:27:59,  1.47it/s]
 24%|██▍       | 15585/65536 [2:54:45<9:36:01,  1.45it/s]
 24%|██▍       | 15586/65536 [2:54:46<9:51:18,  1.41it/s]
 24%|██▍       | 15587/65536 [2:54:47<9:41:40,  1.43it/s]
 24%|██▍       | 15588/65536 [2:54:47<9:35:00,  1.45it/s]
 24%|██▍       | 15589/65536 [2:54:48<9:34:27,  1.45it/s]
 24%|██▍       | 15590/65536 [2:54:49<9:14:44,  1.50it/s]
 24%|██▍       | 15591/65536 [2:54:49<9:06:43,  1.52it/s]
 24%|██▍       | 15592/65536 [2:54:50<9:11:16,  1.51it/s]
 24%|██▍       | 15593/65536 [2:54:51<9:09:46,  1.51it/s]
 24%|██▍       | 15594/65536 [2:54:51<9:22:08,  1.48it/s]
 24%|██▍       | 15595/65536 [2:54:52<9:16:45,  1.50it/s]
 24%|██▍       | 15596/65536 [2:54:53<9:19:25,  1.49it/s]
 24%|██▍       | 15597/65536 [2:54:53<9:32:42,  1.45it/s]
 24%|██▍       | 15598/65536 [2:54:54<9:27:59,  1.47it/s]
 24%|██▍       | 15599/65536 [2:54:55<9:13:19,  1.50it/s]
 24%|██▍       | 15600/65536 [2:54:55<9:16:39,  1.50it/s]
                                                         
{'loss': 0.9254, 'learning_rate': 7.878658013958614e-07, 'epoch': 962.96}

 24%|██▍       | 15600/65536 [2:54:55<9:16:39,  1.50it/s]
 24%|██▍       | 15601/65536 [2:54:56<9:48:59,  1.41it/s]
 24%|██▍       | 15602/65536 [2:54:57<9:40:13,  1.43it/s]
 24%|██▍       | 15603/65536 [2:54:58<9:27:35,  1.47it/s]
 24%|██▍       | 15604/65536 [2:54:58<9:34:30,  1.45it/s]
 24%|██▍       | 15605/65536 [2:54:59<9:14:09,  1.50it/s]
 24%|██▍       | 15606/65536 [2:55:00<9:29:08,  1.46it/s]
 24%|██▍       | 15607/65536 [2:55:00<9:27:45,  1.47it/s]
 24%|██▍       | 15608/65536 [2:55:01<9:24:42,  1.47it/s]
 24%|██▍       | 15609/65536 [2:55:02<9:34:54,  1.45it/s]
 24%|██▍       | 15610/65536 [2:55:02<9:17:17,  1.49it/s]
 24%|██▍       | 15611/65536 [2:55:03<9:03:20,  1.53it/s]
 24%|██▍       | 15612/65536 [2:55:04<9:21:38,  1.48it/s]
 24%|██▍       | 15613/65536 [2:55:04<9:14:31,  1.50it/s]
 24%|██▍       | 15614/65536 [2:55:05<9:17:14,  1.49it/s]
 24%|██▍       | 15615/65536 [2:55:06<9:18:12,  1.49it/s]
 24%|██▍       | 15616/65536 [2:55:06<9:20:01,  1.49it/s]
 24%|██▍       | 15617/65536 [2:55:07<9:39:40,  1.44it/s]
 24%|██▍       | 15618/65536 [2:55:08<9:27:02,  1.47it/s]
 24%|██▍       | 15619/65536 [2:55:08<9:24:40,  1.47it/s]
 24%|██▍       | 15620/65536 [2:55:09<9:32:32,  1.45it/s]
                                                         
{'loss': 0.9293, 'learning_rate': 7.875903024366353e-07, 'epoch': 964.2}

 24%|██▍       | 15620/65536 [2:55:09<9:32:32,  1.45it/s]
 24%|██▍       | 15621/65536 [2:55:10<9:20:55,  1.48it/s]
 24%|██▍       | 15622/65536 [2:55:10<9:40:02,  1.43it/s]
 24%|██▍       | 15623/65536 [2:55:11<9:24:54,  1.47it/s]
 24%|██▍       | 15624/65536 [2:55:12<9:10:39,  1.51it/s]
 24%|██▍       | 15625/65536 [2:55:12<9:04:33,  1.53it/s]
 24%|██▍       | 15626/65536 [2:55:13<9:23:08,  1.48it/s]
 24%|██▍       | 15627/65536 [2:55:14<9:21:44,  1.48it/s]
 24%|██▍       | 15628/65536 [2:55:14<9:12:38,  1.51it/s]
 24%|██▍       | 15629/65536 [2:55:15<9:21:12,  1.48it/s]
 24%|██▍       | 15630/65536 [2:55:16<9:22:13,  1.48it/s]
 24%|██▍       | 15631/65536 [2:55:16<9:15:23,  1.50it/s]
 24%|██▍       | 15632/65536 [2:55:17<9:06:05,  1.52it/s]
 24%|██▍       | 15633/65536 [2:55:18<9:34:50,  1.45it/s]
 24%|██▍       | 15634/65536 [2:55:19<9:50:36,  1.41it/s]
 24%|██▍       | 15635/65536 [2:55:19<9:31:09,  1.46it/s]
 24%|██▍       | 15636/65536 [2:55:20<9:30:04,  1.46it/s]
 24%|██▍       | 15637/65536 [2:55:21<9:22:18,  1.48it/s]
 24%|██▍       | 15638/65536 [2:55:21<9:14:18,  1.50it/s]
 24%|██▍       | 15639/65536 [2:55:22<9:21:56,  1.48it/s]
 24%|██▍       | 15640/65536 [2:55:23<9:16:26,  1.49it/s]
                                                         
{'loss': 0.9152, 'learning_rate': 7.873148034774091e-07, 'epoch': 965.43}

 24%|██▍       | 15640/65536 [2:55:23<9:16:26,  1.49it/s]
 24%|██▍       | 15641/65536 [2:55:23<9:03:07,  1.53it/s]
 24%|██▍       | 15642/65536 [2:55:24<9:08:48,  1.52it/s]
 24%|██▍       | 15643/65536 [2:55:25<9:22:58,  1.48it/s]
 24%|██▍       | 15644/65536 [2:55:25<9:21:30,  1.48it/s]
 24%|██▍       | 15645/65536 [2:55:26<9:22:44,  1.48it/s]
 24%|██▍       | 15646/65536 [2:55:27<9:23:32,  1.48it/s]
 24%|██▍       | 15647/65536 [2:55:27<9:23:42,  1.48it/s]
 24%|██▍       | 15648/65536 [2:55:28<9:35:52,  1.44it/s]
 24%|██▍       | 15649/65536 [2:55:29<9:27:43,  1.46it/s]
 24%|██▍       | 15650/65536 [2:55:29<9:50:49,  1.41it/s]
 24%|██▍       | 15651/65536 [2:55:30<9:39:55,  1.43it/s]
 24%|██▍       | 15652/65536 [2:55:31<9:47:32,  1.42it/s]
 24%|██▍       | 15653/65536 [2:55:32<9:41:00,  1.43it/s]
 24%|██▍       | 15654/65536 [2:55:32<9:27:14,  1.47it/s]
 24%|██▍       | 15655/65536 [2:55:33<9:14:27,  1.50it/s]
 24%|██▍       | 15656/65536 [2:55:33<9:12:16,  1.51it/s]
 24%|██▍       | 15657/65536 [2:55:34<9:09:02,  1.51it/s]
 24%|██▍       | 15658/65536 [2:55:35<9:14:39,  1.50it/s]
 24%|██▍       | 15659/65536 [2:55:35<9:13:31,  1.50it/s]
 24%|██▍       | 15660/65536 [2:55:36<9:08:41,  1.51it/s]
                                                         
{'loss': 0.9366, 'learning_rate': 7.870393045181829e-07, 'epoch': 966.67}

 24%|██▍       | 15660/65536 [2:55:36<9:08:41,  1.51it/s]
 24%|██▍       | 15661/65536 [2:55:37<9:15:31,  1.50it/s]
 24%|██▍       | 15662/65536 [2:55:37<9:10:48,  1.51it/s]
 24%|██▍       | 15663/65536 [2:55:38<9:14:34,  1.50it/s]
 24%|██▍       | 15664/65536 [2:55:39<9:16:01,  1.49it/s]
 24%|██▍       | 15665/65536 [2:55:39<9:07:17,  1.52it/s]
 24%|██▍       | 15666/65536 [2:55:40<9:42:12,  1.43it/s]
 24%|██▍       | 15667/65536 [2:55:41<9:39:20,  1.43it/s]
 24%|██▍       | 15668/65536 [2:55:42<9:26:22,  1.47it/s]
 24%|██▍       | 15669/65536 [2:55:42<9:32:51,  1.45it/s]
 24%|██▍       | 15670/65536 [2:55:43<9:36:00,  1.44it/s]
 24%|██▍       | 15671/65536 [2:55:44<9:18:16,  1.49it/s]
 24%|██▍       | 15672/65536 [2:55:44<9:18:16,  1.49it/s]
 24%|██▍       | 15673/65536 [2:55:45<9:24:00,  1.47it/s]
 24%|██▍       | 15674/65536 [2:55:46<9:20:26,  1.48it/s]
 24%|██▍       | 15675/65536 [2:55:46<9:16:42,  1.49it/s]
 24%|██▍       | 15676/65536 [2:55:47<9:14:52,  1.50it/s]
 24%|██▍       | 15677/65536 [2:55:48<9:32:47,  1.45it/s]
 24%|██▍       | 15678/65536 [2:55:48<9:28:11,  1.46it/s]
 24%|██▍       | 15679/65536 [2:55:49<9:20:38,  1.48it/s]
 24%|██▍       | 15680/65536 [2:55:50<9:16:34,  1.49it/s]
                                                         
{'loss': 0.9262, 'learning_rate': 7.867638055589567e-07, 'epoch': 967.9}

 24%|██▍       | 15680/65536 [2:55:50<9:16:34,  1.49it/s]
 24%|██▍       | 15681/65536 [2:55:50<9:17:23,  1.49it/s]
 24%|██▍       | 15682/65536 [2:55:51<9:44:22,  1.42it/s]
 24%|██▍       | 15683/65536 [2:55:52<9:33:14,  1.45it/s]
 24%|██▍       | 15684/65536 [2:55:52<9:26:24,  1.47it/s]
 24%|██▍       | 15685/65536 [2:55:53<9:22:16,  1.48it/s]
 24%|██▍       | 15686/65536 [2:55:54<9:29:03,  1.46it/s]
 24%|██▍       | 15687/65536 [2:55:54<9:22:46,  1.48it/s]
 24%|██▍       | 15688/65536 [2:55:55<9:27:10,  1.46it/s]
 24%|██▍       | 15689/65536 [2:55:56<9:09:51,  1.51it/s]
 24%|██▍       | 15690/65536 [2:55:56<9:11:28,  1.51it/s]
 24%|██▍       | 15691/65536 [2:55:57<9:01:37,  1.53it/s]
 24%|██▍       | 15692/65536 [2:55:58<9:01:44,  1.53it/s]
 24%|██▍       | 15693/65536 [2:55:58<9:22:27,  1.48it/s]
 24%|██▍       | 15694/65536 [2:55:59<9:17:52,  1.49it/s]
 24%|██▍       | 15695/65536 [2:56:00<9:40:23,  1.43it/s]
 24%|██▍       | 15696/65536 [2:56:01<9:29:33,  1.46it/s]
 24%|██▍       | 15697/65536 [2:56:01<9:20:18,  1.48it/s]
 24%|██▍       | 15698/65536 [2:56:02<9:45:14,  1.42it/s]
 24%|██▍       | 15699/65536 [2:56:03<9:29:31,  1.46it/s]
 24%|██▍       | 15700/65536 [2:56:03<9:30:59,  1.45it/s]
                                                         
{'loss': 0.9257, 'learning_rate': 7.864883065997306e-07, 'epoch': 969.14}

 24%|██▍       | 15700/65536 [2:56:03<9:30:59,  1.45it/s]
 24%|██▍       | 15701/65536 [2:56:04<9:34:34,  1.45it/s]
 24%|██▍       | 15702/65536 [2:56:05<9:25:07,  1.47it/s]
 24%|██▍       | 15703/65536 [2:56:05<9:37:20,  1.44it/s]
 24%|██▍       | 15704/65536 [2:56:06<9:32:55,  1.45it/s]
 24%|██▍       | 15705/65536 [2:56:07<9:23:46,  1.47it/s]
 24%|██▍       | 15706/65536 [2:56:07<9:20:22,  1.48it/s]
 24%|██▍       | 15707/65536 [2:56:08<9:32:34,  1.45it/s]
 24%|██▍       | 15708/65536 [2:56:09<9:42:27,  1.43it/s]
 24%|██▍       | 15709/65536 [2:56:09<9:31:11,  1.45it/s]
 24%|██▍       | 15710/65536 [2:56:10<9:36:13,  1.44it/s]
 24%|██▍       | 15711/65536 [2:56:11<9:15:05,  1.50it/s]
 24%|██▍       | 15712/65536 [2:56:12<9:32:49,  1.45it/s]
 24%|██▍       | 15713/65536 [2:56:12<9:15:28,  1.49it/s]
 24%|██▍       | 15714/65536 [2:56:13<9:12:37,  1.50it/s]
 24%|██▍       | 15715/65536 [2:56:14<9:41:57,  1.43it/s]
 24%|██▍       | 15716/65536 [2:56:14<9:21:52,  1.48it/s]
 24%|██▍       | 15717/65536 [2:56:15<9:04:31,  1.52it/s]
 24%|██▍       | 15718/65536 [2:56:16<9:18:19,  1.49it/s]
 24%|██▍       | 15719/65536 [2:56:16<9:15:56,  1.49it/s]
 24%|██▍       | 15720/65536 [2:56:17<9:03:40,  1.53it/s]
                                                         
{'loss': 0.9076, 'learning_rate': 7.862128076405045e-07, 'epoch': 970.37}

 24%|██▍       | 15720/65536 [2:56:17<9:03:40,  1.53it/s]
 24%|██▍       | 15721/65536 [2:56:17<9:09:21,  1.51it/s]
 24%|██▍       | 15722/65536 [2:56:18<9:11:04,  1.51it/s]
 24%|██▍       | 15723/65536 [2:56:19<9:26:43,  1.46it/s]
 24%|██▍       | 15724/65536 [2:56:20<9:28:11,  1.46it/s]
 24%|██▍       | 15725/65536 [2:56:20<9:18:58,  1.49it/s]
 24%|██▍       | 15726/65536 [2:56:21<9:17:55,  1.49it/s]
 24%|██▍       | 15727/65536 [2:56:22<9:13:25,  1.50it/s]
 24%|██▍       | 15728/65536 [2:56:22<9:13:18,  1.50it/s]
 24%|██▍       | 15729/65536 [2:56:23<9:10:44,  1.51it/s]
 24%|██▍       | 15730/65536 [2:56:24<9:09:07,  1.51it/s]
 24%|██▍       | 15731/65536 [2:56:24<9:28:53,  1.46it/s]
 24%|██▍       | 15732/65536 [2:56:25<9:31:46,  1.45it/s]
 24%|██▍       | 15733/65536 [2:56:26<9:11:57,  1.50it/s]
 24%|██▍       | 15734/65536 [2:56:26<9:15:48,  1.49it/s]
 24%|██▍       | 15735/65536 [2:56:27<9:13:20,  1.50it/s]
 24%|██▍       | 15736/65536 [2:56:28<9:05:18,  1.52it/s]
 24%|██▍       | 15737/65536 [2:56:28<9:07:28,  1.52it/s]
 24%|██▍       | 15738/65536 [2:56:29<9:22:03,  1.48it/s]
 24%|██▍       | 15739/65536 [2:56:30<9:20:09,  1.48it/s]
 24%|██▍       | 15740/65536 [2:56:30<9:38:27,  1.43it/s]
                                                         
{'loss': 0.9401, 'learning_rate': 7.859373086812783e-07, 'epoch': 971.6}

 24%|██▍       | 15740/65536 [2:56:30<9:38:27,  1.43it/s]
 24%|██▍       | 15741/65536 [2:56:31<9:49:12,  1.41it/s]
 24%|██▍       | 15742/65536 [2:56:32<9:31:00,  1.45it/s]
 24%|██▍       | 15743/65536 [2:56:32<9:18:55,  1.48it/s]
 24%|██▍       | 15744/65536 [2:56:33<9:15:30,  1.49it/s]
 24%|██▍       | 15745/65536 [2:56:34<8:54:45,  1.55it/s]
 24%|██▍       | 15746/65536 [2:56:34<9:23:21,  1.47it/s]
 24%|██▍       | 15747/65536 [2:56:35<9:30:27,  1.45it/s]
 24%|██▍       | 15748/65536 [2:56:36<9:26:52,  1.46it/s]
 24%|██▍       | 15749/65536 [2:56:36<9:28:07,  1.46it/s]
 24%|██▍       | 15750/65536 [2:56:37<9:25:27,  1.47it/s]
 24%|██▍       | 15751/65536 [2:56:38<9:17:25,  1.49it/s]
 24%|██▍       | 15752/65536 [2:56:38<9:13:05,  1.50it/s]
 24%|██▍       | 15753/65536 [2:56:39<9:13:14,  1.50it/s]
 24%|██▍       | 15754/65536 [2:56:40<9:09:18,  1.51it/s]
 24%|██▍       | 15755/65536 [2:56:40<9:09:57,  1.51it/s]
 24%|██▍       | 15756/65536 [2:56:41<9:04:09,  1.52it/s]
 24%|██▍       | 15757/65536 [2:56:42<9:09:34,  1.51it/s]
 24%|██▍       | 15758/65536 [2:56:42<9:11:59,  1.50it/s]
 24%|██▍       | 15759/65536 [2:56:43<9:17:34,  1.49it/s]
 24%|██▍       | 15760/65536 [2:56:44<9:20:13,  1.48it/s]
                                                         
{'loss': 0.9276, 'learning_rate': 7.856618097220521e-07, 'epoch': 972.84}

 24%|██▍       | 15760/65536 [2:56:44<9:20:13,  1.48it/s]
 24%|██▍       | 15761/65536 [2:56:44<9:13:54,  1.50it/s]
 24%|██▍       | 15762/65536 [2:56:45<9:16:39,  1.49it/s]
 24%|██▍       | 15763/65536 [2:56:46<9:50:52,  1.40it/s]
 24%|██▍       | 15764/65536 [2:56:47<9:31:52,  1.45it/s]
 24%|██▍       | 15765/65536 [2:56:47<9:27:08,  1.46it/s]
 24%|██▍       | 15766/65536 [2:56:48<9:33:32,  1.45it/s]
 24%|██▍       | 15767/65536 [2:56:49<9:19:21,  1.48it/s]
 24%|██▍       | 15768/65536 [2:56:49<9:17:20,  1.49it/s]
 24%|██▍       | 15769/65536 [2:56:50<9:08:15,  1.51it/s]
 24%|██▍       | 15770/65536 [2:56:51<9:11:37,  1.50it/s]
 24%|██▍       | 15771/65536 [2:56:51<9:33:22,  1.45it/s]
 24%|██▍       | 15772/65536 [2:56:52<9:35:17,  1.44it/s]
 24%|██▍       | 15773/65536 [2:56:53<9:32:12,  1.45it/s]
 24%|██▍       | 15774/65536 [2:56:53<9:14:29,  1.50it/s]
 24%|██▍       | 15775/65536 [2:56:54<9:09:26,  1.51it/s]
 24%|██▍       | 15776/65536 [2:56:55<9:05:07,  1.52it/s]
 24%|██▍       | 15777/65536 [2:56:55<9:15:30,  1.49it/s]
 24%|██▍       | 15778/65536 [2:56:56<9:13:52,  1.50it/s]
 24%|██▍       | 15779/65536 [2:56:57<9:29:30,  1.46it/s]
 24%|██▍       | 15780/65536 [2:56:57<9:33:50,  1.45it/s]
                                                         
{'loss': 0.9223, 'learning_rate': 7.853863107628259e-07, 'epoch': 974.07}

 24%|██▍       | 15780/65536 [2:56:57<9:33:50,  1.45it/s]
 24%|██▍       | 15781/65536 [2:56:58<9:24:47,  1.47it/s]
 24%|██▍       | 15782/65536 [2:56:59<9:28:50,  1.46it/s]
 24%|██▍       | 15783/65536 [2:56:59<9:30:25,  1.45it/s]
 24%|██▍       | 15784/65536 [2:57:00<9:31:05,  1.45it/s]
 24%|██▍       | 15785/65536 [2:57:01<9:43:41,  1.42it/s]
 24%|██▍       | 15786/65536 [2:57:02<9:35:33,  1.44it/s]
 24%|██▍       | 15787/65536 [2:57:02<9:31:22,  1.45it/s]
 24%|██▍       | 15788/65536 [2:57:03<9:37:33,  1.44it/s]
 24%|██▍       | 15789/65536 [2:57:04<9:19:44,  1.48it/s]
 24%|██▍       | 15790/65536 [2:57:04<9:13:29,  1.50it/s]
 24%|██▍       | 15791/65536 [2:57:05<9:16:41,  1.49it/s]
 24%|██▍       | 15792/65536 [2:57:06<9:12:09,  1.50it/s]
 24%|██▍       | 15793/65536 [2:57:06<9:01:35,  1.53it/s]
 24%|██▍       | 15794/65536 [2:57:07<9:01:37,  1.53it/s]
 24%|██▍       | 15795/65536 [2:57:07<9:08:47,  1.51it/s]
 24%|██▍       | 15796/65536 [2:57:08<9:33:04,  1.45it/s]
 24%|██▍       | 15797/65536 [2:57:09<9:29:08,  1.46it/s]
 24%|██▍       | 15798/65536 [2:57:10<9:31:27,  1.45it/s]
 24%|██▍       | 15799/65536 [2:57:10<9:31:19,  1.45it/s]
 24%|██▍       | 15800/65536 [2:57:11<9:16:33,  1.49it/s]
                                                         
{'loss': 0.9229, 'learning_rate': 7.851108118035998e-07, 'epoch': 975.31}

 24%|██▍       | 15800/65536 [2:57:11<9:16:33,  1.49it/s]
 24%|██▍       | 15801/65536 [2:57:12<9:03:33,  1.52it/s]
 24%|██▍       | 15802/65536 [2:57:12<8:59:31,  1.54it/s]
 24%|██▍       | 15803/65536 [2:57:13<9:05:22,  1.52it/s]
 24%|██▍       | 15804/65536 [2:57:13<9:02:24,  1.53it/s]
 24%|██▍       | 15805/65536 [2:57:14<8:59:41,  1.54it/s]
 24%|██▍       | 15806/65536 [2:57:15<9:07:13,  1.51it/s]
 24%|██▍       | 15807/65536 [2:57:16<9:24:01,  1.47it/s]
 24%|██▍       | 15808/65536 [2:57:16<9:24:18,  1.47it/s]
 24%|██▍       | 15809/65536 [2:57:17<9:25:47,  1.46it/s]
 24%|██▍       | 15810/65536 [2:57:18<9:19:56,  1.48it/s]
 24%|██▍       | 15811/65536 [2:57:18<9:19:47,  1.48it/s]
 24%|██▍       | 15812/65536 [2:57:19<9:39:06,  1.43it/s]
 24%|██▍       | 15813/65536 [2:57:20<9:32:06,  1.45it/s]
 24%|██▍       | 15814/65536 [2:57:20<9:31:04,  1.45it/s]
 24%|██▍       | 15815/65536 [2:57:21<9:17:58,  1.49it/s]
 24%|██▍       | 15816/65536 [2:57:22<9:11:33,  1.50it/s]
 24%|██▍       | 15817/65536 [2:57:22<9:12:18,  1.50it/s]
 24%|██▍       | 15818/65536 [2:57:23<8:58:17,  1.54it/s]
 24%|██▍       | 15819/65536 [2:57:24<9:03:24,  1.52it/s]
 24%|██▍       | 15820/65536 [2:57:24<9:30:19,  1.45it/s]
                                                         
{'loss': 0.9176, 'learning_rate': 7.848353128443737e-07, 'epoch': 976.54}

 24%|██▍       | 15820/65536 [2:57:24<9:30:19,  1.45it/s]
 24%|██▍       | 15821/65536 [2:57:25<9:27:56,  1.46it/s]
 24%|██▍       | 15822/65536 [2:57:26<9:25:26,  1.47it/s]
 24%|██▍       | 15823/65536 [2:57:26<9:20:03,  1.48it/s]
 24%|██▍       | 15824/65536 [2:57:27<9:03:41,  1.52it/s]
 24%|██▍       | 15825/65536 [2:57:28<9:08:10,  1.51it/s]
 24%|██▍       | 15826/65536 [2:57:28<9:08:33,  1.51it/s]
 24%|██▍       | 15827/65536 [2:57:29<9:30:18,  1.45it/s]
 24%|██▍       | 15828/65536 [2:57:30<10:02:03,  1.38it/s]
 24%|██▍       | 15829/65536 [2:57:31<9:44:54,  1.42it/s] 
 24%|██▍       | 15830/65536 [2:57:31<9:45:30,  1.41it/s]
 24%|██▍       | 15831/65536 [2:57:32<9:42:31,  1.42it/s]
 24%|██▍       | 15832/65536 [2:57:33<9:36:25,  1.44it/s]
 24%|██▍       | 15833/65536 [2:57:33<9:36:58,  1.44it/s]
 24%|██▍       | 15834/65536 [2:57:34<9:34:21,  1.44it/s]
 24%|██▍       | 15835/65536 [2:57:35<9:30:31,  1.45it/s]
 24%|██▍       | 15836/65536 [2:57:35<9:31:37,  1.45it/s]
 24%|██▍       | 15837/65536 [2:57:36<9:27:46,  1.46it/s]
 24%|██▍       | 15838/65536 [2:57:37<9:27:34,  1.46it/s]
 24%|██▍       | 15839/65536 [2:57:37<9:14:18,  1.49it/s]
 24%|██▍       | 15840/65536 [2:57:38<9:12:58,  1.50it/s]
                                                         
{'loss': 0.924, 'learning_rate': 7.845598138851475e-07, 'epoch': 977.78}

 24%|██▍       | 15840/65536 [2:57:38<9:12:58,  1.50it/s]
 24%|██▍       | 15841/65536 [2:57:39<9:18:32,  1.48it/s]
 24%|██▍       | 15842/65536 [2:57:39<9:08:14,  1.51it/s]
 24%|██▍       | 15843/65536 [2:57:40<9:01:05,  1.53it/s]
 24%|██▍       | 15844/65536 [2:57:41<9:14:12,  1.49it/s]
 24%|██▍       | 15845/65536 [2:57:41<9:18:41,  1.48it/s]
 24%|██▍       | 15846/65536 [2:57:42<9:11:55,  1.50it/s]
 24%|██▍       | 15847/65536 [2:57:43<9:04:47,  1.52it/s]
 24%|██▍       | 15848/65536 [2:57:43<9:28:31,  1.46it/s]
 24%|██▍       | 15849/65536 [2:57:44<9:07:06,  1.51it/s]
 24%|██▍       | 15850/65536 [2:57:45<9:11:59,  1.50it/s]
 24%|██▍       | 15851/65536 [2:57:45<9:22:35,  1.47it/s]
 24%|██▍       | 15852/65536 [2:57:46<9:21:07,  1.48it/s]
 24%|██▍       | 15853/65536 [2:57:47<9:31:35,  1.45it/s]
 24%|██▍       | 15854/65536 [2:57:47<9:14:01,  1.49it/s]
 24%|██▍       | 15855/65536 [2:57:48<9:11:59,  1.50it/s]
 24%|██▍       | 15856/65536 [2:57:49<9:10:37,  1.50it/s]
 24%|██▍       | 15857/65536 [2:57:49<9:11:49,  1.50it/s]
 24%|██▍       | 15858/65536 [2:57:50<9:12:37,  1.50it/s]
 24%|██▍       | 15859/65536 [2:57:51<9:15:09,  1.49it/s]
 24%|██▍       | 15860/65536 [2:57:52<9:32:01,  1.45it/s]
                                                         
{'loss': 0.9301, 'learning_rate': 7.842843149259214e-07, 'epoch': 979.01}

 24%|██▍       | 15860/65536 [2:57:52<9:32:01,  1.45it/s]
 24%|██▍       | 15861/65536 [2:57:52<9:27:57,  1.46it/s]
 24%|██▍       | 15862/65536 [2:57:53<9:12:11,  1.50it/s]
 24%|██▍       | 15863/65536 [2:57:54<9:18:58,  1.48it/s]
 24%|██▍       | 15864/65536 [2:57:54<9:22:57,  1.47it/s]
 24%|██▍       | 15865/65536 [2:57:55<9:28:02,  1.46it/s]
 24%|██▍       | 15866/65536 [2:57:56<9:20:33,  1.48it/s]
 24%|██▍       | 15867/65536 [2:57:56<9:24:19,  1.47it/s]
 24%|██▍       | 15868/65536 [2:57:57<9:28:10,  1.46it/s]
 24%|██▍       | 15869/65536 [2:57:58<9:20:23,  1.48it/s]
 24%|██▍       | 15870/65536 [2:57:58<9:13:03,  1.50it/s]
 24%|██▍       | 15871/65536 [2:57:59<9:15:59,  1.49it/s]
 24%|██▍       | 15872/65536 [2:58:00<9:19:37,  1.48it/s]
 24%|██▍       | 15873/65536 [2:58:00<9:18:52,  1.48it/s]
 24%|██▍       | 15874/65536 [2:58:01<9:22:25,  1.47it/s]
 24%|██▍       | 15875/65536 [2:58:02<9:20:24,  1.48it/s]
 24%|██▍       | 15876/65536 [2:58:02<9:20:56,  1.48it/s]
 24%|██▍       | 15877/65536 [2:58:03<9:41:58,  1.42it/s]
 24%|██▍       | 15878/65536 [2:58:04<9:26:54,  1.46it/s]
 24%|██▍       | 15879/65536 [2:58:04<9:22:47,  1.47it/s]
 24%|██▍       | 15880/65536 [2:58:05<9:34:11,  1.44it/s]
                                                         
{'loss': 0.9089, 'learning_rate': 7.840088159666952e-07, 'epoch': 980.25}

 24%|██▍       | 15880/65536 [2:58:05<9:34:11,  1.44it/s]
 24%|██▍       | 15881/65536 [2:58:06<9:25:28,  1.46it/s]
 24%|██▍       | 15882/65536 [2:58:06<9:28:39,  1.46it/s]
 24%|██▍       | 15883/65536 [2:58:07<9:17:57,  1.48it/s]
 24%|██▍       | 15884/65536 [2:58:08<9:14:38,  1.49it/s]
 24%|██▍       | 15885/65536 [2:58:08<9:12:26,  1.50it/s]
 24%|██▍       | 15886/65536 [2:58:09<9:22:37,  1.47it/s]
 24%|██▍       | 15887/65536 [2:58:10<9:16:57,  1.49it/s]
 24%|██▍       | 15888/65536 [2:58:10<9:06:06,  1.52it/s]
 24%|██▍       | 15889/65536 [2:58:11<9:24:09,  1.47it/s]
 24%|██▍       | 15890/65536 [2:58:12<9:24:37,  1.47it/s]
 24%|██▍       | 15891/65536 [2:58:13<9:17:15,  1.48it/s]
 24%|██▍       | 15892/65536 [2:58:13<9:15:26,  1.49it/s]
 24%|██▍       | 15893/65536 [2:58:14<9:36:02,  1.44it/s]
 24%|██▍       | 15894/65536 [2:58:15<9:37:32,  1.43it/s]
 24%|██▍       | 15895/65536 [2:58:15<9:27:42,  1.46it/s]
 24%|██▍       | 15896/65536 [2:58:16<9:20:26,  1.48it/s]
 24%|██▍       | 15897/65536 [2:58:17<9:17:38,  1.48it/s]
 24%|██▍       | 15898/65536 [2:58:17<9:11:21,  1.50it/s]
 24%|██▍       | 15899/65536 [2:58:18<9:12:21,  1.50it/s]
 24%|██▍       | 15900/65536 [2:58:19<9:19:11,  1.48it/s]
                                                         
{'loss': 0.9233, 'learning_rate': 7.837333170074691e-07, 'epoch': 981.48}

 24%|██▍       | 15900/65536 [2:58:19<9:19:11,  1.48it/s]
 24%|██▍       | 15901/65536 [2:58:19<9:20:50,  1.48it/s]
 24%|██▍       | 15902/65536 [2:58:20<9:21:05,  1.47it/s]
 24%|██▍       | 15903/65536 [2:58:21<9:14:25,  1.49it/s]
 24%|██▍       | 15904/65536 [2:58:21<9:04:35,  1.52it/s]
 24%|██▍       | 15905/65536 [2:58:22<8:52:02,  1.55it/s]
 24%|██▍       | 15906/65536 [2:58:23<9:06:37,  1.51it/s]
 24%|██▍       | 15907/65536 [2:58:23<9:17:41,  1.48it/s]
 24%|██▍       | 15908/65536 [2:58:24<9:28:44,  1.45it/s]
 24%|██▍       | 15909/65536 [2:58:25<9:52:28,  1.40it/s]
 24%|██▍       | 15910/65536 [2:58:25<9:49:00,  1.40it/s]
 24%|██▍       | 15911/65536 [2:58:26<9:23:57,  1.47it/s]
 24%|██▍       | 15912/65536 [2:58:27<9:17:45,  1.48it/s]
 24%|██▍       | 15913/65536 [2:58:27<9:14:34,  1.49it/s]
 24%|██▍       | 15914/65536 [2:58:28<9:17:54,  1.48it/s]
 24%|██▍       | 15915/65536 [2:58:29<9:30:06,  1.45it/s]
 24%|██▍       | 15916/65536 [2:58:29<9:24:34,  1.46it/s]
 24%|██▍       | 15917/65536 [2:58:30<9:16:35,  1.49it/s]
 24%|██▍       | 15918/65536 [2:58:31<9:19:27,  1.48it/s]
 24%|██▍       | 15919/65536 [2:58:31<9:14:01,  1.49it/s]
 24%|██▍       | 15920/65536 [2:58:32<9:38:03,  1.43it/s]
                                                         
{'loss': 0.9134, 'learning_rate': 7.834578180482428e-07, 'epoch': 982.72}

 24%|██▍       | 15920/65536 [2:58:32<9:38:03,  1.43it/s]
 24%|██▍       | 15921/65536 [2:58:33<9:18:37,  1.48it/s]
 24%|██▍       | 15922/65536 [2:58:34<9:20:52,  1.47it/s]
 24%|██▍       | 15923/65536 [2:58:34<9:27:14,  1.46it/s]
 24%|██▍       | 15924/65536 [2:58:35<9:28:04,  1.46it/s]
 24%|██▍       | 15925/65536 [2:58:36<9:31:11,  1.45it/s]
 24%|██▍       | 15926/65536 [2:58:36<9:19:24,  1.48it/s]
 24%|██▍       | 15927/65536 [2:58:37<9:23:30,  1.47it/s]
 24%|██▍       | 15928/65536 [2:58:38<9:16:40,  1.49it/s]
 24%|██▍       | 15929/65536 [2:58:38<9:13:52,  1.49it/s]
 24%|██▍       | 15930/65536 [2:58:39<9:19:30,  1.48it/s]
 24%|██▍       | 15931/65536 [2:58:40<9:11:49,  1.50it/s]
 24%|██▍       | 15932/65536 [2:58:40<9:26:01,  1.46it/s]
 24%|██▍       | 15933/65536 [2:58:41<9:18:22,  1.48it/s]
 24%|██▍       | 15934/65536 [2:58:42<9:15:20,  1.49it/s]
 24%|██▍       | 15935/65536 [2:58:42<9:08:03,  1.51it/s]
 24%|██▍       | 15936/65536 [2:58:43<9:19:31,  1.48it/s]
 24%|██▍       | 15937/65536 [2:58:44<9:17:16,  1.48it/s]
 24%|██▍       | 15938/65536 [2:58:44<9:07:09,  1.51it/s]
 24%|██▍       | 15939/65536 [2:58:45<9:16:53,  1.48it/s]
 24%|██▍       | 15940/65536 [2:58:46<9:19:47,  1.48it/s]
                                                         
{'loss': 0.9232, 'learning_rate': 7.831823190890167e-07, 'epoch': 983.95}

 24%|██▍       | 15940/65536 [2:58:46<9:19:47,  1.48it/s]
 24%|██▍       | 15941/65536 [2:58:46<9:40:55,  1.42it/s]
 24%|██▍       | 15942/65536 [2:58:47<9:24:10,  1.47it/s]
 24%|██▍       | 15943/65536 [2:58:48<9:11:49,  1.50it/s]
 24%|██▍       | 15944/65536 [2:58:48<9:08:44,  1.51it/s]
 24%|██▍       | 15945/65536 [2:58:49<9:00:54,  1.53it/s]
 24%|██▍       | 15946/65536 [2:58:50<9:07:27,  1.51it/s]
 24%|██▍       | 15947/65536 [2:58:50<9:05:33,  1.51it/s]
 24%|██▍       | 15948/65536 [2:58:51<9:31:16,  1.45it/s]
 24%|██▍       | 15949/65536 [2:58:52<9:24:41,  1.46it/s]
 24%|██▍       | 15950/65536 [2:58:52<9:23:23,  1.47it/s]
 24%|██▍       | 15951/65536 [2:58:53<9:22:15,  1.47it/s]
 24%|██▍       | 15952/65536 [2:58:54<9:16:37,  1.48it/s]
 24%|██▍       | 15953/65536 [2:58:55<9:19:12,  1.48it/s]
 24%|██▍       | 15954/65536 [2:58:55<9:28:46,  1.45it/s]
 24%|██▍       | 15955/65536 [2:58:56<9:11:48,  1.50it/s]
 24%|██▍       | 15956/65536 [2:58:57<9:16:55,  1.48it/s]
 24%|██▍       | 15957/65536 [2:58:57<9:18:50,  1.48it/s]
 24%|██▍       | 15958/65536 [2:58:58<9:32:35,  1.44it/s]
 24%|██▍       | 15959/65536 [2:58:59<9:29:14,  1.45it/s]
 24%|██▍       | 15960/65536 [2:58:59<9:19:24,  1.48it/s]
                                                         
{'loss': 0.9269, 'learning_rate': 7.829068201297906e-07, 'epoch': 985.19}

 24%|██▍       | 15960/65536 [2:58:59<9:19:24,  1.48it/s]
 24%|██▍       | 15961/65536 [2:59:00<9:27:58,  1.45it/s]
 24%|██▍       | 15962/65536 [2:59:01<9:15:30,  1.49it/s]
 24%|██▍       | 15963/65536 [2:59:01<9:36:38,  1.43it/s]
 24%|██▍       | 15964/65536 [2:59:02<9:38:01,  1.43it/s]
 24%|██▍       | 15965/65536 [2:59:03<9:27:36,  1.46it/s]
 24%|██▍       | 15966/65536 [2:59:03<9:14:27,  1.49it/s]
 24%|██▍       | 15967/65536 [2:59:04<9:16:35,  1.48it/s]
 24%|██▍       | 15968/65536 [2:59:05<9:34:54,  1.44it/s]
 24%|██▍       | 15969/65536 [2:59:05<9:19:33,  1.48it/s]
 24%|██▍       | 15970/65536 [2:59:06<9:23:23,  1.47it/s]
 24%|██▍       | 15971/65536 [2:59:07<9:10:07,  1.50it/s]
 24%|██▍       | 15972/65536 [2:59:07<9:28:35,  1.45it/s]
 24%|██▍       | 15973/65536 [2:59:08<9:16:22,  1.48it/s]
 24%|██▍       | 15974/65536 [2:59:09<9:36:59,  1.43it/s]
 24%|██▍       | 15975/65536 [2:59:10<9:27:02,  1.46it/s]
 24%|██▍       | 15976/65536 [2:59:10<9:31:57,  1.44it/s]
 24%|██▍       | 15977/65536 [2:59:11<9:19:11,  1.48it/s]
 24%|██▍       | 15978/65536 [2:59:12<9:12:18,  1.50it/s]
 24%|██▍       | 15979/65536 [2:59:12<9:08:15,  1.51it/s]
 24%|██▍       | 15980/65536 [2:59:13<8:56:35,  1.54it/s]
                                                         
{'loss': 0.9056, 'learning_rate': 7.826313211705644e-07, 'epoch': 986.42}

 24%|██▍       | 15980/65536 [2:59:13<8:56:35,  1.54it/s]
 24%|██▍       | 15981/65536 [2:59:14<9:08:20,  1.51it/s]
 24%|██▍       | 15982/65536 [2:59:14<9:28:34,  1.45it/s]
 24%|██▍       | 15983/65536 [2:59:15<9:26:21,  1.46it/s]
 24%|██▍       | 15984/65536 [2:59:16<9:22:17,  1.47it/s]
 24%|██▍       | 15985/65536 [2:59:16<9:08:34,  1.51it/s]
 24%|██▍       | 15986/65536 [2:59:17<9:14:55,  1.49it/s]
 24%|██▍       | 15987/65536 [2:59:18<9:24:02,  1.46it/s]
 24%|██▍       | 15988/65536 [2:59:18<9:18:21,  1.48it/s]
 24%|██▍       | 15989/65536 [2:59:19<9:11:48,  1.50it/s]
 24%|██▍       | 15990/65536 [2:59:20<9:32:45,  1.44it/s]
 24%|██▍       | 15991/65536 [2:59:20<9:19:47,  1.48it/s]
 24%|██▍       | 15992/65536 [2:59:21<9:09:58,  1.50it/s]
 24%|██▍       | 15993/65536 [2:59:22<9:19:04,  1.48it/s]
 24%|██▍       | 15994/65536 [2:59:22<9:28:28,  1.45it/s]
 24%|██▍       | 15995/65536 [2:59:23<9:12:15,  1.50it/s]
 24%|██▍       | 15996/65536 [2:59:24<9:07:31,  1.51it/s]
 24%|██▍       | 15997/65536 [2:59:24<9:09:25,  1.50it/s]
 24%|██▍       | 15998/65536 [2:59:25<9:08:43,  1.50it/s]
 24%|██▍       | 15999/65536 [2:59:26<9:22:40,  1.47it/s]
 24%|██▍       | 16000/65536 [2:59:26<9:16:47,  1.48it/s]
                                                         
{'loss': 0.9268, 'learning_rate': 7.823558222113382e-07, 'epoch': 987.65}

 24%|██▍       | 16000/65536 [2:59:26<9:16:47,  1.48it/s]
 24%|██▍       | 16001/65536 [2:59:27<9:06:05,  1.51it/s]
 24%|██▍       | 16002/65536 [2:59:28<8:56:23,  1.54it/s]
 24%|██▍       | 16003/65536 [2:59:28<9:13:49,  1.49it/s]
 24%|██▍       | 16004/65536 [2:59:29<9:15:53,  1.49it/s]
 24%|██▍       | 16005/65536 [2:59:30<9:10:26,  1.50it/s]
 24%|██▍       | 16006/65536 [2:59:30<9:17:48,  1.48it/s]
 24%|██▍       | 16007/65536 [2:59:31<9:03:06,  1.52it/s]
 24%|██▍       | 16008/65536 [2:59:32<8:57:24,  1.54it/s]
 24%|██▍       | 16009/65536 [2:59:32<9:15:20,  1.49it/s]
 24%|██▍       | 16010/65536 [2:59:33<9:08:06,  1.51it/s]
 24%|██▍       | 16011/65536 [2:59:34<9:19:15,  1.48it/s]
 24%|██▍       | 16012/65536 [2:59:34<9:17:10,  1.48it/s]
 24%|██▍       | 16013/65536 [2:59:35<9:27:10,  1.46it/s]
 24%|██▍       | 16014/65536 [2:59:36<9:26:53,  1.46it/s]
 24%|██▍       | 16015/65536 [2:59:36<9:31:45,  1.44it/s]
 24%|██▍       | 16016/65536 [2:59:37<9:14:05,  1.49it/s]
 24%|██▍       | 16017/65536 [2:59:38<9:18:28,  1.48it/s]
 24%|██▍       | 16018/65536 [2:59:38<9:14:24,  1.49it/s]
 24%|██▍       | 16019/65536 [2:59:39<9:07:41,  1.51it/s]
 24%|██▍       | 16020/65536 [2:59:40<9:05:24,  1.51it/s]
                                                         
{'loss': 0.9208, 'learning_rate': 7.82080323252112e-07, 'epoch': 988.89}

 24%|██▍       | 16020/65536 [2:59:40<9:05:24,  1.51it/s]
 24%|██▍       | 16021/65536 [2:59:40<9:12:43,  1.49it/s]
 24%|██▍       | 16022/65536 [2:59:41<9:41:35,  1.42it/s]
 24%|██▍       | 16023/65536 [2:59:42<9:38:07,  1.43it/s]
 24%|██▍       | 16024/65536 [2:59:43<9:38:44,  1.43it/s]
 24%|██▍       | 16025/65536 [2:59:43<9:22:31,  1.47it/s]
 24%|██▍       | 16026/65536 [2:59:44<9:24:49,  1.46it/s]
 24%|██▍       | 16027/65536 [2:59:45<9:27:50,  1.45it/s]
 24%|██▍       | 16028/65536 [2:59:45<9:11:50,  1.50it/s]
 24%|██▍       | 16029/65536 [2:59:46<9:06:12,  1.51it/s]
 24%|██▍       | 16030/65536 [2:59:47<9:00:39,  1.53it/s]
 24%|██▍       | 16031/65536 [2:59:47<9:09:45,  1.50it/s]
 24%|██▍       | 16032/65536 [2:59:48<9:18:15,  1.48it/s]
 24%|██▍       | 16033/65536 [2:59:49<9:15:55,  1.48it/s]
 24%|██▍       | 16034/65536 [2:59:49<8:57:20,  1.54it/s]
 24%|██▍       | 16035/65536 [2:59:50<8:55:41,  1.54it/s]
 24%|██▍       | 16036/65536 [2:59:51<9:10:37,  1.50it/s]
 24%|██▍       | 16037/65536 [2:59:51<9:10:00,  1.50it/s]
 24%|██▍       | 16038/65536 [2:59:52<9:12:21,  1.49it/s]
 24%|██▍       | 16039/65536 [2:59:53<9:42:43,  1.42it/s]
 24%|██▍       | 16040/65536 [2:59:53<9:31:54,  1.44it/s]
                                                         
{'loss': 0.9292, 'learning_rate': 7.818048242928859e-07, 'epoch': 990.12}

 24%|██▍       | 16040/65536 [2:59:53<9:31:54,  1.44it/s]
 24%|██▍       | 16041/65536 [2:59:54<9:26:19,  1.46it/s]
 24%|██▍       | 16042/65536 [2:59:55<9:04:12,  1.52it/s]
 24%|██▍       | 16043/65536 [2:59:55<9:04:17,  1.52it/s]
 24%|██▍       | 16044/65536 [2:59:56<8:58:28,  1.53it/s]
 24%|██▍       | 16045/65536 [2:59:57<9:08:34,  1.50it/s]
 24%|██▍       | 16046/65536 [2:59:57<9:19:39,  1.47it/s]
 24%|██▍       | 16047/65536 [2:59:58<9:05:05,  1.51it/s]
 24%|██▍       | 16048/65536 [2:59:59<9:11:03,  1.50it/s]
 24%|██▍       | 16049/65536 [2:59:59<9:35:27,  1.43it/s]
 24%|██▍       | 16050/65536 [3:00:00<9:21:57,  1.47it/s]
 24%|██▍       | 16051/65536 [3:00:01<9:19:40,  1.47it/s]
 24%|██▍       | 16052/65536 [3:00:01<9:05:12,  1.51it/s]
 24%|██▍       | 16053/65536 [3:00:02<9:06:48,  1.51it/s]
 24%|██▍       | 16054/65536 [3:00:03<8:59:00,  1.53it/s]
 24%|██▍       | 16055/65536 [3:00:03<9:22:25,  1.47it/s]
 24%|██▍       | 16056/65536 [3:00:04<9:20:50,  1.47it/s]
 25%|██▍       | 16057/65536 [3:00:05<9:31:08,  1.44it/s]
 25%|██▍       | 16058/65536 [3:00:05<9:24:48,  1.46it/s]
 25%|██▍       | 16059/65536 [3:00:06<9:20:23,  1.47it/s]
 25%|██▍       | 16060/65536 [3:00:07<9:15:35,  1.48it/s]
                                                         
{'loss': 0.9301, 'learning_rate': 7.815293253336597e-07, 'epoch': 991.36}

 25%|██▍       | 16060/65536 [3:00:07<9:15:35,  1.48it/s]
 25%|██▍       | 16061/65536 [3:00:07<9:07:26,  1.51it/s]
 25%|██▍       | 16062/65536 [3:00:08<9:18:43,  1.48it/s]
 25%|██▍       | 16063/65536 [3:00:09<9:30:34,  1.45it/s]
 25%|██▍       | 16064/65536 [3:00:09<9:16:02,  1.48it/s]
 25%|██▍       | 16065/65536 [3:00:10<9:01:37,  1.52it/s]
 25%|██▍       | 16066/65536 [3:00:11<9:00:04,  1.53it/s]
 25%|██▍       | 16067/65536 [3:00:11<8:58:04,  1.53it/s]
 25%|██▍       | 16068/65536 [3:00:12<8:44:21,  1.57it/s]
 25%|██▍       | 16069/65536 [3:00:13<8:52:13,  1.55it/s]
 25%|██▍       | 16070/65536 [3:00:13<9:04:47,  1.51it/s]
 25%|██▍       | 16071/65536 [3:00:14<9:28:05,  1.45it/s]
 25%|██▍       | 16072/65536 [3:00:15<9:22:50,  1.46it/s]
 25%|██▍       | 16073/65536 [3:00:15<9:11:59,  1.49it/s]
 25%|██▍       | 16074/65536 [3:00:16<9:26:24,  1.46it/s]
 25%|██▍       | 16075/65536 [3:00:17<9:26:54,  1.45it/s]
 25%|██▍       | 16076/65536 [3:00:18<9:22:36,  1.47it/s]
 25%|██▍       | 16077/65536 [3:00:18<9:15:21,  1.48it/s]
 25%|██▍       | 16078/65536 [3:00:19<9:14:39,  1.49it/s]
 25%|██▍       | 16079/65536 [3:00:20<9:14:21,  1.49it/s]
 25%|██▍       | 16080/65536 [3:00:20<8:56:52,  1.54it/s]
                                                         
{'loss': 0.9371, 'learning_rate': 7.812538263744336e-07, 'epoch': 992.59}

 25%|██▍       | 16080/65536 [3:00:20<8:56:52,  1.54it/s]
 25%|██▍       | 16081/65536 [3:00:21<9:19:47,  1.47it/s]
 25%|██▍       | 16082/65536 [3:00:22<9:15:48,  1.48it/s]
 25%|██▍       | 16083/65536 [3:00:22<9:14:40,  1.49it/s]
 25%|██▍       | 16084/65536 [3:00:23<9:06:34,  1.51it/s]
 25%|██▍       | 16085/65536 [3:00:24<9:10:17,  1.50it/s]
 25%|██▍       | 16086/65536 [3:00:24<9:01:57,  1.52it/s]
 25%|██▍       | 16087/65536 [3:00:25<9:29:17,  1.45it/s]
 25%|██▍       | 16088/65536 [3:00:26<9:27:05,  1.45it/s]
 25%|██▍       | 16089/65536 [3:00:26<9:17:33,  1.48it/s]
 25%|██▍       | 16090/65536 [3:00:27<9:21:18,  1.47it/s]
 25%|██▍       | 16091/65536 [3:00:28<9:09:29,  1.50it/s]
 25%|██▍       | 16092/65536 [3:00:28<9:07:33,  1.51it/s]
 25%|██▍       | 16093/65536 [3:00:29<9:18:55,  1.47it/s]
 25%|██▍       | 16094/65536 [3:00:30<9:01:09,  1.52it/s]
 25%|██▍       | 16095/65536 [3:00:30<9:07:53,  1.50it/s]
 25%|██▍       | 16096/65536 [3:00:31<9:04:03,  1.51it/s]
 25%|██▍       | 16097/65536 [3:00:32<9:20:40,  1.47it/s]
 25%|██▍       | 16098/65536 [3:00:32<9:27:23,  1.45it/s]
 25%|██▍       | 16099/65536 [3:00:33<9:17:52,  1.48it/s]
 25%|██▍       | 16100/65536 [3:00:34<9:04:38,  1.51it/s]
                                                         
{'loss': 0.9206, 'learning_rate': 7.809783274152075e-07, 'epoch': 993.83}

 25%|██▍       | 16100/65536 [3:00:34<9:04:38,  1.51it/s]
 25%|██▍       | 16101/65536 [3:00:34<9:07:45,  1.50it/s]
 25%|██▍       | 16102/65536 [3:00:35<9:08:31,  1.50it/s]
 25%|██▍       | 16103/65536 [3:00:36<9:41:56,  1.42it/s]
 25%|██▍       | 16104/65536 [3:00:36<9:28:39,  1.45it/s]
 25%|██▍       | 16105/65536 [3:00:37<9:13:07,  1.49it/s]
 25%|██▍       | 16106/65536 [3:00:38<9:20:37,  1.47it/s]
 25%|██▍       | 16107/65536 [3:00:38<9:25:36,  1.46it/s]
 25%|██▍       | 16108/65536 [3:00:39<9:22:17,  1.47it/s]
 25%|██▍       | 16109/65536 [3:00:40<9:33:33,  1.44it/s]
 25%|██▍       | 16110/65536 [3:00:40<9:29:49,  1.45it/s]
 25%|██▍       | 16111/65536 [3:00:41<9:37:03,  1.43it/s]
 25%|██▍       | 16112/65536 [3:00:42<9:34:10,  1.43it/s]
 25%|██▍       | 16113/65536 [3:00:43<9:25:43,  1.46it/s]
 25%|██▍       | 16114/65536 [3:00:43<9:13:18,  1.49it/s]
 25%|██▍       | 16115/65536 [3:00:44<9:17:39,  1.48it/s]
 25%|██▍       | 16116/65536 [3:00:45<9:11:28,  1.49it/s]
 25%|██▍       | 16117/65536 [3:00:45<9:10:07,  1.50it/s]
 25%|██▍       | 16118/65536 [3:00:46<9:05:11,  1.51it/s]
 25%|██▍       | 16119/65536 [3:00:47<9:08:37,  1.50it/s]
 25%|██▍       | 16120/65536 [3:00:47<9:34:20,  1.43it/s]
                                                         
{'loss': 0.9196, 'learning_rate': 7.807028284559813e-07, 'epoch': 995.06}

 25%|██▍       | 16120/65536 [3:00:47<9:34:20,  1.43it/s]
 25%|██▍       | 16121/65536 [3:00:48<9:18:14,  1.48it/s]
 25%|██▍       | 16122/65536 [3:00:49<9:16:18,  1.48it/s]
 25%|██▍       | 16123/65536 [3:00:49<9:19:06,  1.47it/s]
 25%|██▍       | 16124/65536 [3:00:50<9:10:41,  1.50it/s]
 25%|██▍       | 16125/65536 [3:00:51<9:07:16,  1.50it/s]
 25%|██▍       | 16126/65536 [3:00:51<9:20:51,  1.47it/s]
 25%|██▍       | 16127/65536 [3:00:52<9:18:43,  1.47it/s]
 25%|██▍       | 16128/65536 [3:00:53<9:12:03,  1.49it/s]
 25%|██▍       | 16129/65536 [3:00:53<9:28:46,  1.45it/s]
 25%|██▍       | 16130/65536 [3:00:54<9:20:44,  1.47it/s]
 25%|██▍       | 16131/65536 [3:00:55<9:16:56,  1.48it/s]
 25%|██▍       | 16132/65536 [3:00:55<9:34:13,  1.43it/s]
 25%|██▍       | 16133/65536 [3:00:56<9:24:02,  1.46it/s]
 25%|██▍       | 16134/65536 [3:00:57<9:18:35,  1.47it/s]
 25%|██▍       | 16135/65536 [3:00:57<9:09:52,  1.50it/s]
 25%|██▍       | 16136/65536 [3:00:58<9:41:25,  1.42it/s]
 25%|██▍       | 16137/65536 [3:00:59<9:39:13,  1.42it/s]
 25%|██▍       | 16138/65536 [3:01:00<9:52:37,  1.39it/s]
 25%|██▍       | 16139/65536 [3:01:00<9:53:55,  1.39it/s]
 25%|██▍       | 16140/65536 [3:01:01<9:44:15,  1.41it/s]
                                                         
{'loss': 0.9068, 'learning_rate': 7.804273294967552e-07, 'epoch': 996.3}

 25%|██▍       | 16140/65536 [3:01:01<9:44:15,  1.41it/s]
 25%|██▍       | 16141/65536 [3:01:02<9:32:38,  1.44it/s]
 25%|██▍       | 16142/65536 [3:01:02<9:24:30,  1.46it/s]
 25%|██▍       | 16143/65536 [3:01:03<9:22:28,  1.46it/s]
 25%|██▍       | 16144/65536 [3:01:04<9:10:27,  1.50it/s]
 25%|██▍       | 16145/65536 [3:01:04<9:19:34,  1.47it/s]
 25%|██▍       | 16146/65536 [3:01:05<9:21:29,  1.47it/s]
 25%|██▍       | 16147/65536 [3:01:06<9:17:52,  1.48it/s]
 25%|██▍       | 16148/65536 [3:01:06<9:14:03,  1.49it/s]
 25%|██▍       | 16149/65536 [3:01:07<9:18:15,  1.47it/s]
 25%|██▍       | 16150/65536 [3:01:08<9:16:30,  1.48it/s]
 25%|██▍       | 16151/65536 [3:01:08<9:24:00,  1.46it/s]
 25%|██▍       | 16152/65536 [3:01:09<9:49:06,  1.40it/s]
 25%|██▍       | 16153/65536 [3:01:10<9:58:47,  1.37it/s]
 25%|██▍       | 16154/65536 [3:01:11<9:32:10,  1.44it/s]
 25%|██▍       | 16155/65536 [3:01:11<9:15:49,  1.48it/s]
 25%|██▍       | 16156/65536 [3:01:12<9:09:44,  1.50it/s]
 25%|██▍       | 16157/65536 [3:01:13<9:09:21,  1.50it/s]
 25%|██▍       | 16158/65536 [3:01:13<9:11:46,  1.49it/s]
 25%|██▍       | 16159/65536 [3:01:14<8:57:35,  1.53it/s]
 25%|██▍       | 16160/65536 [3:01:15<9:03:56,  1.51it/s]
                                                         
{'loss': 0.9371, 'learning_rate': 7.80151830537529e-07, 'epoch': 997.53}

 25%|██▍       | 16160/65536 [3:01:15<9:03:56,  1.51it/s]
 25%|██▍       | 16161/65536 [3:01:15<9:25:43,  1.45it/s]
 25%|██▍       | 16162/65536 [3:01:16<9:17:57,  1.47it/s]
 25%|██▍       | 16163/65536 [3:01:17<9:16:56,  1.48it/s]
 25%|██▍       | 16164/65536 [3:01:17<9:07:53,  1.50it/s]
 25%|██▍       | 16165/65536 [3:01:18<9:07:51,  1.50it/s]
 25%|██▍       | 16166/65536 [3:01:19<9:04:51,  1.51it/s]
 25%|██▍       | 16167/65536 [3:01:19<8:53:45,  1.54it/s]
 25%|██▍       | 16168/65536 [3:01:20<9:18:07,  1.47it/s]
 25%|██▍       | 16169/65536 [3:01:21<9:24:04,  1.46it/s]
 25%|██▍       | 16170/65536 [3:01:21<9:15:18,  1.48it/s]
 25%|██▍       | 16171/65536 [3:01:22<8:58:54,  1.53it/s]
 25%|██▍       | 16172/65536 [3:01:23<9:06:57,  1.50it/s]
 25%|██▍       | 16173/65536 [3:01:23<9:15:33,  1.48it/s]
 25%|██▍       | 16174/65536 [3:01:24<9:16:29,  1.48it/s]
 25%|██▍       | 16175/65536 [3:01:25<8:56:59,  1.53it/s]
 25%|██▍       | 16176/65536 [3:01:25<9:06:24,  1.51it/s]
 25%|██▍       | 16177/65536 [3:01:26<9:02:08,  1.52it/s]
 25%|██▍       | 16178/65536 [3:01:27<8:55:42,  1.54it/s]
 25%|██▍       | 16179/65536 [3:01:27<9:08:05,  1.50it/s]
 25%|██▍       | 16180/65536 [3:01:28<9:05:20,  1.51it/s]
                                                         
{'loss': 0.9175, 'learning_rate': 7.798763315783029e-07, 'epoch': 998.77}

 25%|██▍       | 16180/65536 [3:01:28<9:05:20,  1.51it/s]
 25%|██▍       | 16181/65536 [3:01:29<8:56:03,  1.53it/s]
 25%|██▍       | 16182/65536 [3:01:29<9:03:37,  1.51it/s]
 25%|██▍       | 16183/65536 [3:01:30<9:23:50,  1.46it/s]
 25%|██▍       | 16184/65536 [3:01:31<9:54:30,  1.38it/s]
 25%|██▍       | 16185/65536 [3:01:31<9:32:01,  1.44it/s]
 25%|██▍       | 16186/65536 [3:01:32<9:37:37,  1.42it/s]
 25%|██▍       | 16187/65536 [3:01:33<9:32:25,  1.44it/s]
 25%|██▍       | 16188/65536 [3:01:33<9:16:15,  1.48it/s]
 25%|██▍       | 16189/65536 [3:01:34<9:13:29,  1.49it/s]
 25%|██▍       | 16190/65536 [3:01:35<9:26:02,  1.45it/s]
 25%|██▍       | 16191/65536 [3:01:36<9:27:33,  1.45it/s]
 25%|██▍       | 16192/65536 [3:01:36<9:06:31,  1.50it/s]
 25%|██▍       | 16193/65536 [3:01:37<9:12:31,  1.49it/s]
 25%|██▍       | 16194/65536 [3:01:37<9:07:24,  1.50it/s]
 25%|██▍       | 16195/65536 [3:01:38<9:05:50,  1.51it/s]
 25%|██▍       | 16196/65536 [3:01:39<9:00:49,  1.52it/s]
 25%|██▍       | 16197/65536 [3:01:39<8:56:06,  1.53it/s]
 25%|██▍       | 16198/65536 [3:01:40<8:50:52,  1.55it/s]
 25%|██▍       | 16199/65536 [3:01:41<8:59:31,  1.52it/s]
 25%|██▍       | 16200/65536 [3:01:41<9:03:49,  1.51it/s]
                                                         
{'loss': 0.931, 'learning_rate': 7.796008326190768e-07, 'epoch': 1000.0}

 25%|██▍       | 16200/65536 [3:01:41<9:03:49,  1.51it/s]
 25%|██▍       | 16201/65536 [3:01:42<9:41:06,  1.41it/s]
 25%|██▍       | 16202/65536 [3:01:43<9:31:02,  1.44it/s]
 25%|██▍       | 16203/65536 [3:01:44<9:31:04,  1.44it/s]
 25%|██▍       | 16204/65536 [3:01:44<9:24:17,  1.46it/s]
 25%|██▍       | 16205/65536 [3:01:45<9:19:37,  1.47it/s]
 25%|██▍       | 16206/65536 [3:01:46<9:20:51,  1.47it/s]
 25%|██▍       | 16207/65536 [3:01:46<9:06:08,  1.51it/s]
 25%|██▍       | 16208/65536 [3:01:47<8:57:50,  1.53it/s]
 25%|██▍       | 16209/65536 [3:01:48<9:07:43,  1.50it/s]
 25%|██▍       | 16210/65536 [3:01:48<9:12:00,  1.49it/s]
 25%|██▍       | 16211/65536 [3:01:49<9:06:25,  1.50it/s]
 25%|██▍       | 16212/65536 [3:01:50<9:08:54,  1.50it/s]
 25%|██▍       | 16213/65536 [3:01:50<9:11:18,  1.49it/s]
 25%|██▍       | 16214/65536 [3:01:51<9:09:53,  1.49it/s]
 25%|██▍       | 16215/65536 [3:01:52<9:01:07,  1.52it/s]
 25%|██▍       | 16216/65536 [3:01:52<8:42:37,  1.57it/s]
 25%|██▍       | 16217/65536 [3:01:53<9:27:59,  1.45it/s]
 25%|██▍       | 16218/65536 [3:01:54<9:15:54,  1.48it/s]
 25%|██▍       | 16219/65536 [3:01:54<9:04:25,  1.51it/s]
 25%|██▍       | 16220/65536 [3:01:55<9:04:28,  1.51it/s]
                                                         
{'loss': 0.9336, 'learning_rate': 7.793253336598506e-07, 'epoch': 1001.23}

 25%|██▍       | 16220/65536 [3:01:55<9:04:28,  1.51it/s]
 25%|██▍       | 16221/65536 [3:01:55<8:57:11,  1.53it/s]
 25%|██▍       | 16222/65536 [3:01:56<8:57:55,  1.53it/s]
 25%|██▍       | 16223/65536 [3:01:57<9:02:50,  1.51it/s]
 25%|██▍       | 16224/65536 [3:01:57<8:55:41,  1.53it/s]
 25%|██▍       | 16225/65536 [3:01:58<9:07:53,  1.50it/s]
 25%|██▍       | 16226/65536 [3:01:59<9:18:32,  1.47it/s]
 25%|██▍       | 16227/65536 [3:02:00<9:13:14,  1.49it/s]
 25%|██▍       | 16228/65536 [3:02:00<9:22:28,  1.46it/s]
 25%|██▍       | 16229/65536 [3:02:01<9:14:08,  1.48it/s]
 25%|██▍       | 16230/65536 [3:02:02<9:19:55,  1.47it/s]
 25%|██▍       | 16231/65536 [3:02:02<9:14:31,  1.48it/s]
 25%|██▍       | 16232/65536 [3:02:03<9:09:54,  1.49it/s]
 25%|██▍       | 16233/65536 [3:02:04<9:24:54,  1.45it/s]
 25%|██▍       | 16234/65536 [3:02:04<9:05:15,  1.51it/s]
 25%|██▍       | 16235/65536 [3:02:05<9:20:01,  1.47it/s]
 25%|██▍       | 16236/65536 [3:02:06<9:20:49,  1.47it/s]
 25%|██▍       | 16237/65536 [3:02:06<9:20:42,  1.47it/s]
 25%|██▍       | 16238/65536 [3:02:07<9:14:48,  1.48it/s]
 25%|██▍       | 16239/65536 [3:02:08<9:25:34,  1.45it/s]
 25%|██▍       | 16240/65536 [3:02:08<9:10:38,  1.49it/s]
                                                         
{'loss': 0.9013, 'learning_rate': 7.790498347006245e-07, 'epoch': 1002.47}

 25%|██▍       | 16240/65536 [3:02:08<9:10:38,  1.49it/s]
 25%|██▍       | 16241/65536 [3:02:09<9:00:09,  1.52it/s]
 25%|██▍       | 16242/65536 [3:02:10<8:57:21,  1.53it/s]
 25%|██▍       | 16243/65536 [3:02:10<9:19:56,  1.47it/s]
 25%|██▍       | 16244/65536 [3:02:11<9:22:54,  1.46it/s]
 25%|██▍       | 16245/65536 [3:02:12<9:25:41,  1.45it/s]
 25%|██▍       | 16246/65536 [3:02:12<9:18:29,  1.47it/s]
 25%|██▍       | 16247/65536 [3:02:13<9:04:42,  1.51it/s]
 25%|██▍       | 16248/65536 [3:02:14<8:58:43,  1.52it/s]
 25%|██▍       | 16249/65536 [3:02:14<9:16:35,  1.48it/s]
 25%|██▍       | 16250/65536 [3:02:15<9:14:55,  1.48it/s]
 25%|██▍       | 16251/65536 [3:02:16<9:10:55,  1.49it/s]
 25%|██▍       | 16252/65536 [3:02:16<9:03:40,  1.51it/s]
 25%|██▍       | 16253/65536 [3:02:17<9:23:19,  1.46it/s]
 25%|██▍       | 16254/65536 [3:02:18<9:18:02,  1.47it/s]
 25%|██▍       | 16255/65536 [3:02:18<9:03:45,  1.51it/s]
 25%|██▍       | 16256/65536 [3:02:19<8:54:01,  1.54it/s]
 25%|██▍       | 16257/65536 [3:02:20<9:01:11,  1.52it/s]
 25%|██▍       | 16258/65536 [3:02:20<8:58:31,  1.53it/s]
 25%|██▍       | 16259/65536 [3:02:21<9:08:55,  1.50it/s]
 25%|██▍       | 16260/65536 [3:02:22<9:24:44,  1.45it/s]
                                                         
{'loss': 0.9249, 'learning_rate': 7.787743357413984e-07, 'epoch': 1003.7}

 25%|██▍       | 16260/65536 [3:02:22<9:24:44,  1.45it/s]
 25%|██▍       | 16261/65536 [3:02:22<9:18:28,  1.47it/s]
 25%|██▍       | 16262/65536 [3:02:23<9:04:17,  1.51it/s]
 25%|██▍       | 16263/65536 [3:02:24<9:06:04,  1.50it/s]
 25%|██▍       | 16264/65536 [3:02:24<9:19:03,  1.47it/s]
 25%|██▍       | 16265/65536 [3:02:25<9:43:46,  1.41it/s]
 25%|██▍       | 16266/65536 [3:02:26<9:31:29,  1.44it/s]
 25%|██▍       | 16267/65536 [3:02:27<9:19:55,  1.47it/s]
 25%|██▍       | 16268/65536 [3:02:27<9:07:29,  1.50it/s]
 25%|██▍       | 16269/65536 [3:02:28<9:17:20,  1.47it/s]
 25%|██▍       | 16270/65536 [3:02:29<9:22:44,  1.46it/s]
 25%|██▍       | 16271/65536 [3:02:29<9:22:25,  1.46it/s]
 25%|██▍       | 16272/65536 [3:02:30<9:07:51,  1.50it/s]
 25%|██▍       | 16273/65536 [3:02:30<8:54:25,  1.54it/s]
 25%|██▍       | 16274/65536 [3:02:31<9:04:05,  1.51it/s]
 25%|██▍       | 16275/65536 [3:02:32<9:01:05,  1.52it/s]
 25%|██▍       | 16276/65536 [3:02:32<9:00:13,  1.52it/s]
 25%|██▍       | 16277/65536 [3:02:33<9:00:54,  1.52it/s]
 25%|██▍       | 16278/65536 [3:02:34<9:01:00,  1.52it/s]
 25%|██▍       | 16279/65536 [3:02:35<9:13:15,  1.48it/s]
 25%|██▍       | 16280/65536 [3:02:35<9:27:32,  1.45it/s]
                                                         
{'loss': 0.9019, 'learning_rate': 7.784988367821722e-07, 'epoch': 1004.94}

 25%|██▍       | 16280/65536 [3:02:35<9:27:32,  1.45it/s]
 25%|██▍       | 16281/65536 [3:02:36<9:26:05,  1.45it/s]
 25%|██▍       | 16282/65536 [3:02:37<9:37:40,  1.42it/s]
 25%|██▍       | 16283/65536 [3:02:37<9:36:17,  1.42it/s]
 25%|██▍       | 16284/65536 [3:02:38<9:11:00,  1.49it/s]
 25%|██▍       | 16285/65536 [3:02:39<8:54:08,  1.54it/s]
 25%|██▍       | 16286/65536 [3:02:39<8:55:43,  1.53it/s]
 25%|██▍       | 16287/65536 [3:02:40<9:18:51,  1.47it/s]
 25%|██▍       | 16288/65536 [3:02:41<9:05:00,  1.51it/s]
 25%|██▍       | 16289/65536 [3:02:41<9:02:35,  1.51it/s]
 25%|██▍       | 16290/65536 [3:02:42<9:02:04,  1.51it/s]
 25%|██▍       | 16291/65536 [3:02:43<9:23:43,  1.46it/s]
 25%|██▍       | 16292/65536 [3:02:43<9:14:02,  1.48it/s]
 25%|██▍       | 16293/65536 [3:02:44<9:10:25,  1.49it/s]
 25%|██▍       | 16294/65536 [3:02:45<9:05:26,  1.50it/s]
 25%|██▍       | 16295/65536 [3:02:45<9:09:38,  1.49it/s]
 25%|██▍       | 16296/65536 [3:02:46<9:09:54,  1.49it/s]
 25%|██▍       | 16297/65536 [3:02:47<9:16:11,  1.48it/s]
 25%|██▍       | 16298/65536 [3:02:47<9:30:49,  1.44it/s]
 25%|██▍       | 16299/65536 [3:02:48<9:30:12,  1.44it/s]
 25%|██▍       | 16300/65536 [3:02:49<9:12:33,  1.49it/s]
                                                         
{'loss': 0.9366, 'learning_rate': 7.78223337822946e-07, 'epoch': 1006.17}

 25%|██▍       | 16300/65536 [3:02:49<9:12:33,  1.49it/s]
 25%|██▍       | 16301/65536 [3:02:49<9:17:33,  1.47it/s]
 25%|██▍       | 16302/65536 [3:02:50<9:25:55,  1.45it/s]
 25%|██▍       | 16303/65536 [3:02:51<9:17:25,  1.47it/s]
 25%|██▍       | 16304/65536 [3:02:51<9:05:29,  1.50it/s]
 25%|██▍       | 16305/65536 [3:02:52<9:02:03,  1.51it/s]
 25%|██▍       | 16306/65536 [3:02:53<9:03:07,  1.51it/s]
 25%|██▍       | 16307/65536 [3:02:53<9:09:56,  1.49it/s]
 25%|██▍       | 16308/65536 [3:02:54<9:19:44,  1.47it/s]
 25%|██▍       | 16309/65536 [3:02:55<9:18:20,  1.47it/s]
 25%|██▍       | 16310/65536 [3:02:55<9:15:12,  1.48it/s]
 25%|██▍       | 16311/65536 [3:02:56<9:10:30,  1.49it/s]
 25%|██▍       | 16312/65536 [3:02:57<8:58:16,  1.52it/s]
 25%|██▍       | 16313/65536 [3:02:57<9:03:18,  1.51it/s]
 25%|██▍       | 16314/65536 [3:02:58<9:30:43,  1.44it/s]
 25%|██▍       | 16315/65536 [3:02:59<9:44:41,  1.40it/s]
 25%|██▍       | 16316/65536 [3:03:00<9:36:05,  1.42it/s]
 25%|██▍       | 16317/65536 [3:03:00<9:15:35,  1.48it/s]
 25%|██▍       | 16318/65536 [3:03:01<9:20:17,  1.46it/s]
 25%|██▍       | 16319/65536 [3:03:02<9:02:43,  1.51it/s]
 25%|██▍       | 16320/65536 [3:03:02<8:54:07,  1.54it/s]
                                                         
{'loss': 0.9302, 'learning_rate': 7.779478388637198e-07, 'epoch': 1007.41}

 25%|██▍       | 16320/65536 [3:03:02<8:54:07,  1.54it/s]
 25%|██▍       | 16321/65536 [3:03:03<9:05:33,  1.50it/s]
 25%|██▍       | 16322/65536 [3:03:04<9:10:14,  1.49it/s]
 25%|██▍       | 16323/65536 [3:03:04<9:13:58,  1.48it/s]
 25%|██▍       | 16324/65536 [3:03:05<9:12:50,  1.48it/s]
 25%|██▍       | 16325/65536 [3:03:06<9:10:48,  1.49it/s]
 25%|██▍       | 16326/65536 [3:03:06<8:54:37,  1.53it/s]
 25%|██▍       | 16327/65536 [3:03:07<8:52:45,  1.54it/s]
 25%|██▍       | 16328/65536 [3:03:07<8:47:50,  1.55it/s]
 25%|██▍       | 16329/65536 [3:03:08<9:01:09,  1.52it/s]
 25%|██▍       | 16330/65536 [3:03:09<9:23:35,  1.46it/s]
 25%|██▍       | 16331/65536 [3:03:10<9:26:24,  1.45it/s]
 25%|██▍       | 16332/65536 [3:03:10<9:12:06,  1.49it/s]
 25%|██▍       | 16333/65536 [3:03:11<9:12:09,  1.49it/s]
 25%|██▍       | 16334/65536 [3:03:12<9:08:18,  1.50it/s]
 25%|██▍       | 16335/65536 [3:03:12<9:06:43,  1.50it/s]
 25%|██▍       | 16336/65536 [3:03:13<8:58:02,  1.52it/s]
 25%|██▍       | 16337/65536 [3:03:14<9:02:29,  1.51it/s]
 25%|██▍       | 16338/65536 [3:03:14<9:19:00,  1.47it/s]
 25%|██▍       | 16339/65536 [3:03:15<9:07:24,  1.50it/s]
 25%|██▍       | 16340/65536 [3:03:16<9:09:55,  1.49it/s]
                                                         
{'loss': 0.9104, 'learning_rate': 7.776723399044937e-07, 'epoch': 1008.64}

 25%|██▍       | 16340/65536 [3:03:16<9:09:55,  1.49it/s]
 25%|██▍       | 16341/65536 [3:03:16<9:06:07,  1.50it/s]
 25%|██▍       | 16342/65536 [3:03:17<9:09:35,  1.49it/s]
 25%|██▍       | 16343/65536 [3:03:18<9:17:21,  1.47it/s]
 25%|██▍       | 16344/65536 [3:03:18<9:22:44,  1.46it/s]
 25%|██▍       | 16345/65536 [3:03:19<9:16:12,  1.47it/s]
 25%|██▍       | 16346/65536 [3:03:20<9:34:11,  1.43it/s]
 25%|██▍       | 16347/65536 [3:03:20<9:26:51,  1.45it/s]
 25%|██▍       | 16348/65536 [3:03:21<9:33:03,  1.43it/s]
 25%|██▍       | 16349/65536 [3:03:22<9:28:26,  1.44it/s]
 25%|██▍       | 16350/65536 [3:03:22<9:08:35,  1.49it/s]
 25%|██▍       | 16351/65536 [3:03:23<9:22:12,  1.46it/s]
 25%|██▍       | 16352/65536 [3:03:24<9:20:13,  1.46it/s]
 25%|██▍       | 16353/65536 [3:03:24<9:06:59,  1.50it/s]
 25%|██▍       | 16354/65536 [3:03:25<9:01:14,  1.51it/s]
 25%|██▍       | 16355/65536 [3:03:26<9:11:27,  1.49it/s]
 25%|██▍       | 16356/65536 [3:03:26<9:00:38,  1.52it/s]
 25%|██▍       | 16357/65536 [3:03:27<8:58:27,  1.52it/s]
 25%|██▍       | 16358/65536 [3:03:28<9:09:43,  1.49it/s]
 25%|██▍       | 16359/65536 [3:03:28<9:06:02,  1.50it/s]
 25%|██▍       | 16360/65536 [3:03:29<8:51:52,  1.54it/s]
                                                         
{'loss': 0.9249, 'learning_rate': 7.773968409452675e-07, 'epoch': 1009.88}

 25%|██▍       | 16360/65536 [3:03:29<8:51:52,  1.54it/s]
 25%|██▍       | 16361/65536 [3:03:30<9:02:27,  1.51it/s]
 25%|██▍       | 16362/65536 [3:03:30<9:09:10,  1.49it/s]
 25%|██▍       | 16363/65536 [3:03:31<9:37:02,  1.42it/s]
 25%|██▍       | 16364/65536 [3:03:32<9:21:09,  1.46it/s]
 25%|██▍       | 16365/65536 [3:03:33<9:12:28,  1.48it/s]
 25%|██▍       | 16366/65536 [3:03:33<8:52:25,  1.54it/s]
 25%|██▍       | 16367/65536 [3:03:34<8:58:24,  1.52it/s]
 25%|██▍       | 16368/65536 [3:03:34<8:57:04,  1.53it/s]
 25%|██▍       | 16369/65536 [3:03:35<9:11:25,  1.49it/s]
 25%|██▍       | 16370/65536 [3:03:36<9:12:52,  1.48it/s]
 25%|██▍       | 16371/65536 [3:03:37<9:20:04,  1.46it/s]
 25%|██▍       | 16372/65536 [3:03:37<9:27:07,  1.44it/s]
 25%|██▍       | 16373/65536 [3:03:38<9:23:38,  1.45it/s]
 25%|██▍       | 16374/65536 [3:03:39<9:07:47,  1.50it/s]
 25%|██▍       | 16375/65536 [3:03:39<9:06:20,  1.50it/s]
 25%|██▍       | 16376/65536 [3:03:40<9:02:02,  1.51it/s]
 25%|██▍       | 16377/65536 [3:03:41<9:11:34,  1.49it/s]
 25%|██▍       | 16378/65536 [3:03:41<9:10:48,  1.49it/s]
 25%|██▍       | 16379/65536 [3:03:42<9:18:20,  1.47it/s]
 25%|██▍       | 16380/65536 [3:03:43<9:05:22,  1.50it/s]
                                                         
{'loss': 0.9129, 'learning_rate': 7.771213419860414e-07, 'epoch': 1011.11}

 25%|██▍       | 16380/65536 [3:03:43<9:05:22,  1.50it/s]
 25%|██▍       | 16381/65536 [3:03:43<9:15:34,  1.47it/s]
 25%|██▍       | 16382/65536 [3:03:44<9:04:33,  1.50it/s]
 25%|██▍       | 16383/65536 [3:03:45<9:06:13,  1.50it/s]
 25%|██▌       | 16384/65536 [3:03:45<9:04:52,  1.50it/s]
 25%|██▌       | 16385/65536 [3:03:46<9:00:08,  1.52it/s]
 25%|██▌       | 16386/65536 [3:03:47<8:59:36,  1.52it/s]
 25%|██▌       | 16387/65536 [3:03:47<8:59:26,  1.52it/s]
 25%|██▌       | 16388/65536 [3:03:48<9:14:01,  1.48it/s]
 25%|██▌       | 16389/65536 [3:03:49<9:06:45,  1.50it/s]
 25%|██▌       | 16390/65536 [3:03:49<9:13:06,  1.48it/s]
 25%|██▌       | 16391/65536 [3:03:50<9:15:59,  1.47it/s]
 25%|██▌       | 16392/65536 [3:03:51<9:22:19,  1.46it/s]
 25%|██▌       | 16393/65536 [3:03:51<9:25:47,  1.45it/s]
 25%|██▌       | 16394/65536 [3:03:52<9:24:13,  1.45it/s]
 25%|██▌       | 16395/65536 [3:03:53<9:50:15,  1.39it/s]
 25%|██▌       | 16396/65536 [3:03:53<9:36:54,  1.42it/s]
 25%|██▌       | 16397/65536 [3:03:54<9:23:39,  1.45it/s]
 25%|██▌       | 16398/65536 [3:03:55<9:24:27,  1.45it/s]
 25%|██▌       | 16399/65536 [3:03:55<9:17:10,  1.47it/s]
 25%|██▌       | 16400/65536 [3:03:56<9:13:57,  1.48it/s]
                                                         
{'loss': 0.9155, 'learning_rate': 7.768458430268152e-07, 'epoch': 1012.35}

 25%|██▌       | 16400/65536 [3:03:56<9:13:57,  1.48it/s]
 25%|██▌       | 16401/65536 [3:03:57<9:08:32,  1.49it/s]
 25%|██▌       | 16402/65536 [3:03:57<9:10:25,  1.49it/s]
 25%|██▌       | 16403/65536 [3:03:58<9:19:33,  1.46it/s]
 25%|██▌       | 16404/65536 [3:03:59<9:10:53,  1.49it/s]
 25%|██▌       | 16405/65536 [3:03:59<8:55:46,  1.53it/s]
 25%|██▌       | 16406/65536 [3:04:00<9:02:23,  1.51it/s]
 25%|██▌       | 16407/65536 [3:04:01<9:00:53,  1.51it/s]
 25%|██▌       | 16408/65536 [3:04:01<8:57:42,  1.52it/s]
 25%|██▌       | 16409/65536 [3:04:02<9:19:48,  1.46it/s]
 25%|██▌       | 16410/65536 [3:04:03<9:07:35,  1.50it/s]
 25%|██▌       | 16411/65536 [3:04:04<9:26:32,  1.45it/s]
 25%|██▌       | 16412/65536 [3:04:04<9:13:44,  1.48it/s]
 25%|██▌       | 16413/65536 [3:04:05<9:01:23,  1.51it/s]
 25%|██▌       | 16414/65536 [3:04:05<9:00:06,  1.52it/s]
 25%|██▌       | 16415/65536 [3:04:06<9:01:32,  1.51it/s]
 25%|██▌       | 16416/65536 [3:04:07<8:54:35,  1.53it/s]
 25%|██▌       | 16417/65536 [3:04:07<8:58:05,  1.52it/s]
 25%|██▌       | 16418/65536 [3:04:08<9:17:13,  1.47it/s]
 25%|██▌       | 16419/65536 [3:04:09<9:35:18,  1.42it/s]
 25%|██▌       | 16420/65536 [3:04:10<9:21:34,  1.46it/s]
                                                         
{'loss': 0.9165, 'learning_rate': 7.765703440675891e-07, 'epoch': 1013.58}

 25%|██▌       | 16420/65536 [3:04:10<9:21:34,  1.46it/s]
 25%|██▌       | 16421/65536 [3:04:10<9:16:49,  1.47it/s]
 25%|██▌       | 16422/65536 [3:04:11<9:15:22,  1.47it/s]
 25%|██▌       | 16423/65536 [3:04:12<9:06:01,  1.50it/s]
 25%|██▌       | 16424/65536 [3:04:12<9:18:10,  1.47it/s]
 25%|██▌       | 16425/65536 [3:04:13<9:16:04,  1.47it/s]
 25%|██▌       | 16426/65536 [3:04:14<9:15:20,  1.47it/s]
 25%|██▌       | 16427/65536 [3:04:14<9:39:16,  1.41it/s]
 25%|██▌       | 16428/65536 [3:04:15<9:35:22,  1.42it/s]
 25%|██▌       | 16429/65536 [3:04:16<9:34:50,  1.42it/s]
 25%|██▌       | 16430/65536 [3:04:17<9:35:02,  1.42it/s]
 25%|██▌       | 16431/65536 [3:04:17<9:24:45,  1.45it/s]
 25%|██▌       | 16432/65536 [3:04:18<9:01:13,  1.51it/s]
 25%|██▌       | 16433/65536 [3:04:18<9:02:10,  1.51it/s]
 25%|██▌       | 16434/65536 [3:04:19<9:11:01,  1.49it/s]
 25%|██▌       | 16435/65536 [3:04:20<9:05:05,  1.50it/s]
 25%|██▌       | 16436/65536 [3:04:20<8:56:28,  1.53it/s]
 25%|██▌       | 16437/65536 [3:04:21<9:13:37,  1.48it/s]
 25%|██▌       | 16438/65536 [3:04:22<9:10:48,  1.49it/s]
 25%|██▌       | 16439/65536 [3:04:22<8:56:49,  1.52it/s]
 25%|██▌       | 16440/65536 [3:04:23<9:15:30,  1.47it/s]
                                                         
{'loss': 0.9128, 'learning_rate': 7.76294845108363e-07, 'epoch': 1014.81}

 25%|██▌       | 16440/65536 [3:04:23<9:15:30,  1.47it/s]
 25%|██▌       | 16441/65536 [3:04:24<9:01:33,  1.51it/s]
 25%|██▌       | 16442/65536 [3:04:24<9:01:31,  1.51it/s]
 25%|██▌       | 16443/65536 [3:04:25<9:02:52,  1.51it/s]
 25%|██▌       | 16444/65536 [3:04:26<9:17:13,  1.47it/s]
 25%|██▌       | 16445/65536 [3:04:26<9:14:14,  1.48it/s]
 25%|██▌       | 16446/65536 [3:04:27<9:01:28,  1.51it/s]
 25%|██▌       | 16447/65536 [3:04:28<9:03:57,  1.50it/s]
 25%|██▌       | 16448/65536 [3:04:28<8:55:21,  1.53it/s]
 25%|██▌       | 16449/65536 [3:04:29<9:20:16,  1.46it/s]
 25%|██▌       | 16450/65536 [3:04:30<9:20:46,  1.46it/s]
 25%|██▌       | 16451/65536 [3:04:30<9:07:23,  1.49it/s]
 25%|██▌       | 16452/65536 [3:04:31<9:12:18,  1.48it/s]
 25%|██▌       | 16453/65536 [3:04:32<9:11:59,  1.48it/s]
 25%|██▌       | 16454/65536 [3:04:33<9:08:52,  1.49it/s]
 25%|██▌       | 16455/65536 [3:04:33<8:58:00,  1.52it/s]
 25%|██▌       | 16456/65536 [3:04:34<8:52:48,  1.54it/s]
 25%|██▌       | 16457/65536 [3:04:34<9:03:48,  1.50it/s]
 25%|██▌       | 16458/65536 [3:04:35<9:10:35,  1.49it/s]
 25%|██▌       | 16459/65536 [3:04:36<9:26:06,  1.44it/s]
 25%|██▌       | 16460/65536 [3:04:37<9:28:18,  1.44it/s]
                                                         
{'loss': 0.9192, 'learning_rate': 7.760193461491367e-07, 'epoch': 1016.05}

 25%|██▌       | 16460/65536 [3:04:37<9:28:18,  1.44it/s]
 25%|██▌       | 16461/65536 [3:04:37<9:27:59,  1.44it/s]
 25%|██▌       | 16462/65536 [3:04:38<9:20:12,  1.46it/s]
 25%|██▌       | 16463/65536 [3:04:39<9:10:55,  1.48it/s]
 25%|██▌       | 16464/65536 [3:04:39<9:14:42,  1.47it/s]
 25%|██▌       | 16465/65536 [3:04:40<9:20:31,  1.46it/s]
 25%|██▌       | 16466/65536 [3:04:41<9:10:12,  1.49it/s]
 25%|██▌       | 16467/65536 [3:04:41<9:17:43,  1.47it/s]
 25%|██▌       | 16468/65536 [3:04:42<9:03:50,  1.50it/s]
 25%|██▌       | 16469/65536 [3:04:43<9:00:01,  1.51it/s]
 25%|██▌       | 16470/65536 [3:04:43<9:03:16,  1.51it/s]
 25%|██▌       | 16471/65536 [3:04:44<9:03:18,  1.51it/s]
 25%|██▌       | 16472/65536 [3:04:45<9:08:54,  1.49it/s]
 25%|██▌       | 16473/65536 [3:04:45<9:09:09,  1.49it/s]
 25%|██▌       | 16474/65536 [3:04:46<9:17:24,  1.47it/s]
 25%|██▌       | 16475/65536 [3:04:47<9:21:29,  1.46it/s]
 25%|██▌       | 16476/65536 [3:04:48<9:43:06,  1.40it/s]
 25%|██▌       | 16477/65536 [3:04:48<9:22:41,  1.45it/s]
 25%|██▌       | 16478/65536 [3:04:49<9:22:42,  1.45it/s]
 25%|██▌       | 16479/65536 [3:04:49<9:08:10,  1.49it/s]
 25%|██▌       | 16480/65536 [3:04:50<9:06:16,  1.50it/s]
                                                         
{'loss': 0.9207, 'learning_rate': 7.757438471899106e-07, 'epoch': 1017.28}

 25%|██▌       | 16480/65536 [3:04:50<9:06:16,  1.50it/s]
 25%|██▌       | 16481/65536 [3:04:51<9:09:23,  1.49it/s]
 25%|██▌       | 16482/65536 [3:04:51<9:11:12,  1.48it/s]
 25%|██▌       | 16483/65536 [3:04:52<9:01:48,  1.51it/s]
 25%|██▌       | 16484/65536 [3:04:53<9:05:24,  1.50it/s]
 25%|██▌       | 16485/65536 [3:04:53<9:10:58,  1.48it/s]
 25%|██▌       | 16486/65536 [3:04:54<9:14:59,  1.47it/s]
 25%|██▌       | 16487/65536 [3:04:55<9:00:15,  1.51it/s]
 25%|██▌       | 16488/65536 [3:04:55<9:01:52,  1.51it/s]
 25%|██▌       | 16489/65536 [3:04:56<9:02:26,  1.51it/s]
 25%|██▌       | 16490/65536 [3:04:57<9:10:08,  1.49it/s]
 25%|██▌       | 16491/65536 [3:04:57<9:12:18,  1.48it/s]
 25%|██▌       | 16492/65536 [3:04:58<9:42:04,  1.40it/s]
 25%|██▌       | 16493/65536 [3:04:59<9:29:08,  1.44it/s]
 25%|██▌       | 16494/65536 [3:05:00<9:24:17,  1.45it/s]
 25%|██▌       | 16495/65536 [3:05:00<9:05:58,  1.50it/s]
 25%|██▌       | 16496/65536 [3:05:01<9:13:01,  1.48it/s]
 25%|██▌       | 16497/65536 [3:05:02<9:19:31,  1.46it/s]
 25%|██▌       | 16498/65536 [3:05:02<9:22:11,  1.45it/s]
 25%|██▌       | 16499/65536 [3:05:03<9:16:15,  1.47it/s]
 25%|██▌       | 16500/65536 [3:05:04<9:16:52,  1.47it/s]
                                                         
{'loss': 0.9221, 'learning_rate': 7.754683482306844e-07, 'epoch': 1018.52}

 25%|██▌       | 16500/65536 [3:05:04<9:16:52,  1.47it/s]
 25%|██▌       | 16501/65536 [3:05:04<9:11:05,  1.48it/s]
 25%|██▌       | 16502/65536 [3:05:05<9:07:39,  1.49it/s]
 25%|██▌       | 16503/65536 [3:05:06<9:06:21,  1.50it/s]
 25%|██▌       | 16504/65536 [3:05:06<9:04:04,  1.50it/s]
 25%|██▌       | 16505/65536 [3:05:07<9:15:10,  1.47it/s]
 25%|██▌       | 16506/65536 [3:05:08<9:20:11,  1.46it/s]
 25%|██▌       | 16507/65536 [3:05:08<9:04:49,  1.50it/s]
 25%|██▌       | 16508/65536 [3:05:09<9:14:52,  1.47it/s]
 25%|██▌       | 16509/65536 [3:05:10<9:11:09,  1.48it/s]
 25%|██▌       | 16510/65536 [3:05:10<9:01:00,  1.51it/s]
 25%|██▌       | 16511/65536 [3:05:11<9:19:20,  1.46it/s]
 25%|██▌       | 16512/65536 [3:05:12<9:34:52,  1.42it/s]
 25%|██▌       | 16513/65536 [3:05:13<9:28:29,  1.44it/s]
 25%|██▌       | 16514/65536 [3:05:13<9:12:42,  1.48it/s]
 25%|██▌       | 16515/65536 [3:05:14<8:56:59,  1.52it/s]
 25%|██▌       | 16516/65536 [3:05:14<9:00:57,  1.51it/s]
 25%|██▌       | 16517/65536 [3:05:15<9:05:44,  1.50it/s]
 25%|██▌       | 16518/65536 [3:05:16<9:15:22,  1.47it/s]
 25%|██▌       | 16519/65536 [3:05:17<9:25:07,  1.45it/s]
 25%|██▌       | 16520/65536 [3:05:17<9:00:00,  1.51it/s]
                                                         
{'loss': 0.9162, 'learning_rate': 7.751928492714583e-07, 'epoch': 1019.75}

 25%|██▌       | 16520/65536 [3:05:17<9:00:00,  1.51it/s]
 25%|██▌       | 16521/65536 [3:05:18<9:04:45,  1.50it/s]
 25%|██▌       | 16522/65536 [3:05:18<8:58:48,  1.52it/s]
 25%|██▌       | 16523/65536 [3:05:19<9:13:27,  1.48it/s]
 25%|██▌       | 16524/65536 [3:05:20<9:10:36,  1.48it/s]
 25%|██▌       | 16525/65536 [3:05:21<9:30:43,  1.43it/s]
 25%|██▌       | 16526/65536 [3:05:21<9:26:55,  1.44it/s]
 25%|██▌       | 16527/65536 [3:05:22<9:17:10,  1.47it/s]
 25%|██▌       | 16528/65536 [3:05:23<9:13:06,  1.48it/s]
 25%|██▌       | 16529/65536 [3:05:23<9:07:59,  1.49it/s]
 25%|██▌       | 16530/65536 [3:05:24<8:57:54,  1.52it/s]
 25%|██▌       | 16531/65536 [3:05:25<9:15:16,  1.47it/s]
 25%|██▌       | 16532/65536 [3:05:25<9:16:40,  1.47it/s]
 25%|██▌       | 16533/65536 [3:05:26<9:28:30,  1.44it/s]
 25%|██▌       | 16534/65536 [3:05:27<9:19:24,  1.46it/s]
 25%|██▌       | 16535/65536 [3:05:27<9:06:00,  1.50it/s]
 25%|██▌       | 16536/65536 [3:05:28<8:58:20,  1.52it/s]
 25%|██▌       | 16537/65536 [3:05:29<9:08:21,  1.49it/s]
 25%|██▌       | 16538/65536 [3:05:29<9:06:13,  1.50it/s]
 25%|██▌       | 16539/65536 [3:05:30<9:03:09,  1.50it/s]
 25%|██▌       | 16540/65536 [3:05:31<8:58:41,  1.52it/s]
                                                         
{'loss': 0.9345, 'learning_rate': 7.749173503122321e-07, 'epoch': 1020.99}

 25%|██▌       | 16540/65536 [3:05:31<8:58:41,  1.52it/s]
 25%|██▌       | 16541/65536 [3:05:31<9:39:09,  1.41it/s]
 25%|██▌       | 16542/65536 [3:05:32<9:35:53,  1.42it/s]
 25%|██▌       | 16543/65536 [3:05:33<9:16:03,  1.47it/s]
 25%|██▌       | 16544/65536 [3:05:33<9:07:00,  1.49it/s]
 25%|██▌       | 16545/65536 [3:05:34<9:02:19,  1.51it/s]
 25%|██▌       | 16546/65536 [3:05:35<9:03:30,  1.50it/s]
 25%|██▌       | 16547/65536 [3:05:35<9:05:12,  1.50it/s]
 25%|██▌       | 16548/65536 [3:05:36<9:07:15,  1.49it/s]
 25%|██▌       | 16549/65536 [3:05:37<9:16:38,  1.47it/s]
 25%|██▌       | 16550/65536 [3:05:37<9:10:11,  1.48it/s]
 25%|██▌       | 16551/65536 [3:05:38<9:08:50,  1.49it/s]
 25%|██▌       | 16552/65536 [3:05:39<9:07:40,  1.49it/s]
 25%|██▌       | 16553/65536 [3:05:39<9:07:56,  1.49it/s]
 25%|██▌       | 16554/65536 [3:05:40<9:02:24,  1.51it/s]
 25%|██▌       | 16555/65536 [3:05:41<9:03:46,  1.50it/s]
 25%|██▌       | 16556/65536 [3:05:41<9:02:17,  1.51it/s]
 25%|██▌       | 16557/65536 [3:05:42<9:19:25,  1.46it/s]
 25%|██▌       | 16558/65536 [3:05:43<9:10:24,  1.48it/s]
 25%|██▌       | 16559/65536 [3:05:43<9:03:08,  1.50it/s]
 25%|██▌       | 16560/65536 [3:05:44<9:09:09,  1.49it/s]
                                                         
{'loss': 0.925, 'learning_rate': 7.746418513530059e-07, 'epoch': 1022.22}

 25%|██▌       | 16560/65536 [3:05:44<9:09:09,  1.49it/s]
 25%|██▌       | 16561/65536 [3:05:45<9:04:39,  1.50it/s]
 25%|██▌       | 16562/65536 [3:05:46<9:16:28,  1.47it/s]
 25%|██▌       | 16563/65536 [3:05:46<9:23:29,  1.45it/s]
 25%|██▌       | 16564/65536 [3:05:47<9:36:39,  1.42it/s]
 25%|██▌       | 16565/65536 [3:05:48<9:22:41,  1.45it/s]
 25%|██▌       | 16566/65536 [3:05:48<9:22:01,  1.45it/s]
 25%|██▌       | 16567/65536 [3:05:49<9:19:17,  1.46it/s]
 25%|██▌       | 16568/65536 [3:05:50<9:28:26,  1.44it/s]
 25%|██▌       | 16569/65536 [3:05:50<9:20:06,  1.46it/s]
 25%|██▌       | 16570/65536 [3:05:51<9:18:47,  1.46it/s]
 25%|██▌       | 16571/65536 [3:05:52<9:01:02,  1.51it/s]
 25%|██▌       | 16572/65536 [3:05:52<8:57:14,  1.52it/s]
 25%|██▌       | 16573/65536 [3:05:53<9:30:12,  1.43it/s]
 25%|██▌       | 16574/65536 [3:05:54<9:25:43,  1.44it/s]
 25%|██▌       | 16575/65536 [3:05:54<9:23:42,  1.45it/s]
 25%|██▌       | 16576/65536 [3:05:55<9:31:04,  1.43it/s]
 25%|██▌       | 16577/65536 [3:05:56<9:27:57,  1.44it/s]
 25%|██▌       | 16578/65536 [3:05:57<9:14:58,  1.47it/s]
 25%|██▌       | 16579/65536 [3:05:57<9:03:45,  1.50it/s]
 25%|██▌       | 16580/65536 [3:05:58<8:59:44,  1.51it/s]
                                                         
{'loss': 0.9033, 'learning_rate': 7.743663523937798e-07, 'epoch': 1023.46}

 25%|██▌       | 16580/65536 [3:05:58<8:59:44,  1.51it/s]
 25%|██▌       | 16581/65536 [3:05:58<8:57:24,  1.52it/s]
 25%|██▌       | 16582/65536 [3:05:59<8:53:09,  1.53it/s]
 25%|██▌       | 16583/65536 [3:06:00<8:55:29,  1.52it/s]
 25%|██▌       | 16584/65536 [3:06:00<8:58:37,  1.51it/s]
 25%|██▌       | 16585/65536 [3:06:01<9:19:08,  1.46it/s]
 25%|██▌       | 16586/65536 [3:06:02<9:17:00,  1.46it/s]
 25%|██▌       | 16587/65536 [3:06:03<9:10:21,  1.48it/s]
 25%|██▌       | 16588/65536 [3:06:03<9:08:02,  1.49it/s]
 25%|██▌       | 16589/65536 [3:06:04<9:25:37,  1.44it/s]
 25%|██▌       | 16590/65536 [3:06:05<9:21:51,  1.45it/s]
 25%|██▌       | 16591/65536 [3:06:05<9:16:10,  1.47it/s]
 25%|██▌       | 16592/65536 [3:06:06<9:15:35,  1.47it/s]
 25%|██▌       | 16593/65536 [3:06:07<9:04:55,  1.50it/s]
 25%|██▌       | 16594/65536 [3:06:07<9:04:45,  1.50it/s]
 25%|██▌       | 16595/65536 [3:06:08<9:03:31,  1.50it/s]
 25%|██▌       | 16596/65536 [3:06:09<9:14:12,  1.47it/s]
 25%|██▌       | 16597/65536 [3:06:09<9:03:56,  1.50it/s]
 25%|██▌       | 16598/65536 [3:06:10<8:58:45,  1.51it/s]
 25%|██▌       | 16599/65536 [3:06:11<9:09:37,  1.48it/s]
 25%|██▌       | 16600/65536 [3:06:11<9:04:11,  1.50it/s]
                                                         
{'loss': 0.9194, 'learning_rate': 7.740908534345536e-07, 'epoch': 1024.69}

 25%|██▌       | 16600/65536 [3:06:11<9:04:11,  1.50it/s]
 25%|██▌       | 16601/65536 [3:06:12<9:08:47,  1.49it/s]
 25%|██▌       | 16602/65536 [3:06:13<9:12:03,  1.48it/s]
 25%|██▌       | 16603/65536 [3:06:13<9:15:29,  1.47it/s]
 25%|██▌       | 16604/65536 [3:06:14<9:11:04,  1.48it/s]
 25%|██▌       | 16605/65536 [3:06:15<9:14:51,  1.47it/s]
 25%|██▌       | 16606/65536 [3:06:15<9:40:23,  1.41it/s]
 25%|██▌       | 16607/65536 [3:06:16<9:23:22,  1.45it/s]
 25%|██▌       | 16608/65536 [3:06:17<9:06:38,  1.49it/s]
 25%|██▌       | 16609/65536 [3:06:17<9:07:15,  1.49it/s]
 25%|██▌       | 16610/65536 [3:06:18<9:04:56,  1.50it/s]
 25%|██▌       | 16611/65536 [3:06:19<8:56:57,  1.52it/s]
 25%|██▌       | 16612/65536 [3:06:19<8:54:26,  1.53it/s]
 25%|██▌       | 16613/65536 [3:06:20<9:02:36,  1.50it/s]
 25%|██▌       | 16614/65536 [3:06:21<9:11:25,  1.48it/s]
 25%|██▌       | 16615/65536 [3:06:21<9:18:17,  1.46it/s]
 25%|██▌       | 16616/65536 [3:06:22<9:21:41,  1.45it/s]
 25%|██▌       | 16617/65536 [3:06:23<9:26:10,  1.44it/s]
 25%|██▌       | 16618/65536 [3:06:24<9:35:52,  1.42it/s]
 25%|██▌       | 16619/65536 [3:06:24<9:27:03,  1.44it/s]
 25%|██▌       | 16620/65536 [3:06:25<9:21:26,  1.45it/s]
                                                         
{'loss': 0.908, 'learning_rate': 7.738153544753275e-07, 'epoch': 1025.93}

 25%|██▌       | 16620/65536 [3:06:25<9:21:26,  1.45it/s]
 25%|██▌       | 16621/65536 [3:06:26<9:17:11,  1.46it/s]
 25%|██▌       | 16622/65536 [3:06:26<9:30:49,  1.43it/s]
 25%|██▌       | 16623/65536 [3:06:27<9:27:10,  1.44it/s]
 25%|██▌       | 16624/65536 [3:06:28<9:21:09,  1.45it/s]
 25%|██▌       | 16625/65536 [3:06:28<9:07:01,  1.49it/s]
 25%|██▌       | 16626/65536 [3:06:29<9:10:59,  1.48it/s]
 25%|██▌       | 16627/65536 [3:06:30<9:02:02,  1.50it/s]
 25%|██▌       | 16628/65536 [3:06:30<8:59:51,  1.51it/s]
 25%|██▌       | 16629/65536 [3:06:31<8:55:45,  1.52it/s]
 25%|██▌       | 16630/65536 [3:06:32<9:09:46,  1.48it/s]
 25%|██▌       | 16631/65536 [3:06:32<8:54:10,  1.53it/s]
 25%|██▌       | 16632/65536 [3:06:33<8:51:03,  1.53it/s]
 25%|██▌       | 16633/65536 [3:06:34<8:51:03,  1.53it/s]
 25%|██▌       | 16634/65536 [3:06:34<8:53:32,  1.53it/s]
 25%|██▌       | 16635/65536 [3:06:35<9:30:21,  1.43it/s]
 25%|██▌       | 16636/65536 [3:06:36<9:26:31,  1.44it/s]
 25%|██▌       | 16637/65536 [3:06:36<9:22:56,  1.45it/s]
 25%|██▌       | 16638/65536 [3:06:37<9:51:31,  1.38it/s]
 25%|██▌       | 16639/65536 [3:06:38<9:41:44,  1.40it/s]
 25%|██▌       | 16640/65536 [3:06:39<9:20:33,  1.45it/s]
                                                         
{'loss': 0.9337, 'learning_rate': 7.735398555161013e-07, 'epoch': 1027.16}

 25%|██▌       | 16640/65536 [3:06:39<9:20:33,  1.45it/s]
 25%|██▌       | 16641/65536 [3:06:39<9:25:00,  1.44it/s]
 25%|██▌       | 16642/65536 [3:06:40<9:13:48,  1.47it/s]
 25%|██▌       | 16643/65536 [3:06:41<8:59:37,  1.51it/s]
 25%|██▌       | 16644/65536 [3:06:41<8:54:24,  1.52it/s]
 25%|██▌       | 16645/65536 [3:06:42<8:59:50,  1.51it/s]
 25%|██▌       | 16646/65536 [3:06:42<9:00:20,  1.51it/s]
 25%|██▌       | 16647/65536 [3:06:43<9:12:34,  1.47it/s]
 25%|██▌       | 16648/65536 [3:06:44<9:02:55,  1.50it/s]
 25%|██▌       | 16649/65536 [3:06:45<9:00:35,  1.51it/s]
 25%|██▌       | 16650/65536 [3:06:45<8:59:07,  1.51it/s]
 25%|██▌       | 16651/65536 [3:06:46<8:55:11,  1.52it/s]
 25%|██▌       | 16652/65536 [3:06:47<9:12:17,  1.48it/s]
 25%|██▌       | 16653/65536 [3:06:47<9:05:34,  1.49it/s]
 25%|██▌       | 16654/65536 [3:06:48<9:28:39,  1.43it/s]
 25%|██▌       | 16655/65536 [3:06:49<9:21:11,  1.45it/s]
 25%|██▌       | 16656/65536 [3:06:49<9:23:40,  1.45it/s]
 25%|██▌       | 16657/65536 [3:06:50<9:21:22,  1.45it/s]
 25%|██▌       | 16658/65536 [3:06:51<9:23:20,  1.45it/s]
 25%|██▌       | 16659/65536 [3:06:51<9:09:45,  1.48it/s]
 25%|██▌       | 16660/65536 [3:06:52<9:14:54,  1.47it/s]
                                                         
{'loss': 0.9237, 'learning_rate': 7.732643565568752e-07, 'epoch': 1028.4}

 25%|██▌       | 16660/65536 [3:06:52<9:14:54,  1.47it/s]
 25%|██▌       | 16661/65536 [3:06:53<9:26:06,  1.44it/s]
 25%|██▌       | 16662/65536 [3:06:53<9:13:22,  1.47it/s]
 25%|██▌       | 16663/65536 [3:06:54<9:10:47,  1.48it/s]
 25%|██▌       | 16664/65536 [3:06:55<9:10:04,  1.48it/s]
 25%|██▌       | 16665/65536 [3:06:55<9:07:24,  1.49it/s]
 25%|██▌       | 16666/65536 [3:06:56<9:00:19,  1.51it/s]
 25%|██▌       | 16667/65536 [3:06:57<8:56:58,  1.52it/s]
 25%|██▌       | 16668/65536 [3:06:57<8:57:21,  1.52it/s]
 25%|██▌       | 16669/65536 [3:06:58<8:55:35,  1.52it/s]
 25%|██▌       | 16670/65536 [3:06:59<9:12:20,  1.47it/s]
 25%|██▌       | 16671/65536 [3:06:59<9:09:09,  1.48it/s]
 25%|██▌       | 16672/65536 [3:07:00<9:04:34,  1.50it/s]
 25%|██▌       | 16673/65536 [3:07:01<9:10:05,  1.48it/s]
 25%|██▌       | 16674/65536 [3:07:01<9:12:52,  1.47it/s]
 25%|██▌       | 16675/65536 [3:07:02<9:21:41,  1.45it/s]
 25%|██▌       | 16676/65536 [3:07:03<9:13:25,  1.47it/s]
 25%|██▌       | 16677/65536 [3:07:04<9:19:52,  1.45it/s]
 25%|██▌       | 16678/65536 [3:07:04<9:17:18,  1.46it/s]
 25%|██▌       | 16679/65536 [3:07:05<8:59:23,  1.51it/s]
 25%|██▌       | 16680/65536 [3:07:05<9:03:26,  1.50it/s]
                                                         
{'loss': 0.9225, 'learning_rate': 7.729888575976491e-07, 'epoch': 1029.63}

 25%|██▌       | 16680/65536 [3:07:05<9:03:26,  1.50it/s]
 25%|██▌       | 16681/65536 [3:07:06<8:50:02,  1.54it/s]
 25%|██▌       | 16682/65536 [3:07:07<8:49:46,  1.54it/s]
 25%|██▌       | 16683/65536 [3:07:07<8:58:45,  1.51it/s]
 25%|██▌       | 16684/65536 [3:07:08<9:09:35,  1.48it/s]
 25%|██▌       | 16685/65536 [3:07:09<9:17:39,  1.46it/s]
 25%|██▌       | 16686/65536 [3:07:09<9:11:21,  1.48it/s]
 25%|██▌       | 16687/65536 [3:07:10<9:34:00,  1.42it/s]
 25%|██▌       | 16688/65536 [3:07:11<9:13:56,  1.47it/s]
 25%|██▌       | 16689/65536 [3:07:12<9:11:50,  1.48it/s]
 25%|██▌       | 16690/65536 [3:07:12<9:04:25,  1.50it/s]
 25%|██▌       | 16691/65536 [3:07:13<9:00:58,  1.50it/s]
 25%|██▌       | 16692/65536 [3:07:14<8:55:23,  1.52it/s]
 25%|██▌       | 16693/65536 [3:07:14<9:11:37,  1.48it/s]
 25%|██▌       | 16694/65536 [3:07:15<9:10:03,  1.48it/s]
 25%|██▌       | 16695/65536 [3:07:16<9:29:15,  1.43it/s]
 25%|██▌       | 16696/65536 [3:07:16<9:16:43,  1.46it/s]
 25%|██▌       | 16697/65536 [3:07:17<9:20:02,  1.45it/s]
 25%|██▌       | 16698/65536 [3:07:18<9:06:04,  1.49it/s]
 25%|██▌       | 16699/65536 [3:07:18<9:01:15,  1.50it/s]
 25%|██▌       | 16700/65536 [3:07:19<8:49:49,  1.54it/s]
                                                         
{'loss': 0.909, 'learning_rate': 7.727133586384229e-07, 'epoch': 1030.86}

 25%|██▌       | 16700/65536 [3:07:19<8:49:49,  1.54it/s]
 25%|██▌       | 16701/65536 [3:07:20<9:06:47,  1.49it/s]
 25%|██▌       | 16702/65536 [3:07:20<8:56:31,  1.52it/s]
 25%|██▌       | 16703/65536 [3:07:21<9:25:47,  1.44it/s]
 25%|██▌       | 16704/65536 [3:07:22<9:19:40,  1.45it/s]
 25%|██▌       | 16705/65536 [3:07:22<9:25:36,  1.44it/s]
 25%|██▌       | 16706/65536 [3:07:23<9:23:17,  1.44it/s]
 25%|██▌       | 16707/65536 [3:07:24<9:13:27,  1.47it/s]
 25%|██▌       | 16708/65536 [3:07:24<9:13:50,  1.47it/s]
 25%|██▌       | 16709/65536 [3:07:25<9:08:04,  1.48it/s]
 25%|██▌       | 16710/65536 [3:07:26<9:04:30,  1.49it/s]
 25%|██▌       | 16711/65536 [3:07:26<9:11:16,  1.48it/s]
 26%|██▌       | 16712/65536 [3:07:27<9:11:21,  1.48it/s]
 26%|██▌       | 16713/65536 [3:07:28<9:16:07,  1.46it/s]
 26%|██▌       | 16714/65536 [3:07:28<9:13:31,  1.47it/s]
 26%|██▌       | 16715/65536 [3:07:29<9:03:04,  1.50it/s]
 26%|██▌       | 16716/65536 [3:07:30<9:00:05,  1.51it/s]
 26%|██▌       | 16717/65536 [3:07:30<9:04:45,  1.49it/s]
 26%|██▌       | 16718/65536 [3:07:31<9:15:24,  1.46it/s]
 26%|██▌       | 16719/65536 [3:07:32<9:25:29,  1.44it/s]
 26%|██▌       | 16720/65536 [3:07:33<9:16:45,  1.46it/s]
                                                         
{'loss': 0.92, 'learning_rate': 7.724378596791968e-07, 'epoch': 1032.1}

 26%|██▌       | 16720/65536 [3:07:33<9:16:45,  1.46it/s]
 26%|██▌       | 16721/65536 [3:07:33<9:02:52,  1.50it/s]
 26%|██▌       | 16722/65536 [3:07:34<9:12:25,  1.47it/s]
 26%|██▌       | 16723/65536 [3:07:35<9:16:28,  1.46it/s]
 26%|██▌       | 16724/65536 [3:07:35<9:06:28,  1.49it/s]
 26%|██▌       | 16725/65536 [3:07:36<9:12:44,  1.47it/s]
 26%|██▌       | 16726/65536 [3:07:37<9:26:52,  1.44it/s]
 26%|██▌       | 16727/65536 [3:07:37<9:39:42,  1.40it/s]
 26%|██▌       | 16728/65536 [3:07:38<9:23:22,  1.44it/s]
 26%|██▌       | 16729/65536 [3:07:39<9:22:16,  1.45it/s]
 26%|██▌       | 16730/65536 [3:07:39<9:13:16,  1.47it/s]
 26%|██▌       | 16731/65536 [3:07:40<9:10:06,  1.48it/s]
 26%|██▌       | 16732/65536 [3:07:41<9:15:24,  1.46it/s]
 26%|██▌       | 16733/65536 [3:07:41<9:10:24,  1.48it/s]
 26%|██▌       | 16734/65536 [3:07:42<8:53:47,  1.52it/s]
 26%|██▌       | 16735/65536 [3:07:43<9:12:15,  1.47it/s]
 26%|██▌       | 16736/65536 [3:07:43<9:21:27,  1.45it/s]
 26%|██▌       | 16737/65536 [3:07:44<9:11:01,  1.48it/s]
 26%|██▌       | 16738/65536 [3:07:45<9:06:24,  1.49it/s]
 26%|██▌       | 16739/65536 [3:07:46<9:14:49,  1.47it/s]
 26%|██▌       | 16740/65536 [3:07:46<9:09:19,  1.48it/s]
                                                         
{'loss': 0.8961, 'learning_rate': 7.721623607199706e-07, 'epoch': 1033.33}

 26%|██▌       | 16740/65536 [3:07:46<9:09:19,  1.48it/s]
 26%|██▌       | 16741/65536 [3:07:47<9:17:00,  1.46it/s]
 26%|██▌       | 16742/65536 [3:07:47<8:56:47,  1.51it/s]
 26%|██▌       | 16743/65536 [3:07:48<8:59:14,  1.51it/s]
 26%|██▌       | 16744/65536 [3:07:49<9:12:58,  1.47it/s]
 26%|██▌       | 16745/65536 [3:07:50<9:19:39,  1.45it/s]
 26%|██▌       | 16746/65536 [3:07:50<9:10:18,  1.48it/s]
 26%|██▌       | 16747/65536 [3:07:51<9:17:36,  1.46it/s]
 26%|██▌       | 16748/65536 [3:07:52<9:12:33,  1.47it/s]
 26%|██▌       | 16749/65536 [3:07:52<9:02:35,  1.50it/s]
 26%|██▌       | 16750/65536 [3:07:53<8:58:43,  1.51it/s]
 26%|██▌       | 16751/65536 [3:07:54<9:16:39,  1.46it/s]
 26%|██▌       | 16752/65536 [3:07:54<9:19:02,  1.45it/s]
 26%|██▌       | 16753/65536 [3:07:55<9:26:54,  1.43it/s]
 26%|██▌       | 16754/65536 [3:07:56<9:07:58,  1.48it/s]
 26%|██▌       | 16755/65536 [3:07:56<9:16:05,  1.46it/s]
 26%|██▌       | 16756/65536 [3:07:57<9:11:00,  1.48it/s]
 26%|██▌       | 16757/65536 [3:07:58<9:15:59,  1.46it/s]
 26%|██▌       | 16758/65536 [3:07:58<9:07:00,  1.49it/s]
 26%|██▌       | 16759/65536 [3:07:59<9:05:40,  1.49it/s]
 26%|██▌       | 16760/65536 [3:08:00<8:57:31,  1.51it/s]
                                                         
{'loss': 0.9309, 'learning_rate': 7.718868617607444e-07, 'epoch': 1034.57}

 26%|██▌       | 16760/65536 [3:08:00<8:57:31,  1.51it/s]
 26%|██▌       | 16761/65536 [3:08:00<9:12:27,  1.47it/s]
 26%|██▌       | 16762/65536 [3:08:01<9:09:38,  1.48it/s]
 26%|██▌       | 16763/65536 [3:08:02<8:55:54,  1.52it/s]
 26%|██▌       | 16764/65536 [3:08:02<8:59:05,  1.51it/s]
 26%|██▌       | 16765/65536 [3:08:03<9:09:18,  1.48it/s]
 26%|██▌       | 16766/65536 [3:08:04<9:14:36,  1.47it/s]
 26%|██▌       | 16767/65536 [3:08:04<9:06:40,  1.49it/s]
 26%|██▌       | 16768/65536 [3:08:05<9:09:41,  1.48it/s]
 26%|██▌       | 16769/65536 [3:08:06<9:01:09,  1.50it/s]
 26%|██▌       | 16770/65536 [3:08:06<9:06:51,  1.49it/s]
 26%|██▌       | 16771/65536 [3:08:07<8:54:54,  1.52it/s]
 26%|██▌       | 16772/65536 [3:08:08<9:01:44,  1.50it/s]
 26%|██▌       | 16773/65536 [3:08:08<8:48:57,  1.54it/s]
 26%|██▌       | 16774/65536 [3:08:09<8:53:09,  1.52it/s]
 26%|██▌       | 16775/65536 [3:08:10<8:44:27,  1.55it/s]
 26%|██▌       | 16776/65536 [3:08:10<8:55:24,  1.52it/s]
 26%|██▌       | 16777/65536 [3:08:11<9:07:32,  1.48it/s]
 26%|██▌       | 16778/65536 [3:08:12<9:18:21,  1.46it/s]
 26%|██▌       | 16779/65536 [3:08:12<9:10:51,  1.48it/s]
 26%|██▌       | 16780/65536 [3:08:13<9:18:47,  1.45it/s]
                                                         
{'loss': 0.9122, 'learning_rate': 7.716113628015182e-07, 'epoch': 1035.8}

 26%|██▌       | 16780/65536 [3:08:13<9:18:47,  1.45it/s]
 26%|██▌       | 16781/65536 [3:08:14<9:14:06,  1.47it/s]
 26%|██▌       | 16782/65536 [3:08:14<9:14:33,  1.47it/s]
 26%|██▌       | 16783/65536 [3:08:15<9:10:49,  1.48it/s]
 26%|██▌       | 16784/65536 [3:08:16<9:25:33,  1.44it/s]
 26%|██▌       | 16785/65536 [3:08:17<9:29:04,  1.43it/s]
 26%|██▌       | 16786/65536 [3:08:17<9:33:45,  1.42it/s]
 26%|██▌       | 16787/65536 [3:08:18<9:11:05,  1.47it/s]
 26%|██▌       | 16788/65536 [3:08:19<9:16:54,  1.46it/s]
 26%|██▌       | 16789/65536 [3:08:19<8:54:19,  1.52it/s]
 26%|██▌       | 16790/65536 [3:08:20<9:14:58,  1.46it/s]
 26%|██▌       | 16791/65536 [3:08:21<9:01:37,  1.50it/s]
 26%|██▌       | 16792/65536 [3:08:21<9:04:56,  1.49it/s]
 26%|██▌       | 16793/65536 [3:08:22<8:54:12,  1.52it/s]
 26%|██▌       | 16794/65536 [3:08:23<8:58:58,  1.51it/s]
 26%|██▌       | 16795/65536 [3:08:23<8:58:02,  1.51it/s]
 26%|██▌       | 16796/65536 [3:08:24<8:57:30,  1.51it/s]
 26%|██▌       | 16797/65536 [3:08:25<8:58:29,  1.51it/s]
 26%|██▌       | 16798/65536 [3:08:25<9:13:10,  1.47it/s]
 26%|██▌       | 16799/65536 [3:08:26<8:55:10,  1.52it/s]
 26%|██▌       | 16800/65536 [3:08:27<9:24:49,  1.44it/s]
                                                         
{'loss': 0.9372, 'learning_rate': 7.713358638422921e-07, 'epoch': 1037.04}

 26%|██▌       | 16800/65536 [3:08:27<9:24:49,  1.44it/s]
 26%|██▌       | 16801/65536 [3:08:27<9:19:01,  1.45it/s]
 26%|██▌       | 16802/65536 [3:08:28<9:16:27,  1.46it/s]
 26%|██▌       | 16803/65536 [3:08:29<9:07:45,  1.48it/s]
 26%|██▌       | 16804/65536 [3:08:29<9:20:54,  1.45it/s]
 26%|██▌       | 16805/65536 [3:08:30<9:12:59,  1.47it/s]
 26%|██▌       | 16806/65536 [3:08:31<9:14:03,  1.47it/s]
 26%|██▌       | 16807/65536 [3:08:31<9:24:13,  1.44it/s]
 26%|██▌       | 16808/65536 [3:08:32<8:56:51,  1.51it/s]
 26%|██▌       | 16809/65536 [3:08:33<8:39:35,  1.56it/s]
 26%|██▌       | 16810/65536 [3:08:33<8:45:37,  1.55it/s]
 26%|██▌       | 16811/65536 [3:08:34<8:52:59,  1.52it/s]
 26%|██▌       | 16812/65536 [3:08:35<8:55:46,  1.52it/s]
 26%|██▌       | 16813/65536 [3:08:35<9:03:56,  1.49it/s]
 26%|██▌       | 16814/65536 [3:08:36<9:00:11,  1.50it/s]
 26%|██▌       | 16815/65536 [3:08:37<8:53:06,  1.52it/s]
 26%|██▌       | 16816/65536 [3:08:37<9:05:30,  1.49it/s]
 26%|██▌       | 16817/65536 [3:08:38<9:00:59,  1.50it/s]
 26%|██▌       | 16818/65536 [3:08:39<8:57:40,  1.51it/s]
 26%|██▌       | 16819/65536 [3:08:39<9:08:48,  1.48it/s]
 26%|██▌       | 16820/65536 [3:08:40<9:17:34,  1.46it/s]
                                                         
{'loss': 0.9146, 'learning_rate': 7.710603648830659e-07, 'epoch': 1038.27}

 26%|██▌       | 16820/65536 [3:08:40<9:17:34,  1.46it/s]
 26%|██▌       | 16821/65536 [3:08:41<9:06:45,  1.48it/s]
 26%|██▌       | 16822/65536 [3:08:41<9:00:57,  1.50it/s]
 26%|██▌       | 16823/65536 [3:08:42<9:06:58,  1.48it/s]
 26%|██▌       | 16824/65536 [3:08:43<9:04:32,  1.49it/s]
 26%|██▌       | 16825/65536 [3:08:43<9:08:10,  1.48it/s]
 26%|██▌       | 16826/65536 [3:08:44<9:26:45,  1.43it/s]
 26%|██▌       | 16827/65536 [3:08:45<9:11:35,  1.47it/s]
 26%|██▌       | 16828/65536 [3:08:45<9:02:41,  1.50it/s]
 26%|██▌       | 16829/65536 [3:08:46<9:10:01,  1.48it/s]
 26%|██▌       | 16830/65536 [3:08:47<9:04:41,  1.49it/s]
 26%|██▌       | 16831/65536 [3:08:47<9:01:34,  1.50it/s]
 26%|██▌       | 16832/65536 [3:08:48<9:33:10,  1.42it/s]
 26%|██▌       | 16833/65536 [3:08:49<9:31:35,  1.42it/s]
 26%|██▌       | 16834/65536 [3:08:50<9:23:02,  1.44it/s]
 26%|██▌       | 16835/65536 [3:08:50<9:13:34,  1.47it/s]
 26%|██▌       | 16836/65536 [3:08:51<9:07:58,  1.48it/s]
 26%|██▌       | 16837/65536 [3:08:52<9:04:36,  1.49it/s]
 26%|██▌       | 16838/65536 [3:08:52<9:18:57,  1.45it/s]
 26%|██▌       | 16839/65536 [3:08:53<9:09:05,  1.48it/s]
 26%|██▌       | 16840/65536 [3:08:54<8:53:03,  1.52it/s]
                                                         
{'loss': 0.9187, 'learning_rate': 7.707848659238397e-07, 'epoch': 1039.51}

 26%|██▌       | 16840/65536 [3:08:54<8:53:03,  1.52it/s]
 26%|██▌       | 16841/65536 [3:08:54<8:57:17,  1.51it/s]
 26%|██▌       | 16842/65536 [3:08:55<9:12:33,  1.47it/s]
 26%|██▌       | 16843/65536 [3:08:56<9:15:29,  1.46it/s]
 26%|██▌       | 16844/65536 [3:08:56<9:11:25,  1.47it/s]
 26%|██▌       | 16845/65536 [3:08:57<9:23:54,  1.44it/s]
 26%|██▌       | 16846/65536 [3:08:58<9:30:30,  1.42it/s]
 26%|██▌       | 16847/65536 [3:08:58<9:18:14,  1.45it/s]
 26%|██▌       | 16848/65536 [3:08:59<9:08:16,  1.48it/s]
 26%|██▌       | 16849/65536 [3:09:00<9:30:37,  1.42it/s]
 26%|██▌       | 16850/65536 [3:09:00<9:15:56,  1.46it/s]
 26%|██▌       | 16851/65536 [3:09:01<9:11:12,  1.47it/s]
 26%|██▌       | 16852/65536 [3:09:02<9:07:44,  1.48it/s]
 26%|██▌       | 16853/65536 [3:09:02<8:57:23,  1.51it/s]
 26%|██▌       | 16854/65536 [3:09:03<8:55:20,  1.52it/s]
 26%|██▌       | 16855/65536 [3:09:04<9:08:01,  1.48it/s]
 26%|██▌       | 16856/65536 [3:09:05<9:15:14,  1.46it/s]
 26%|██▌       | 16857/65536 [3:09:05<9:10:38,  1.47it/s]
 26%|██▌       | 16858/65536 [3:09:06<9:09:10,  1.48it/s]
 26%|██▌       | 16859/65536 [3:09:07<9:06:52,  1.48it/s]
 26%|██▌       | 16860/65536 [3:09:07<8:51:24,  1.53it/s]
                                                         
{'loss': 0.9154, 'learning_rate': 7.705093669646136e-07, 'epoch': 1040.74}

 26%|██▌       | 16860/65536 [3:09:07<8:51:24,  1.53it/s]
 26%|██▌       | 16861/65536 [3:09:08<8:55:44,  1.51it/s]
 26%|██▌       | 16862/65536 [3:09:09<9:05:53,  1.49it/s]
 26%|██▌       | 16863/65536 [3:09:09<9:14:32,  1.46it/s]
 26%|██▌       | 16864/65536 [3:09:10<9:18:09,  1.45it/s]
 26%|██▌       | 16865/65536 [3:09:11<9:34:59,  1.41it/s]
 26%|██▌       | 16866/65536 [3:09:11<9:15:40,  1.46it/s]
 26%|██▌       | 16867/65536 [3:09:12<9:16:42,  1.46it/s]
 26%|██▌       | 16868/65536 [3:09:13<9:11:33,  1.47it/s]
 26%|██▌       | 16869/65536 [3:09:13<9:02:31,  1.50it/s]
 26%|██▌       | 16870/65536 [3:09:14<9:02:49,  1.49it/s]
 26%|██▌       | 16871/65536 [3:09:15<9:04:54,  1.49it/s]
 26%|██▌       | 16872/65536 [3:09:15<9:04:39,  1.49it/s]
 26%|██▌       | 16873/65536 [3:09:16<9:06:23,  1.48it/s]
 26%|██▌       | 16874/65536 [3:09:17<9:04:16,  1.49it/s]
 26%|██▌       | 16875/65536 [3:09:17<8:52:59,  1.52it/s]
 26%|██▌       | 16876/65536 [3:09:18<8:55:42,  1.51it/s]
 26%|██▌       | 16877/65536 [3:09:19<8:56:06,  1.51it/s]
 26%|██▌       | 16878/65536 [3:09:19<9:01:56,  1.50it/s]
 26%|██▌       | 16879/65536 [3:09:20<8:50:12,  1.53it/s]
 26%|██▌       | 16880/65536 [3:09:21<8:53:57,  1.52it/s]
                                                         
{'loss': 0.9253, 'learning_rate': 7.702338680053874e-07, 'epoch': 1041.98}

 26%|██▌       | 16880/65536 [3:09:21<8:53:57,  1.52it/s]
 26%|██▌       | 16881/65536 [3:09:21<9:30:33,  1.42it/s]
 26%|██▌       | 16882/65536 [3:09:22<9:32:29,  1.42it/s]
 26%|██▌       | 16883/65536 [3:09:23<9:18:53,  1.45it/s]
 26%|██▌       | 16884/65536 [3:09:23<9:04:26,  1.49it/s]
 26%|██▌       | 16885/65536 [3:09:24<9:06:20,  1.48it/s]
 26%|██▌       | 16886/65536 [3:09:25<9:21:03,  1.45it/s]
 26%|██▌       | 16887/65536 [3:09:25<9:15:21,  1.46it/s]
 26%|██▌       | 16888/65536 [3:09:26<9:18:53,  1.45it/s]
 26%|██▌       | 16889/65536 [3:09:27<9:05:19,  1.49it/s]
 26%|██▌       | 16890/65536 [3:09:28<9:09:55,  1.47it/s]
 26%|██▌       | 16891/65536 [3:09:28<9:03:46,  1.49it/s]
 26%|██▌       | 16892/65536 [3:09:29<9:10:53,  1.47it/s]
 26%|██▌       | 16893/65536 [3:09:30<9:00:40,  1.50it/s]
 26%|██▌       | 16894/65536 [3:09:30<8:59:10,  1.50it/s]
 26%|██▌       | 16895/65536 [3:09:31<9:06:38,  1.48it/s]
 26%|██▌       | 16896/65536 [3:09:32<8:57:47,  1.51it/s]
 26%|██▌       | 16897/65536 [3:09:32<9:23:20,  1.44it/s]
 26%|██▌       | 16898/65536 [3:09:33<9:08:00,  1.48it/s]
 26%|██▌       | 16899/65536 [3:09:34<9:07:15,  1.48it/s]
 26%|██▌       | 16900/65536 [3:09:34<9:05:08,  1.49it/s]
                                                         
{'loss': 0.9261, 'learning_rate': 7.699583690461613e-07, 'epoch': 1043.21}

 26%|██▌       | 16900/65536 [3:09:34<9:05:08,  1.49it/s]
 26%|██▌       | 16901/65536 [3:09:35<9:13:27,  1.46it/s]
 26%|██▌       | 16902/65536 [3:09:36<9:00:56,  1.50it/s]
 26%|██▌       | 16903/65536 [3:09:36<9:05:50,  1.48it/s]
 26%|██▌       | 16904/65536 [3:09:37<9:10:52,  1.47it/s]
 26%|██▌       | 16905/65536 [3:09:38<9:08:28,  1.48it/s]
 26%|██▌       | 16906/65536 [3:09:38<8:59:27,  1.50it/s]
 26%|██▌       | 16907/65536 [3:09:39<8:58:56,  1.50it/s]
 26%|██▌       | 16908/65536 [3:09:40<9:04:06,  1.49it/s]
 26%|██▌       | 16909/65536 [3:09:40<9:02:32,  1.49it/s]
 26%|██▌       | 16910/65536 [3:09:41<9:01:50,  1.50it/s]
 26%|██▌       | 16911/65536 [3:09:42<9:15:56,  1.46it/s]
 26%|██▌       | 16912/65536 [3:09:42<9:11:44,  1.47it/s]
 26%|██▌       | 16913/65536 [3:09:43<9:32:11,  1.42it/s]
 26%|██▌       | 16914/65536 [3:09:44<9:13:01,  1.47it/s]
 26%|██▌       | 16915/65536 [3:09:44<9:02:58,  1.49it/s]
 26%|██▌       | 16916/65536 [3:09:45<9:01:52,  1.50it/s]
 26%|██▌       | 16917/65536 [3:09:46<9:05:32,  1.49it/s]
 26%|██▌       | 16918/65536 [3:09:46<9:15:05,  1.46it/s]
 26%|██▌       | 16919/65536 [3:09:47<9:14:19,  1.46it/s]
 26%|██▌       | 16920/65536 [3:09:48<9:08:19,  1.48it/s]
                                                         
{'loss': 0.899, 'learning_rate': 7.696828700869351e-07, 'epoch': 1044.44}

 26%|██▌       | 16920/65536 [3:09:48<9:08:19,  1.48it/s]
 26%|██▌       | 16921/65536 [3:09:48<9:05:27,  1.49it/s]
 26%|██▌       | 16922/65536 [3:09:49<8:56:42,  1.51it/s]
 26%|██▌       | 16923/65536 [3:09:50<9:03:15,  1.49it/s]
 26%|██▌       | 16924/65536 [3:09:50<8:58:12,  1.51it/s]
 26%|██▌       | 16925/65536 [3:09:51<8:49:55,  1.53it/s]
 26%|██▌       | 16926/65536 [3:09:52<8:40:28,  1.56it/s]
 26%|██▌       | 16927/65536 [3:09:52<8:59:24,  1.50it/s]
 26%|██▌       | 16928/65536 [3:09:53<9:18:58,  1.45it/s]
 26%|██▌       | 16929/65536 [3:09:54<9:14:18,  1.46it/s]
 26%|██▌       | 16930/65536 [3:09:55<9:28:10,  1.43it/s]
 26%|██▌       | 16931/65536 [3:09:55<9:41:21,  1.39it/s]
 26%|██▌       | 16932/65536 [3:09:56<9:28:38,  1.42it/s]
 26%|██▌       | 16933/65536 [3:09:57<9:18:26,  1.45it/s]
 26%|██▌       | 16934/65536 [3:09:57<9:16:07,  1.46it/s]
 26%|██▌       | 16935/65536 [3:09:58<9:04:28,  1.49it/s]
 26%|██▌       | 16936/65536 [3:09:59<9:08:06,  1.48it/s]
 26%|██▌       | 16937/65536 [3:09:59<9:17:17,  1.45it/s]
 26%|██▌       | 16938/65536 [3:10:00<9:14:57,  1.46it/s]
 26%|██▌       | 16939/65536 [3:10:01<9:08:28,  1.48it/s]
 26%|██▌       | 16940/65536 [3:10:01<9:12:24,  1.47it/s]
                                                         
{'loss': 0.9249, 'learning_rate': 7.69407371127709e-07, 'epoch': 1045.68}

 26%|██▌       | 16940/65536 [3:10:01<9:12:24,  1.47it/s]
 26%|██▌       | 16941/65536 [3:10:02<9:12:34,  1.47it/s]
 26%|██▌       | 16942/65536 [3:10:03<9:08:50,  1.48it/s]
 26%|██▌       | 16943/65536 [3:10:03<8:51:01,  1.53it/s]
 26%|██▌       | 16944/65536 [3:10:04<8:32:43,  1.58it/s]
 26%|██▌       | 16945/65536 [3:10:05<8:42:26,  1.55it/s]
 26%|██▌       | 16946/65536 [3:10:05<9:11:58,  1.47it/s]
 26%|██▌       | 16947/65536 [3:10:06<9:20:47,  1.44it/s]
 26%|██▌       | 16948/65536 [3:10:07<9:05:49,  1.48it/s]
 26%|██▌       | 16949/65536 [3:10:07<9:03:27,  1.49it/s]
 26%|██▌       | 16950/65536 [3:10:08<8:59:22,  1.50it/s]
 26%|██▌       | 16951/65536 [3:10:09<8:51:12,  1.52it/s]
 26%|██▌       | 16952/65536 [3:10:09<8:57:15,  1.51it/s]
 26%|██▌       | 16953/65536 [3:10:10<8:55:12,  1.51it/s]
 26%|██▌       | 16954/65536 [3:10:11<8:53:39,  1.52it/s]
 26%|██▌       | 16955/65536 [3:10:11<8:56:18,  1.51it/s]
 26%|██▌       | 16956/65536 [3:10:12<8:48:25,  1.53it/s]
 26%|██▌       | 16957/65536 [3:10:13<9:14:32,  1.46it/s]
 26%|██▌       | 16958/65536 [3:10:13<9:26:39,  1.43it/s]
 26%|██▌       | 16959/65536 [3:10:14<9:16:19,  1.46it/s]
 26%|██▌       | 16960/65536 [3:10:15<9:03:54,  1.49it/s]
                                                         
{'loss': 0.9142, 'learning_rate': 7.69131872168483e-07, 'epoch': 1046.91}

 26%|██▌       | 16960/65536 [3:10:15<9:03:54,  1.49it/s]
 26%|██▌       | 16961/65536 [3:10:15<9:04:06,  1.49it/s]
 26%|██▌       | 16962/65536 [3:10:16<9:22:03,  1.44it/s]
 26%|██▌       | 16963/65536 [3:10:17<9:12:37,  1.46it/s]
 26%|██▌       | 16964/65536 [3:10:18<9:20:46,  1.44it/s]
 26%|██▌       | 16965/65536 [3:10:18<9:34:41,  1.41it/s]
 26%|██▌       | 16966/65536 [3:10:19<9:26:03,  1.43it/s]
 26%|██▌       | 16967/65536 [3:10:20<9:17:55,  1.45it/s]
 26%|██▌       | 16968/65536 [3:10:20<9:02:35,  1.49it/s]
 26%|██▌       | 16969/65536 [3:10:21<8:53:59,  1.52it/s]
 26%|██▌       | 16970/65536 [3:10:22<9:00:48,  1.50it/s]
 26%|██▌       | 16971/65536 [3:10:22<8:59:04,  1.50it/s]
 26%|██▌       | 16972/65536 [3:10:23<9:03:28,  1.49it/s]
 26%|██▌       | 16973/65536 [3:10:24<9:06:00,  1.48it/s]
 26%|██▌       | 16974/65536 [3:10:24<8:56:17,  1.51it/s]
 26%|██▌       | 16975/65536 [3:10:25<9:04:57,  1.49it/s]
 26%|██▌       | 16976/65536 [3:10:26<9:05:52,  1.48it/s]
 26%|██▌       | 16977/65536 [3:10:26<8:44:52,  1.54it/s]
 26%|██▌       | 16978/65536 [3:10:27<9:03:03,  1.49it/s]
 26%|██▌       | 16979/65536 [3:10:28<9:09:43,  1.47it/s]
 26%|██▌       | 16980/65536 [3:10:28<9:03:58,  1.49it/s]
                                                         
{'loss': 0.9124, 'learning_rate': 7.688563732092568e-07, 'epoch': 1048.15}

 26%|██▌       | 16980/65536 [3:10:28<9:03:58,  1.49it/s]
 26%|██▌       | 16981/65536 [3:10:29<9:10:40,  1.47it/s]
 26%|██▌       | 16982/65536 [3:10:30<9:02:47,  1.49it/s]
 26%|██▌       | 16983/65536 [3:10:30<9:10:32,  1.47it/s]
 26%|██▌       | 16984/65536 [3:10:31<9:15:49,  1.46it/s]
 26%|██▌       | 16985/65536 [3:10:32<9:06:28,  1.48it/s]
 26%|██▌       | 16986/65536 [3:10:32<9:10:50,  1.47it/s]
 26%|██▌       | 16987/65536 [3:10:33<9:05:55,  1.48it/s]
 26%|██▌       | 16988/65536 [3:10:34<9:07:57,  1.48it/s]
 26%|██▌       | 16989/65536 [3:10:34<9:04:19,  1.49it/s]
 26%|██▌       | 16990/65536 [3:10:35<8:47:35,  1.53it/s]
 26%|██▌       | 16991/65536 [3:10:36<8:37:52,  1.56it/s]
 26%|██▌       | 16992/65536 [3:10:36<8:57:24,  1.51it/s]
 26%|██▌       | 16993/65536 [3:10:37<9:00:11,  1.50it/s]
 26%|██▌       | 16994/65536 [3:10:38<9:13:27,  1.46it/s]
 26%|██▌       | 16995/65536 [3:10:38<9:07:38,  1.48it/s]
 26%|██▌       | 16996/65536 [3:10:39<8:52:32,  1.52it/s]
 26%|██▌       | 16997/65536 [3:10:40<9:01:27,  1.49it/s]
 26%|██▌       | 16998/65536 [3:10:40<9:01:29,  1.49it/s]
 26%|██▌       | 16999/65536 [3:10:41<9:06:53,  1.48it/s]
 26%|██▌       | 17000/65536 [3:10:42<9:09:25,  1.47it/s]
                                                         
{'loss': 0.9062, 'learning_rate': 7.685808742500307e-07, 'epoch': 1049.38}

 26%|██▌       | 17000/65536 [3:10:42<9:09:25,  1.47it/s]
 26%|██▌       | 17001/65536 [3:10:42<9:00:52,  1.50it/s]
 26%|██▌       | 17002/65536 [3:10:43<9:05:08,  1.48it/s]
 26%|██▌       | 17003/65536 [3:10:44<9:07:34,  1.48it/s]
 26%|██▌       | 17004/65536 [3:10:44<9:19:37,  1.45it/s]
 26%|██▌       | 17005/65536 [3:10:45<9:06:59,  1.48it/s]
 26%|██▌       | 17006/65536 [3:10:46<9:12:17,  1.46it/s]
 26%|██▌       | 17007/65536 [3:10:46<9:13:17,  1.46it/s]
 26%|██▌       | 17008/65536 [3:10:47<8:57:06,  1.51it/s]
 26%|██▌       | 17009/65536 [3:10:48<8:56:18,  1.51it/s]
 26%|██▌       | 17010/65536 [3:10:48<9:00:32,  1.50it/s]
 26%|██▌       | 17011/65536 [3:10:49<9:08:13,  1.48it/s]
 26%|██▌       | 17012/65536 [3:10:50<9:07:48,  1.48it/s]
 26%|██▌       | 17013/65536 [3:10:50<9:01:51,  1.49it/s]
 26%|██▌       | 17014/65536 [3:10:51<8:58:50,  1.50it/s]
 26%|██▌       | 17015/65536 [3:10:52<9:07:08,  1.48it/s]
 26%|██▌       | 17016/65536 [3:10:52<9:03:17,  1.49it/s]
 26%|██▌       | 17017/65536 [3:10:53<8:56:04,  1.51it/s]
 26%|██▌       | 17018/65536 [3:10:54<8:48:49,  1.53it/s]
 26%|██▌       | 17019/65536 [3:10:54<8:52:31,  1.52it/s]
 26%|██▌       | 17020/65536 [3:10:55<8:48:31,  1.53it/s]
                                                         
{'loss': 0.9227, 'learning_rate': 7.683053752908044e-07, 'epoch': 1050.62}

 26%|██▌       | 17020/65536 [3:10:55<8:48:31,  1.53it/s]
 26%|██▌       | 17021/65536 [3:10:56<8:53:43,  1.51it/s]
 26%|██▌       | 17022/65536 [3:10:56<8:51:54,  1.52it/s]
 26%|██▌       | 17023/65536 [3:10:57<8:57:23,  1.50it/s]
 26%|██▌       | 17024/65536 [3:10:58<9:12:10,  1.46it/s]
 26%|██▌       | 17025/65536 [3:10:59<9:14:43,  1.46it/s]
 26%|██▌       | 17026/65536 [3:10:59<9:15:32,  1.46it/s]
 26%|██▌       | 17027/65536 [3:11:00<9:27:04,  1.43it/s]
 26%|██▌       | 17028/65536 [3:11:01<9:23:04,  1.44it/s]
 26%|██▌       | 17029/65536 [3:11:01<9:15:48,  1.45it/s]
 26%|██▌       | 17030/65536 [3:11:02<9:07:12,  1.48it/s]
 26%|██▌       | 17031/65536 [3:11:03<8:59:38,  1.50it/s]
 26%|██▌       | 17032/65536 [3:11:03<8:54:06,  1.51it/s]
 26%|██▌       | 17033/65536 [3:11:04<8:59:08,  1.50it/s]
 26%|██▌       | 17034/65536 [3:11:05<9:08:01,  1.48it/s]
 26%|██▌       | 17035/65536 [3:11:05<9:07:35,  1.48it/s]
 26%|██▌       | 17036/65536 [3:11:06<9:25:00,  1.43it/s]
 26%|██▌       | 17037/65536 [3:11:07<9:30:40,  1.42it/s]
 26%|██▌       | 17038/65536 [3:11:07<9:12:48,  1.46it/s]
 26%|██▌       | 17039/65536 [3:11:08<9:10:46,  1.47it/s]
 26%|██▌       | 17040/65536 [3:11:09<9:00:47,  1.49it/s]
                                                         
{'loss': 0.8964, 'learning_rate': 7.680298763315783e-07, 'epoch': 1051.85}

 26%|██▌       | 17040/65536 [3:11:09<9:00:47,  1.49it/s]
 26%|██▌       | 17041/65536 [3:11:09<9:08:33,  1.47it/s]
 26%|██▌       | 17042/65536 [3:11:10<8:57:29,  1.50it/s]
 26%|██▌       | 17043/65536 [3:11:11<9:11:29,  1.47it/s]
 26%|██▌       | 17044/65536 [3:11:11<9:13:03,  1.46it/s]
 26%|██▌       | 17045/65536 [3:11:12<9:14:24,  1.46it/s]
 26%|██▌       | 17046/65536 [3:11:13<9:16:59,  1.45it/s]
 26%|██▌       | 17047/65536 [3:11:14<9:16:06,  1.45it/s]
 26%|██▌       | 17048/65536 [3:11:14<9:16:50,  1.45it/s]
 26%|██▌       | 17049/65536 [3:11:15<9:13:07,  1.46it/s]
 26%|██▌       | 17050/65536 [3:11:16<9:09:07,  1.47it/s]
 26%|██▌       | 17051/65536 [3:11:16<8:58:35,  1.50it/s]
 26%|██▌       | 17052/65536 [3:11:17<8:49:10,  1.53it/s]
 26%|██▌       | 17053/65536 [3:11:17<8:48:38,  1.53it/s]
 26%|██▌       | 17054/65536 [3:11:18<9:01:24,  1.49it/s]
 26%|██▌       | 17055/65536 [3:11:19<9:16:58,  1.45it/s]
 26%|██▌       | 17056/65536 [3:11:20<9:14:59,  1.46it/s]
 26%|██▌       | 17057/65536 [3:11:20<9:10:13,  1.47it/s]
 26%|██▌       | 17058/65536 [3:11:21<8:57:13,  1.50it/s]
 26%|██▌       | 17059/65536 [3:11:22<9:08:37,  1.47it/s]
 26%|██▌       | 17060/65536 [3:11:22<9:20:56,  1.44it/s]
                                                         
{'loss': 0.928, 'learning_rate': 7.677543773723522e-07, 'epoch': 1053.09}

 26%|██▌       | 17060/65536 [3:11:22<9:20:56,  1.44it/s]
 26%|██▌       | 17061/65536 [3:11:23<9:07:02,  1.48it/s]
 26%|██▌       | 17062/65536 [3:11:24<9:07:45,  1.47it/s]
 26%|██▌       | 17063/65536 [3:11:24<9:17:45,  1.45it/s]
 26%|██▌       | 17064/65536 [3:11:25<9:22:37,  1.44it/s]
 26%|██▌       | 17065/65536 [3:11:26<9:17:19,  1.45it/s]
 26%|██▌       | 17066/65536 [3:11:26<9:27:47,  1.42it/s]
 26%|██▌       | 17067/65536 [3:11:27<9:15:28,  1.45it/s]
 26%|██▌       | 17068/65536 [3:11:28<9:02:21,  1.49it/s]
 26%|██▌       | 17069/65536 [3:11:28<8:56:43,  1.51it/s]
 26%|██▌       | 17070/65536 [3:11:29<8:53:25,  1.51it/s]
 26%|██▌       | 17071/65536 [3:11:30<8:46:15,  1.53it/s]
 26%|██▌       | 17072/65536 [3:11:30<8:39:15,  1.56it/s]
 26%|██▌       | 17073/65536 [3:11:31<8:49:15,  1.53it/s]
 26%|██▌       | 17074/65536 [3:11:32<8:46:51,  1.53it/s]
 26%|██▌       | 17075/65536 [3:11:32<9:14:10,  1.46it/s]
 26%|██▌       | 17076/65536 [3:11:33<9:04:08,  1.48it/s]
 26%|██▌       | 17077/65536 [3:11:34<9:18:12,  1.45it/s]
 26%|██▌       | 17078/65536 [3:11:34<9:18:27,  1.45it/s]
 26%|██▌       | 17079/65536 [3:11:35<9:15:25,  1.45it/s]
 26%|██▌       | 17080/65536 [3:11:36<9:06:36,  1.48it/s]
                                                         
{'loss': 0.8993, 'learning_rate': 7.674788784131259e-07, 'epoch': 1054.32}

 26%|██▌       | 17080/65536 [3:11:36<9:06:36,  1.48it/s]
 26%|██▌       | 17081/65536 [3:11:36<9:02:27,  1.49it/s]
 26%|██▌       | 17082/65536 [3:11:37<8:51:25,  1.52it/s]
 26%|██▌       | 17083/65536 [3:11:38<8:41:31,  1.55it/s]
 26%|██▌       | 17084/65536 [3:11:38<9:07:53,  1.47it/s]
 26%|██▌       | 17085/65536 [3:11:39<9:01:50,  1.49it/s]
 26%|██▌       | 17086/65536 [3:11:40<8:56:54,  1.50it/s]
 26%|██▌       | 17087/65536 [3:11:40<9:05:46,  1.48it/s]
 26%|██▌       | 17088/65536 [3:11:41<9:01:49,  1.49it/s]
 26%|██▌       | 17089/65536 [3:11:42<8:57:50,  1.50it/s]
 26%|██▌       | 17090/65536 [3:11:42<8:49:01,  1.53it/s]
 26%|██▌       | 17091/65536 [3:11:43<8:50:39,  1.52it/s]
 26%|██▌       | 17092/65536 [3:11:44<9:32:39,  1.41it/s]
 26%|██▌       | 17093/65536 [3:11:45<9:12:33,  1.46it/s]
 26%|██▌       | 17094/65536 [3:11:45<9:04:59,  1.48it/s]
 26%|██▌       | 17095/65536 [3:11:46<8:57:54,  1.50it/s]
 26%|██▌       | 17096/65536 [3:11:46<8:42:29,  1.55it/s]
 26%|██▌       | 17097/65536 [3:11:47<8:49:35,  1.52it/s]
 26%|██▌       | 17098/65536 [3:11:48<9:07:32,  1.47it/s]
 26%|██▌       | 17099/65536 [3:11:48<8:55:20,  1.51it/s]
 26%|██▌       | 17100/65536 [3:11:49<8:59:22,  1.50it/s]
                                                         
{'loss': 0.9275, 'learning_rate': 7.672033794538998e-07, 'epoch': 1055.56}

 26%|██▌       | 17100/65536 [3:11:49<8:59:22,  1.50it/s]
 26%|██▌       | 17101/65536 [3:11:50<9:02:21,  1.49it/s]
 26%|██▌       | 17102/65536 [3:11:51<9:16:36,  1.45it/s]
 26%|██▌       | 17103/65536 [3:11:51<9:03:48,  1.48it/s]
 26%|██▌       | 17104/65536 [3:11:52<8:49:05,  1.53it/s]
 26%|██▌       | 17105/65536 [3:11:53<8:55:42,  1.51it/s]
 26%|██▌       | 17106/65536 [3:11:53<8:58:59,  1.50it/s]
 26%|██▌       | 17107/65536 [3:11:54<8:56:25,  1.50it/s]
 26%|██▌       | 17108/65536 [3:11:55<9:12:05,  1.46it/s]
 26%|██▌       | 17109/65536 [3:11:55<9:05:27,  1.48it/s]
 26%|██▌       | 17110/65536 [3:11:56<8:51:01,  1.52it/s]
 26%|██▌       | 17111/65536 [3:11:57<8:54:12,  1.51it/s]
 26%|██▌       | 17112/65536 [3:11:57<9:07:12,  1.47it/s]
 26%|██▌       | 17113/65536 [3:11:58<9:02:56,  1.49it/s]
 26%|██▌       | 17114/65536 [3:11:59<9:09:56,  1.47it/s]
 26%|██▌       | 17115/65536 [3:11:59<9:08:07,  1.47it/s]
 26%|██▌       | 17116/65536 [3:12:00<9:08:27,  1.47it/s]
 26%|██▌       | 17117/65536 [3:12:01<9:09:18,  1.47it/s]
 26%|██▌       | 17118/65536 [3:12:01<8:53:09,  1.51it/s]
 26%|██▌       | 17119/65536 [3:12:02<8:49:43,  1.52it/s]
 26%|██▌       | 17120/65536 [3:12:03<9:03:01,  1.49it/s]
                                                         
{'loss': 0.9276, 'learning_rate': 7.669278804946736e-07, 'epoch': 1056.79}

 26%|██▌       | 17120/65536 [3:12:03<9:03:01,  1.49it/s]
 26%|██▌       | 17121/65536 [3:12:03<9:05:48,  1.48it/s]
 26%|██▌       | 17122/65536 [3:12:04<8:59:17,  1.50it/s]
 26%|██▌       | 17123/65536 [3:12:05<8:52:13,  1.52it/s]
 26%|██▌       | 17124/65536 [3:12:05<9:14:11,  1.46it/s]
 26%|██▌       | 17125/65536 [3:12:06<9:17:27,  1.45it/s]
 26%|██▌       | 17126/65536 [3:12:07<9:01:17,  1.49it/s]
 26%|██▌       | 17127/65536 [3:12:07<9:00:19,  1.49it/s]
 26%|██▌       | 17128/65536 [3:12:08<8:48:17,  1.53it/s]
 26%|██▌       | 17129/65536 [3:12:09<8:50:20,  1.52it/s]
 26%|██▌       | 17130/65536 [3:12:09<8:57:20,  1.50it/s]
 26%|██▌       | 17131/65536 [3:12:10<9:05:18,  1.48it/s]
 26%|██▌       | 17132/65536 [3:12:11<8:51:28,  1.52it/s]
 26%|██▌       | 17133/65536 [3:12:11<8:59:10,  1.50it/s]
 26%|██▌       | 17134/65536 [3:12:12<9:01:49,  1.49it/s]
 26%|██▌       | 17135/65536 [3:12:13<8:53:54,  1.51it/s]
 26%|██▌       | 17136/65536 [3:12:13<8:56:48,  1.50it/s]
 26%|██▌       | 17137/65536 [3:12:14<8:39:31,  1.55it/s]
 26%|██▌       | 17138/65536 [3:12:15<9:02:30,  1.49it/s]
 26%|██▌       | 17139/65536 [3:12:15<8:54:00,  1.51it/s]
 26%|██▌       | 17140/65536 [3:12:16<9:30:42,  1.41it/s]
                                                         
{'loss': 0.9322, 'learning_rate': 7.666523815354475e-07, 'epoch': 1058.02}

 26%|██▌       | 17140/65536 [3:12:16<9:30:42,  1.41it/s]
 26%|██▌       | 17141/65536 [3:12:17<9:28:21,  1.42it/s]
 26%|██▌       | 17142/65536 [3:12:17<9:30:23,  1.41it/s]
 26%|██▌       | 17143/65536 [3:12:18<9:22:58,  1.43it/s]
 26%|██▌       | 17144/65536 [3:12:19<9:13:48,  1.46it/s]
 26%|██▌       | 17145/65536 [3:12:19<9:00:45,  1.49it/s]
 26%|██▌       | 17146/65536 [3:12:20<9:14:34,  1.45it/s]
 26%|██▌       | 17147/65536 [3:12:21<9:14:05,  1.46it/s]
 26%|██▌       | 17148/65536 [3:12:22<9:07:35,  1.47it/s]
 26%|██▌       | 17149/65536 [3:12:22<9:03:24,  1.48it/s]
 26%|██▌       | 17150/65536 [3:12:23<8:48:59,  1.52it/s]
 26%|██▌       | 17151/65536 [3:12:23<8:47:28,  1.53it/s]
 26%|██▌       | 17152/65536 [3:12:24<8:47:10,  1.53it/s]
 26%|██▌       | 17153/65536 [3:12:25<8:39:39,  1.55it/s]
 26%|██▌       | 17154/65536 [3:12:25<8:46:57,  1.53it/s]
 26%|██▌       | 17155/65536 [3:12:26<8:40:03,  1.55it/s]
 26%|██▌       | 17156/65536 [3:12:27<8:59:57,  1.49it/s]
 26%|██▌       | 17157/65536 [3:12:27<8:53:56,  1.51it/s]
 26%|██▌       | 17158/65536 [3:12:28<8:52:01,  1.52it/s]
 26%|██▌       | 17159/65536 [3:12:29<8:52:39,  1.51it/s]
 26%|██▌       | 17160/65536 [3:12:29<8:47:48,  1.53it/s]
                                                         
{'loss': 0.9364, 'learning_rate': 7.663768825762213e-07, 'epoch': 1059.26}

 26%|██▌       | 17160/65536 [3:12:29<8:47:48,  1.53it/s]
 26%|██▌       | 17161/65536 [3:12:30<8:45:32,  1.53it/s]
 26%|██▌       | 17162/65536 [3:12:31<8:49:26,  1.52it/s]
 26%|██▌       | 17163/65536 [3:12:31<8:43:40,  1.54it/s]
 26%|██▌       | 17164/65536 [3:12:32<8:47:25,  1.53it/s]
 26%|██▌       | 17165/65536 [3:12:33<8:57:44,  1.50it/s]
 26%|██▌       | 17166/65536 [3:12:33<8:54:03,  1.51it/s]
 26%|██▌       | 17167/65536 [3:12:34<9:05:20,  1.48it/s]
 26%|██▌       | 17168/65536 [3:12:35<9:20:19,  1.44it/s]
 26%|██▌       | 17169/65536 [3:12:36<9:40:17,  1.39it/s]
 26%|██▌       | 17170/65536 [3:12:36<9:10:14,  1.46it/s]
 26%|██▌       | 17171/65536 [3:12:37<9:13:12,  1.46it/s]
 26%|██▌       | 17172/65536 [3:12:37<9:06:27,  1.48it/s]
 26%|██▌       | 17173/65536 [3:12:38<9:29:06,  1.42it/s]
 26%|██▌       | 17174/65536 [3:12:39<9:14:21,  1.45it/s]
 26%|██▌       | 17175/65536 [3:12:40<9:11:10,  1.46it/s]
 26%|██▌       | 17176/65536 [3:12:40<9:19:39,  1.44it/s]
 26%|██▌       | 17177/65536 [3:12:41<9:02:10,  1.49it/s]
 26%|██▌       | 17178/65536 [3:12:42<8:55:20,  1.51it/s]
 26%|██▌       | 17179/65536 [3:12:42<9:01:17,  1.49it/s]
 26%|██▌       | 17180/65536 [3:12:43<8:50:21,  1.52it/s]
                                                         
{'loss': 0.9116, 'learning_rate': 7.661013836169952e-07, 'epoch': 1060.49}

 26%|██▌       | 17180/65536 [3:12:43<8:50:21,  1.52it/s]
 26%|██▌       | 17181/65536 [3:12:44<8:52:47,  1.51it/s]
 26%|██▌       | 17182/65536 [3:12:44<8:52:39,  1.51it/s]
 26%|██▌       | 17183/65536 [3:12:45<9:00:26,  1.49it/s]
 26%|██▌       | 17184/65536 [3:12:46<8:59:33,  1.49it/s]
 26%|██▌       | 17185/65536 [3:12:46<9:03:40,  1.48it/s]
 26%|██▌       | 17186/65536 [3:12:47<9:15:12,  1.45it/s]
 26%|██▌       | 17187/65536 [3:12:48<8:58:29,  1.50it/s]
 26%|██▌       | 17188/65536 [3:12:48<8:49:08,  1.52it/s]
 26%|██▌       | 17189/65536 [3:12:49<9:15:29,  1.45it/s]
 26%|██▌       | 17190/65536 [3:12:50<8:55:32,  1.50it/s]
 26%|██▌       | 17191/65536 [3:12:50<9:05:49,  1.48it/s]
 26%|██▌       | 17192/65536 [3:12:51<8:54:24,  1.51it/s]
 26%|██▌       | 17193/65536 [3:12:52<8:55:55,  1.50it/s]
 26%|██▌       | 17194/65536 [3:12:52<8:49:59,  1.52it/s]
 26%|██▌       | 17195/65536 [3:12:53<8:48:43,  1.52it/s]
 26%|██▌       | 17196/65536 [3:12:54<8:53:51,  1.51it/s]
 26%|██▌       | 17197/65536 [3:12:54<8:37:48,  1.56it/s]
 26%|██▌       | 17198/65536 [3:12:55<8:48:05,  1.53it/s]
 26%|██▌       | 17199/65536 [3:12:56<8:45:28,  1.53it/s]
 26%|██▌       | 17200/65536 [3:12:56<8:53:39,  1.51it/s]
                                                         
{'loss': 0.9109, 'learning_rate': 7.658258846577691e-07, 'epoch': 1061.73}

 26%|██▌       | 17200/65536 [3:12:56<8:53:39,  1.51it/s]
 26%|██▌       | 17201/65536 [3:12:57<8:45:53,  1.53it/s]
 26%|██▌       | 17202/65536 [3:12:57<8:51:17,  1.52it/s]
 26%|██▌       | 17203/65536 [3:12:58<8:59:16,  1.49it/s]
 26%|██▋       | 17204/65536 [3:12:59<9:14:10,  1.45it/s]
 26%|██▋       | 17205/65536 [3:13:00<9:28:49,  1.42it/s]
 26%|██▋       | 17206/65536 [3:13:00<9:09:31,  1.47it/s]
 26%|██▋       | 17207/65536 [3:13:01<9:02:11,  1.49it/s]
 26%|██▋       | 17208/65536 [3:13:02<8:57:57,  1.50it/s]
 26%|██▋       | 17209/65536 [3:13:02<9:09:33,  1.47it/s]
 26%|██▋       | 17210/65536 [3:13:03<9:11:57,  1.46it/s]
 26%|██▋       | 17211/65536 [3:13:04<8:52:57,  1.51it/s]
 26%|██▋       | 17212/65536 [3:13:04<9:04:29,  1.48it/s]
 26%|██▋       | 17213/65536 [3:13:05<9:01:56,  1.49it/s]
 26%|██▋       | 17214/65536 [3:13:06<8:53:38,  1.51it/s]
 26%|██▋       | 17215/65536 [3:13:06<8:49:50,  1.52it/s]
 26%|██▋       | 17216/65536 [3:13:07<9:03:06,  1.48it/s]
 26%|██▋       | 17217/65536 [3:13:08<8:57:16,  1.50it/s]
 26%|██▋       | 17218/65536 [3:13:08<8:45:22,  1.53it/s]
 26%|██▋       | 17219/65536 [3:13:09<8:39:29,  1.55it/s]
 26%|██▋       | 17220/65536 [3:13:10<8:59:23,  1.49it/s]
                                                         
{'loss': 0.9329, 'learning_rate': 7.655503856985429e-07, 'epoch': 1062.96}

 26%|██▋       | 17220/65536 [3:13:10<8:59:23,  1.49it/s]
 26%|██▋       | 17221/65536 [3:13:10<9:40:26,  1.39it/s]
 26%|██▋       | 17222/65536 [3:13:11<9:26:12,  1.42it/s]
 26%|██▋       | 17223/65536 [3:13:12<9:06:19,  1.47it/s]
 26%|██▋       | 17224/65536 [3:13:12<9:18:11,  1.44it/s]
 26%|██▋       | 17225/65536 [3:13:13<9:23:32,  1.43it/s]
 26%|██▋       | 17226/65536 [3:13:14<9:20:28,  1.44it/s]
 26%|██▋       | 17227/65536 [3:13:15<9:08:19,  1.47it/s]
 26%|██▋       | 17228/65536 [3:13:15<9:05:00,  1.48it/s]
 26%|██▋       | 17229/65536 [3:13:16<9:01:14,  1.49it/s]
 26%|██▋       | 17230/65536 [3:13:17<9:02:35,  1.48it/s]
 26%|██▋       | 17231/65536 [3:13:17<9:04:06,  1.48it/s]
 26%|██▋       | 17232/65536 [3:13:18<9:01:23,  1.49it/s]
 26%|██▋       | 17233/65536 [3:13:19<8:52:18,  1.51it/s]
 26%|██▋       | 17234/65536 [3:13:19<8:47:23,  1.53it/s]
 26%|██▋       | 17235/65536 [3:13:20<8:45:55,  1.53it/s]
 26%|██▋       | 17236/65536 [3:13:20<8:45:08,  1.53it/s]
 26%|██▋       | 17237/65536 [3:13:21<9:16:59,  1.45it/s]
 26%|██▋       | 17238/65536 [3:13:22<9:07:11,  1.47it/s]
 26%|██▋       | 17239/65536 [3:13:23<9:05:45,  1.47it/s]
 26%|██▋       | 17240/65536 [3:13:23<9:00:09,  1.49it/s]
                                                         
{'loss': 0.9174, 'learning_rate': 7.652748867393169e-07, 'epoch': 1064.2}

 26%|██▋       | 17240/65536 [3:13:23<9:00:09,  1.49it/s]
 26%|██▋       | 17241/65536 [3:13:24<9:06:29,  1.47it/s]
 26%|██▋       | 17242/65536 [3:13:25<9:04:24,  1.48it/s]
 26%|██▋       | 17243/65536 [3:13:25<8:52:50,  1.51it/s]
 26%|██▋       | 17244/65536 [3:13:26<8:50:37,  1.52it/s]
 26%|██▋       | 17245/65536 [3:13:26<8:42:34,  1.54it/s]
 26%|██▋       | 17246/65536 [3:13:27<8:50:33,  1.52it/s]
 26%|██▋       | 17247/65536 [3:13:28<9:04:10,  1.48it/s]
 26%|██▋       | 17248/65536 [3:13:28<8:50:25,  1.52it/s]
 26%|██▋       | 17249/65536 [3:13:29<8:40:53,  1.55it/s]
 26%|██▋       | 17250/65536 [3:13:30<8:40:48,  1.55it/s]
 26%|██▋       | 17251/65536 [3:13:30<8:49:48,  1.52it/s]
 26%|██▋       | 17252/65536 [3:13:31<8:47:09,  1.53it/s]
 26%|██▋       | 17253/65536 [3:13:32<9:03:26,  1.48it/s]
 26%|██▋       | 17254/65536 [3:13:33<9:19:09,  1.44it/s]
 26%|██▋       | 17255/65536 [3:13:33<9:06:06,  1.47it/s]
 26%|██▋       | 17256/65536 [3:13:34<8:59:30,  1.49it/s]
 26%|██▋       | 17257/65536 [3:13:34<8:52:10,  1.51it/s]
 26%|██▋       | 17258/65536 [3:13:35<8:49:13,  1.52it/s]
 26%|██▋       | 17259/65536 [3:13:36<9:05:10,  1.48it/s]
 26%|██▋       | 17260/65536 [3:13:36<8:51:40,  1.51it/s]
                                                         
{'loss': 0.9115, 'learning_rate': 7.649993877800906e-07, 'epoch': 1065.43}

 26%|██▋       | 17260/65536 [3:13:36<8:51:40,  1.51it/s]
 26%|██▋       | 17261/65536 [3:13:37<8:58:59,  1.49it/s]
 26%|██▋       | 17262/65536 [3:13:38<8:42:33,  1.54it/s]
 26%|██▋       | 17263/65536 [3:13:39<9:05:01,  1.48it/s]
 26%|██▋       | 17264/65536 [3:13:39<8:54:05,  1.51it/s]
 26%|██▋       | 17265/65536 [3:13:40<9:18:56,  1.44it/s]
 26%|██▋       | 17266/65536 [3:13:41<9:11:13,  1.46it/s]
 26%|██▋       | 17267/65536 [3:13:41<9:07:15,  1.47it/s]
 26%|██▋       | 17268/65536 [3:13:42<9:11:06,  1.46it/s]
 26%|██▋       | 17269/65536 [3:13:43<9:03:11,  1.48it/s]
 26%|██▋       | 17270/65536 [3:13:43<9:18:51,  1.44it/s]
 26%|██▋       | 17271/65536 [3:13:44<9:09:56,  1.46it/s]
 26%|██▋       | 17272/65536 [3:13:45<9:08:06,  1.47it/s]
 26%|██▋       | 17273/65536 [3:13:45<9:11:57,  1.46it/s]
 26%|██▋       | 17274/65536 [3:13:46<9:02:32,  1.48it/s]
 26%|██▋       | 17275/65536 [3:13:47<8:56:47,  1.50it/s]
 26%|██▋       | 17276/65536 [3:13:47<8:47:35,  1.52it/s]
 26%|██▋       | 17277/65536 [3:13:48<8:53:33,  1.51it/s]
 26%|██▋       | 17278/65536 [3:13:49<8:59:09,  1.49it/s]
 26%|██▋       | 17279/65536 [3:13:49<8:50:24,  1.52it/s]
 26%|██▋       | 17280/65536 [3:13:50<8:44:16,  1.53it/s]
                                                         
{'loss': 0.9295, 'learning_rate': 7.647238888208645e-07, 'epoch': 1066.67}

 26%|██▋       | 17280/65536 [3:13:50<8:44:16,  1.53it/s]
 26%|██▋       | 17281/65536 [3:13:51<8:35:27,  1.56it/s]
 26%|██▋       | 17282/65536 [3:13:51<8:56:12,  1.50it/s]
 26%|██▋       | 17283/65536 [3:13:52<8:57:31,  1.50it/s]
 26%|██▋       | 17284/65536 [3:13:53<9:05:28,  1.47it/s]
 26%|██▋       | 17285/65536 [3:13:53<9:19:13,  1.44it/s]
 26%|██▋       | 17286/65536 [3:13:54<9:16:39,  1.44it/s]
 26%|██▋       | 17287/65536 [3:13:55<9:08:33,  1.47it/s]
 26%|██▋       | 17288/65536 [3:13:55<9:00:14,  1.49it/s]
 26%|██▋       | 17289/65536 [3:13:56<9:04:32,  1.48it/s]
 26%|██▋       | 17290/65536 [3:13:57<8:58:49,  1.49it/s]
 26%|██▋       | 17291/65536 [3:13:57<8:53:57,  1.51it/s]
 26%|██▋       | 17292/65536 [3:13:58<8:48:49,  1.52it/s]
 26%|██▋       | 17293/65536 [3:13:59<9:01:00,  1.49it/s]
 26%|██▋       | 17294/65536 [3:13:59<9:19:09,  1.44it/s]
 26%|██▋       | 17295/65536 [3:14:00<9:16:00,  1.45it/s]
 26%|██▋       | 17296/65536 [3:14:01<9:03:18,  1.48it/s]
 26%|██▋       | 17297/65536 [3:14:01<9:06:49,  1.47it/s]
 26%|██▋       | 17298/65536 [3:14:02<9:17:49,  1.44it/s]
 26%|██▋       | 17299/65536 [3:14:03<8:52:11,  1.51it/s]
 26%|██▋       | 17300/65536 [3:14:04<9:09:36,  1.46it/s]
                                                         
{'loss': 0.9038, 'learning_rate': 7.644483898616383e-07, 'epoch': 1067.9}

 26%|██▋       | 17300/65536 [3:14:04<9:09:36,  1.46it/s]
 26%|██▋       | 17301/65536 [3:14:04<8:56:04,  1.50it/s]
 26%|██▋       | 17302/65536 [3:14:05<9:28:53,  1.41it/s]
 26%|██▋       | 17303/65536 [3:14:06<9:21:35,  1.43it/s]
 26%|██▋       | 17304/65536 [3:14:06<9:29:53,  1.41it/s]
 26%|██▋       | 17305/65536 [3:14:07<9:23:29,  1.43it/s]
 26%|██▋       | 17306/65536 [3:14:08<9:18:15,  1.44it/s]
 26%|██▋       | 17307/65536 [3:14:08<9:03:18,  1.48it/s]
 26%|██▋       | 17308/65536 [3:14:09<8:56:31,  1.50it/s]
 26%|██▋       | 17309/65536 [3:14:10<8:59:18,  1.49it/s]
 26%|██▋       | 17310/65536 [3:14:10<8:52:45,  1.51it/s]
 26%|██▋       | 17311/65536 [3:14:11<8:39:59,  1.55it/s]
 26%|██▋       | 17312/65536 [3:14:12<8:48:21,  1.52it/s]
 26%|██▋       | 17313/65536 [3:14:12<8:43:46,  1.53it/s]
 26%|██▋       | 17314/65536 [3:14:13<8:48:32,  1.52it/s]
 26%|██▋       | 17315/65536 [3:14:14<8:46:21,  1.53it/s]
 26%|██▋       | 17316/65536 [3:14:14<8:52:06,  1.51it/s]
 26%|██▋       | 17317/65536 [3:14:15<9:00:01,  1.49it/s]
 26%|██▋       | 17318/65536 [3:14:16<9:13:41,  1.45it/s]
 26%|██▋       | 17319/65536 [3:14:16<9:18:48,  1.44it/s]
 26%|██▋       | 17320/65536 [3:14:17<8:57:35,  1.49it/s]
                                                         
{'loss': 0.9232, 'learning_rate': 7.641728909024121e-07, 'epoch': 1069.14}

 26%|██▋       | 17320/65536 [3:14:17<8:57:35,  1.49it/s]
 26%|██▋       | 17321/65536 [3:14:18<8:58:22,  1.49it/s]
 26%|██▋       | 17322/65536 [3:14:18<8:49:33,  1.52it/s]
 26%|██▋       | 17323/65536 [3:14:19<9:02:37,  1.48it/s]
 26%|██▋       | 17324/65536 [3:14:20<9:16:41,  1.44it/s]
 26%|██▋       | 17325/65536 [3:14:20<9:26:04,  1.42it/s]
 26%|██▋       | 17326/65536 [3:14:21<9:11:55,  1.46it/s]
 26%|██▋       | 17327/65536 [3:14:22<8:53:46,  1.51it/s]
 26%|██▋       | 17328/65536 [3:14:22<8:50:01,  1.52it/s]
 26%|██▋       | 17329/65536 [3:14:23<8:57:51,  1.49it/s]
 26%|██▋       | 17330/65536 [3:14:24<8:56:45,  1.50it/s]
 26%|██▋       | 17331/65536 [3:14:24<9:04:28,  1.48it/s]
 26%|██▋       | 17332/65536 [3:14:25<8:50:56,  1.51it/s]
 26%|██▋       | 17333/65536 [3:14:26<8:55:27,  1.50it/s]
 26%|██▋       | 17334/65536 [3:14:26<8:57:04,  1.50it/s]
 26%|██▋       | 17335/65536 [3:14:27<9:17:22,  1.44it/s]
 26%|██▋       | 17336/65536 [3:14:28<9:15:12,  1.45it/s]
 26%|██▋       | 17337/65536 [3:14:29<9:14:49,  1.45it/s]
 26%|██▋       | 17338/65536 [3:14:29<9:08:52,  1.46it/s]
 26%|██▋       | 17339/65536 [3:14:30<9:18:17,  1.44it/s]
 26%|██▋       | 17340/65536 [3:14:31<9:20:06,  1.43it/s]
                                                         
{'loss': 0.8865, 'learning_rate': 7.638973919431859e-07, 'epoch': 1070.37}

 26%|██▋       | 17340/65536 [3:14:31<9:20:06,  1.43it/s]
 26%|██▋       | 17341/65536 [3:14:31<8:54:16,  1.50it/s]
 26%|██▋       | 17342/65536 [3:14:32<9:02:35,  1.48it/s]
 26%|██▋       | 17343/65536 [3:14:33<8:46:03,  1.53it/s]
 26%|██▋       | 17344/65536 [3:14:33<8:45:52,  1.53it/s]
 26%|██▋       | 17345/65536 [3:14:34<8:58:19,  1.49it/s]
 26%|██▋       | 17346/65536 [3:14:35<8:54:35,  1.50it/s]
 26%|██▋       | 17347/65536 [3:14:35<9:05:17,  1.47it/s]
 26%|██▋       | 17348/65536 [3:14:36<8:55:08,  1.50it/s]
 26%|██▋       | 17349/65536 [3:14:37<9:03:08,  1.48it/s]
 26%|██▋       | 17350/65536 [3:14:37<8:56:47,  1.50it/s]
 26%|██▋       | 17351/65536 [3:14:38<9:23:40,  1.42it/s]
 26%|██▋       | 17352/65536 [3:14:39<9:21:36,  1.43it/s]
 26%|██▋       | 17353/65536 [3:14:39<9:05:16,  1.47it/s]
 26%|██▋       | 17354/65536 [3:14:40<8:49:23,  1.52it/s]
 26%|██▋       | 17355/65536 [3:14:41<8:43:35,  1.53it/s]
 26%|██▋       | 17356/65536 [3:14:41<8:55:58,  1.50it/s]
 26%|██▋       | 17357/65536 [3:14:42<8:52:15,  1.51it/s]
 26%|██▋       | 17358/65536 [3:14:43<8:56:15,  1.50it/s]
 26%|██▋       | 17359/65536 [3:14:43<9:00:45,  1.48it/s]
 26%|██▋       | 17360/65536 [3:14:44<8:59:53,  1.49it/s]
                                                         
{'loss': 0.9058, 'learning_rate': 7.636218929839597e-07, 'epoch': 1071.6}

 26%|██▋       | 17360/65536 [3:14:44<8:59:53,  1.49it/s]
 26%|██▋       | 17361/65536 [3:14:45<8:55:20,  1.50it/s]
 26%|██▋       | 17362/65536 [3:14:45<8:55:01,  1.50it/s]
 26%|██▋       | 17363/65536 [3:14:46<8:43:35,  1.53it/s]
 26%|██▋       | 17364/65536 [3:14:47<9:17:53,  1.44it/s]
 26%|██▋       | 17365/65536 [3:14:47<9:14:30,  1.45it/s]
 26%|██▋       | 17366/65536 [3:14:48<9:10:52,  1.46it/s]
 26%|██▋       | 17367/65536 [3:14:49<9:31:59,  1.40it/s]
 27%|██▋       | 17368/65536 [3:14:50<9:23:03,  1.43it/s]
 27%|██▋       | 17369/65536 [3:14:50<9:08:58,  1.46it/s]
 27%|██▋       | 17370/65536 [3:14:51<9:08:57,  1.46it/s]
 27%|██▋       | 17371/65536 [3:14:52<9:18:57,  1.44it/s]
 27%|██▋       | 17372/65536 [3:14:52<9:15:09,  1.45it/s]
 27%|██▋       | 17373/65536 [3:14:53<8:57:17,  1.49it/s]
 27%|██▋       | 17374/65536 [3:14:54<9:09:38,  1.46it/s]
 27%|██▋       | 17375/65536 [3:14:54<9:13:45,  1.45it/s]
 27%|██▋       | 17376/65536 [3:14:55<9:11:45,  1.45it/s]
 27%|██▋       | 17377/65536 [3:14:56<9:01:09,  1.48it/s]
 27%|██▋       | 17378/65536 [3:14:56<8:58:10,  1.49it/s]
 27%|██▋       | 17379/65536 [3:14:57<8:51:00,  1.51it/s]
 27%|██▋       | 17380/65536 [3:14:58<8:39:52,  1.54it/s]
                                                         
{'loss': 0.9125, 'learning_rate': 7.633463940247336e-07, 'epoch': 1072.84}

 27%|██▋       | 17380/65536 [3:14:58<8:39:52,  1.54it/s]
 27%|██▋       | 17381/65536 [3:14:58<8:32:48,  1.57it/s]
 27%|██▋       | 17382/65536 [3:14:59<8:49:50,  1.51it/s]
 27%|██▋       | 17383/65536 [3:15:00<8:59:29,  1.49it/s]
 27%|██▋       | 17384/65536 [3:15:00<8:53:47,  1.50it/s]
 27%|██▋       | 17385/65536 [3:15:01<8:48:00,  1.52it/s]
 27%|██▋       | 17386/65536 [3:15:02<8:41:37,  1.54it/s]
 27%|██▋       | 17387/65536 [3:15:02<8:43:04,  1.53it/s]
 27%|██▋       | 17388/65536 [3:15:03<8:42:15,  1.54it/s]
 27%|██▋       | 17389/65536 [3:15:03<8:47:14,  1.52it/s]
 27%|██▋       | 17390/65536 [3:15:04<9:00:19,  1.49it/s]
 27%|██▋       | 17391/65536 [3:15:05<9:05:12,  1.47it/s]
 27%|██▋       | 17392/65536 [3:15:06<8:53:49,  1.50it/s]
 27%|██▋       | 17393/65536 [3:15:06<9:12:24,  1.45it/s]
 27%|██▋       | 17394/65536 [3:15:07<9:16:48,  1.44it/s]
 27%|██▋       | 17395/65536 [3:15:08<9:00:41,  1.48it/s]
 27%|██▋       | 17396/65536 [3:15:08<8:55:06,  1.50it/s]
 27%|██▋       | 17397/65536 [3:15:09<9:00:32,  1.48it/s]
 27%|██▋       | 17398/65536 [3:15:10<9:06:32,  1.47it/s]
 27%|██▋       | 17399/65536 [3:15:10<9:21:49,  1.43it/s]
 27%|██▋       | 17400/65536 [3:15:11<9:01:45,  1.48it/s]
                                                         
{'loss': 0.9216, 'learning_rate': 7.630708950655074e-07, 'epoch': 1074.07}

 27%|██▋       | 17400/65536 [3:15:11<9:01:45,  1.48it/s]
 27%|██▋       | 17401/65536 [3:15:12<8:58:02,  1.49it/s]
 27%|██▋       | 17402/65536 [3:15:12<9:01:42,  1.48it/s]
 27%|██▋       | 17403/65536 [3:15:13<8:51:17,  1.51it/s]
 27%|██▋       | 17404/65536 [3:15:14<8:51:09,  1.51it/s]
 27%|██▋       | 17405/65536 [3:15:14<9:02:37,  1.48it/s]
 27%|██▋       | 17406/65536 [3:15:15<9:04:41,  1.47it/s]
 27%|██▋       | 17407/65536 [3:15:16<9:01:27,  1.48it/s]
 27%|██▋       | 17408/65536 [3:15:16<8:48:55,  1.52it/s]
 27%|██▋       | 17409/65536 [3:15:17<8:47:21,  1.52it/s]
 27%|██▋       | 17410/65536 [3:15:18<8:44:20,  1.53it/s]
 27%|██▋       | 17411/65536 [3:15:18<8:41:03,  1.54it/s]
 27%|██▋       | 17412/65536 [3:15:19<8:57:54,  1.49it/s]
 27%|██▋       | 17413/65536 [3:15:20<8:54:46,  1.50it/s]
 27%|██▋       | 17414/65536 [3:15:20<9:04:29,  1.47it/s]
 27%|██▋       | 17415/65536 [3:15:21<9:02:00,  1.48it/s]
 27%|██▋       | 17416/65536 [3:15:22<9:15:24,  1.44it/s]
 27%|██▋       | 17417/65536 [3:15:22<9:20:24,  1.43it/s]
 27%|██▋       | 17418/65536 [3:15:23<9:07:29,  1.46it/s]
 27%|██▋       | 17419/65536 [3:15:24<9:26:12,  1.42it/s]
 27%|██▋       | 17420/65536 [3:15:25<9:16:52,  1.44it/s]
                                                         
{'loss': 0.9189, 'learning_rate': 7.627953961062813e-07, 'epoch': 1075.31}

 27%|██▋       | 17420/65536 [3:15:25<9:16:52,  1.44it/s]
 27%|██▋       | 17421/65536 [3:15:25<9:07:01,  1.47it/s]
 27%|██▋       | 17422/65536 [3:15:26<8:57:41,  1.49it/s]
 27%|██▋       | 17423/65536 [3:15:26<8:58:21,  1.49it/s]
 27%|██▋       | 17424/65536 [3:15:27<8:55:27,  1.50it/s]
 27%|██▋       | 17425/65536 [3:15:28<8:48:38,  1.52it/s]
 27%|██▋       | 17426/65536 [3:15:28<8:52:28,  1.51it/s]
 27%|██▋       | 17427/65536 [3:15:29<8:54:35,  1.50it/s]
 27%|██▋       | 17428/65536 [3:15:30<8:49:46,  1.51it/s]
 27%|██▋       | 17429/65536 [3:15:30<8:45:44,  1.53it/s]
 27%|██▋       | 17430/65536 [3:15:31<8:50:16,  1.51it/s]
 27%|██▋       | 17431/65536 [3:15:32<8:45:57,  1.52it/s]
 27%|██▋       | 17432/65536 [3:15:33<9:18:11,  1.44it/s]
 27%|██▋       | 17433/65536 [3:15:33<9:06:30,  1.47it/s]
 27%|██▋       | 17434/65536 [3:15:34<9:17:32,  1.44it/s]
 27%|██▋       | 17435/65536 [3:15:35<9:10:06,  1.46it/s]
 27%|██▋       | 17436/65536 [3:15:35<9:08:45,  1.46it/s]
 27%|██▋       | 17437/65536 [3:15:36<9:03:51,  1.47it/s]
 27%|██▋       | 17438/65536 [3:15:37<8:55:37,  1.50it/s]
 27%|██▋       | 17439/65536 [3:15:37<8:50:28,  1.51it/s]
 27%|██▋       | 17440/65536 [3:15:38<8:46:00,  1.52it/s]
                                                         
{'loss': 0.9064, 'learning_rate': 7.625198971470552e-07, 'epoch': 1076.54}

 27%|██▋       | 17440/65536 [3:15:38<8:46:00,  1.52it/s]
 27%|██▋       | 17441/65536 [3:15:38<8:35:16,  1.56it/s]
 27%|██▋       | 17442/65536 [3:15:39<8:41:34,  1.54it/s]
 27%|██▋       | 17443/65536 [3:15:40<8:41:56,  1.54it/s]
 27%|██▋       | 17444/65536 [3:15:40<8:42:10,  1.53it/s]
 27%|██▋       | 17445/65536 [3:15:41<8:56:05,  1.50it/s]
 27%|██▋       | 17446/65536 [3:15:42<9:06:25,  1.47it/s]
 27%|██▋       | 17447/65536 [3:15:43<9:10:13,  1.46it/s]
 27%|██▋       | 17448/65536 [3:15:43<9:27:12,  1.41it/s]
 27%|██▋       | 17449/65536 [3:15:44<9:24:04,  1.42it/s]
 27%|██▋       | 17450/65536 [3:15:45<9:26:26,  1.41it/s]
 27%|██▋       | 17451/65536 [3:15:45<9:18:48,  1.43it/s]
 27%|██▋       | 17452/65536 [3:15:46<9:31:12,  1.40it/s]
 27%|██▋       | 17453/65536 [3:15:47<9:07:56,  1.46it/s]
 27%|██▋       | 17454/65536 [3:15:47<9:01:56,  1.48it/s]
 27%|██▋       | 17455/65536 [3:15:48<8:48:18,  1.52it/s]
 27%|██▋       | 17456/65536 [3:15:49<8:49:08,  1.51it/s]
 27%|██▋       | 17457/65536 [3:15:49<8:44:49,  1.53it/s]
 27%|██▋       | 17458/65536 [3:15:50<8:38:38,  1.54it/s]
 27%|██▋       | 17459/65536 [3:15:51<8:35:13,  1.56it/s]
 27%|██▋       | 17460/65536 [3:15:51<8:32:34,  1.56it/s]
                                                         
{'loss': 0.9239, 'learning_rate': 7.62244398187829e-07, 'epoch': 1077.78}

 27%|██▋       | 17460/65536 [3:15:51<8:32:34,  1.56it/s]
 27%|██▋       | 17461/65536 [3:15:52<8:32:22,  1.56it/s]
 27%|██▋       | 17462/65536 [3:15:53<8:45:07,  1.53it/s]
 27%|██▋       | 17463/65536 [3:15:53<8:56:26,  1.49it/s]
 27%|██▋       | 17464/65536 [3:15:54<9:18:23,  1.43it/s]
 27%|██▋       | 17465/65536 [3:15:55<9:03:35,  1.47it/s]
 27%|██▋       | 17466/65536 [3:15:55<9:02:17,  1.48it/s]
 27%|██▋       | 17467/65536 [3:15:56<9:02:29,  1.48it/s]
 27%|██▋       | 17468/65536 [3:15:57<8:56:44,  1.49it/s]
 27%|██▋       | 17469/65536 [3:15:57<9:03:37,  1.47it/s]
 27%|██▋       | 17470/65536 [3:15:58<9:04:07,  1.47it/s]
 27%|██▋       | 17471/65536 [3:15:59<8:53:57,  1.50it/s]
 27%|██▋       | 17472/65536 [3:15:59<8:57:35,  1.49it/s]
 27%|██▋       | 17473/65536 [3:16:00<9:09:33,  1.46it/s]
 27%|██▋       | 17474/65536 [3:16:01<9:05:17,  1.47it/s]
 27%|██▋       | 17475/65536 [3:16:01<9:02:11,  1.48it/s]
 27%|██▋       | 17476/65536 [3:16:02<8:58:50,  1.49it/s]
 27%|██▋       | 17477/65536 [3:16:03<8:58:25,  1.49it/s]
 27%|██▋       | 17478/65536 [3:16:03<9:00:40,  1.48it/s]
 27%|██▋       | 17479/65536 [3:16:04<8:54:27,  1.50it/s]
 27%|██▋       | 17480/65536 [3:16:05<9:07:25,  1.46it/s]
                                                         
{'loss': 0.9157, 'learning_rate': 7.619688992286029e-07, 'epoch': 1079.01}

 27%|██▋       | 17480/65536 [3:16:05<9:07:25,  1.46it/s]
 27%|██▋       | 17481/65536 [3:16:06<9:09:12,  1.46it/s]
 27%|██▋       | 17482/65536 [3:16:06<8:58:20,  1.49it/s]
 27%|██▋       | 17483/65536 [3:16:07<8:43:27,  1.53it/s]
 27%|██▋       | 17484/65536 [3:16:07<8:41:01,  1.54it/s]
 27%|██▋       | 17485/65536 [3:16:08<8:43:34,  1.53it/s]
 27%|██▋       | 17486/65536 [3:16:09<8:34:24,  1.56it/s]
 27%|██▋       | 17487/65536 [3:16:09<8:48:02,  1.52it/s]
 27%|██▋       | 17488/65536 [3:16:10<8:56:22,  1.49it/s]
 27%|██▋       | 17489/65536 [3:16:11<8:49:51,  1.51it/s]
 27%|██▋       | 17490/65536 [3:16:11<8:45:58,  1.52it/s]
 27%|██▋       | 17491/65536 [3:16:12<8:40:45,  1.54it/s]
 27%|██▋       | 17492/65536 [3:16:13<8:52:06,  1.50it/s]
 27%|██▋       | 17493/65536 [3:16:13<8:46:55,  1.52it/s]
 27%|██▋       | 17494/65536 [3:16:14<8:45:34,  1.52it/s]
 27%|██▋       | 17495/65536 [3:16:15<9:16:19,  1.44it/s]
 27%|██▋       | 17496/65536 [3:16:15<9:01:06,  1.48it/s]
 27%|██▋       | 17497/65536 [3:16:16<9:23:46,  1.42it/s]
 27%|██▋       | 17498/65536 [3:16:17<9:13:50,  1.45it/s]
 27%|██▋       | 17499/65536 [3:16:18<9:14:35,  1.44it/s]
 27%|██▋       | 17500/65536 [3:16:18<9:20:54,  1.43it/s]
                                                         
{'loss': 0.9249, 'learning_rate': 7.616934002693767e-07, 'epoch': 1080.25}

 27%|██▋       | 17500/65536 [3:16:18<9:20:54,  1.43it/s]
 27%|██▋       | 17501/65536 [3:16:19<9:22:02,  1.42it/s]
 27%|██▋       | 17502/65536 [3:16:20<9:13:52,  1.45it/s]
 27%|██▋       | 17503/65536 [3:16:20<9:01:47,  1.48it/s]
 27%|██▋       | 17504/65536 [3:16:21<8:58:24,  1.49it/s]
 27%|██▋       | 17505/65536 [3:16:22<9:01:29,  1.48it/s]
 27%|██▋       | 17506/65536 [3:16:22<8:47:36,  1.52it/s]
 27%|██▋       | 17507/65536 [3:16:23<8:41:49,  1.53it/s]
 27%|██▋       | 17508/65536 [3:16:24<8:38:50,  1.54it/s]
 27%|██▋       | 17509/65536 [3:16:24<8:39:33,  1.54it/s]
 27%|██▋       | 17510/65536 [3:16:25<8:41:31,  1.53it/s]
 27%|██▋       | 17511/65536 [3:16:26<8:50:29,  1.51it/s]
 27%|██▋       | 17512/65536 [3:16:26<9:01:27,  1.48it/s]
 27%|██▋       | 17513/65536 [3:16:27<9:17:43,  1.44it/s]
 27%|██▋       | 17514/65536 [3:16:28<9:03:17,  1.47it/s]
 27%|██▋       | 17515/65536 [3:16:28<9:03:53,  1.47it/s]
 27%|██▋       | 17516/65536 [3:16:29<8:44:17,  1.53it/s]
 27%|██▋       | 17517/65536 [3:16:30<9:08:15,  1.46it/s]
 27%|██▋       | 17518/65536 [3:16:30<9:02:06,  1.48it/s]
 27%|██▋       | 17519/65536 [3:16:31<8:59:46,  1.48it/s]
 27%|██▋       | 17520/65536 [3:16:32<8:57:34,  1.49it/s]
                                                         
{'loss': 0.9266, 'learning_rate': 7.614179013101506e-07, 'epoch': 1081.48}

 27%|██▋       | 17520/65536 [3:16:32<8:57:34,  1.49it/s]
 27%|██▋       | 17521/65536 [3:16:32<8:56:08,  1.49it/s]
 27%|██▋       | 17522/65536 [3:16:33<8:55:04,  1.50it/s]
 27%|██▋       | 17523/65536 [3:16:34<8:52:24,  1.50it/s]
 27%|██▋       | 17524/65536 [3:16:34<9:05:41,  1.47it/s]
 27%|██▋       | 17525/65536 [3:16:35<8:51:48,  1.50it/s]
 27%|██▋       | 17526/65536 [3:16:36<8:51:32,  1.51it/s]
 27%|██▋       | 17527/65536 [3:16:36<9:04:43,  1.47it/s]
 27%|██▋       | 17528/65536 [3:16:37<9:08:30,  1.46it/s]
 27%|██▋       | 17529/65536 [3:16:38<9:20:11,  1.43it/s]
 27%|██▋       | 17530/65536 [3:16:38<9:12:30,  1.45it/s]
 27%|██▋       | 17531/65536 [3:16:39<9:08:38,  1.46it/s]
 27%|██▋       | 17532/65536 [3:16:40<9:28:46,  1.41it/s]
 27%|██▋       | 17533/65536 [3:16:41<9:18:07,  1.43it/s]
 27%|██▋       | 17534/65536 [3:16:41<9:07:01,  1.46it/s]
 27%|██▋       | 17535/65536 [3:16:42<8:50:16,  1.51it/s]
 27%|██▋       | 17536/65536 [3:16:42<8:47:30,  1.52it/s]
 27%|██▋       | 17537/65536 [3:16:43<8:48:56,  1.51it/s]
 27%|██▋       | 17538/65536 [3:16:44<8:55:24,  1.49it/s]
 27%|██▋       | 17539/65536 [3:16:45<8:56:08,  1.49it/s]
 27%|██▋       | 17540/65536 [3:16:45<8:57:11,  1.49it/s]
                                                         
{'loss': 0.9043, 'learning_rate': 7.611424023509245e-07, 'epoch': 1082.72}

 27%|██▋       | 17540/65536 [3:16:45<8:57:11,  1.49it/s]
 27%|██▋       | 17541/65536 [3:16:46<8:51:26,  1.51it/s]
 27%|██▋       | 17542/65536 [3:16:46<8:45:39,  1.52it/s]
 27%|██▋       | 17543/65536 [3:16:47<9:00:34,  1.48it/s]
 27%|██▋       | 17544/65536 [3:16:48<8:48:35,  1.51it/s]
 27%|██▋       | 17545/65536 [3:16:49<9:05:39,  1.47it/s]
 27%|██▋       | 17546/65536 [3:16:49<8:57:28,  1.49it/s]
 27%|██▋       | 17547/65536 [3:16:50<8:45:09,  1.52it/s]
 27%|██▋       | 17548/65536 [3:16:51<8:55:03,  1.49it/s]
 27%|██▋       | 17549/65536 [3:16:51<8:42:47,  1.53it/s]
 27%|██▋       | 17550/65536 [3:16:52<8:57:56,  1.49it/s]
 27%|██▋       | 17551/65536 [3:16:52<8:53:28,  1.50it/s]
 27%|██▋       | 17552/65536 [3:16:53<9:05:17,  1.47it/s]
 27%|██▋       | 17553/65536 [3:16:54<8:56:05,  1.49it/s]
 27%|██▋       | 17554/65536 [3:16:55<8:52:13,  1.50it/s]
 27%|██▋       | 17555/65536 [3:16:55<9:04:54,  1.47it/s]
 27%|██▋       | 17556/65536 [3:16:56<8:59:26,  1.48it/s]
 27%|██▋       | 17557/65536 [3:16:57<8:51:03,  1.51it/s]
 27%|██▋       | 17558/65536 [3:16:57<8:56:46,  1.49it/s]
 27%|██▋       | 17559/65536 [3:16:58<8:53:18,  1.50it/s]
 27%|██▋       | 17560/65536 [3:16:59<8:57:03,  1.49it/s]
                                                         
{'loss': 0.9212, 'learning_rate': 7.608669033916982e-07, 'epoch': 1083.95}

 27%|██▋       | 17560/65536 [3:16:59<8:57:03,  1.49it/s]
 27%|██▋       | 17561/65536 [3:16:59<9:16:09,  1.44it/s]
 27%|██▋       | 17562/65536 [3:17:00<9:13:31,  1.44it/s]
 27%|██▋       | 17563/65536 [3:17:01<9:19:17,  1.43it/s]
 27%|██▋       | 17564/65536 [3:17:01<9:29:33,  1.40it/s]
 27%|██▋       | 17565/65536 [3:17:02<9:05:31,  1.47it/s]
 27%|██▋       | 17566/65536 [3:17:03<8:54:37,  1.50it/s]
 27%|██▋       | 17567/65536 [3:17:03<8:49:34,  1.51it/s]
 27%|██▋       | 17568/65536 [3:17:04<8:58:26,  1.48it/s]
 27%|██▋       | 17569/65536 [3:17:05<8:58:32,  1.48it/s]
 27%|██▋       | 17570/65536 [3:17:05<9:04:29,  1.47it/s]
 27%|██▋       | 17571/65536 [3:17:06<8:56:26,  1.49it/s]
 27%|██▋       | 17572/65536 [3:17:07<9:07:50,  1.46it/s]
 27%|██▋       | 17573/65536 [3:17:07<9:03:03,  1.47it/s]
 27%|██▋       | 17574/65536 [3:17:08<8:49:18,  1.51it/s]
 27%|██▋       | 17575/65536 [3:17:09<8:34:41,  1.55it/s]
 27%|██▋       | 17576/65536 [3:17:09<8:33:29,  1.56it/s]
 27%|██▋       | 17577/65536 [3:17:10<8:42:23,  1.53it/s]
 27%|██▋       | 17578/65536 [3:17:11<9:15:11,  1.44it/s]
 27%|██▋       | 17579/65536 [3:17:11<9:18:09,  1.43it/s]
 27%|██▋       | 17580/65536 [3:17:12<9:22:32,  1.42it/s]
                                                         
{'loss': 0.9222, 'learning_rate': 7.605914044324721e-07, 'epoch': 1085.19}

 27%|██▋       | 17580/65536 [3:17:12<9:22:32,  1.42it/s]
 27%|██▋       | 17581/65536 [3:17:13<9:11:38,  1.45it/s]
 27%|██▋       | 17582/65536 [3:17:14<9:07:19,  1.46it/s]
 27%|██▋       | 17583/65536 [3:17:14<9:10:27,  1.45it/s]
 27%|██▋       | 17584/65536 [3:17:15<9:08:04,  1.46it/s]
 27%|██▋       | 17585/65536 [3:17:16<9:09:16,  1.45it/s]
 27%|██▋       | 17586/65536 [3:17:16<9:12:10,  1.45it/s]
 27%|██▋       | 17587/65536 [3:17:17<9:07:54,  1.46it/s]
 27%|██▋       | 17588/65536 [3:17:18<9:11:54,  1.45it/s]
 27%|██▋       | 17589/65536 [3:17:18<9:02:41,  1.47it/s]
 27%|██▋       | 17590/65536 [3:17:19<8:55:31,  1.49it/s]
 27%|██▋       | 17591/65536 [3:17:20<8:53:28,  1.50it/s]
 27%|██▋       | 17592/65536 [3:17:20<8:46:48,  1.52it/s]
 27%|██▋       | 17593/65536 [3:17:21<8:43:08,  1.53it/s]
 27%|██▋       | 17594/65536 [3:17:22<9:11:10,  1.45it/s]
 27%|██▋       | 17595/65536 [3:17:22<9:03:41,  1.47it/s]
 27%|██▋       | 17596/65536 [3:17:23<9:02:22,  1.47it/s]
 27%|██▋       | 17597/65536 [3:17:24<9:03:44,  1.47it/s]
 27%|██▋       | 17598/65536 [3:17:24<9:16:18,  1.44it/s]
 27%|██▋       | 17599/65536 [3:17:25<9:15:33,  1.44it/s]
 27%|██▋       | 17600/65536 [3:17:26<9:13:52,  1.44it/s]
                                                         
{'loss': 0.8999, 'learning_rate': 7.603159054732459e-07, 'epoch': 1086.42}

 27%|██▋       | 17600/65536 [3:17:26<9:13:52,  1.44it/s]
 27%|██▋       | 17601/65536 [3:17:27<9:10:42,  1.45it/s]
 27%|██▋       | 17602/65536 [3:17:27<8:58:06,  1.48it/s]
 27%|██▋       | 17603/65536 [3:17:28<9:04:28,  1.47it/s]
 27%|██▋       | 17604/65536 [3:17:28<8:48:57,  1.51it/s]
 27%|██▋       | 17605/65536 [3:17:29<8:33:38,  1.56it/s]
 27%|██▋       | 17606/65536 [3:17:30<8:18:35,  1.60it/s]
 27%|██▋       | 17607/65536 [3:17:30<8:13:42,  1.62it/s]
 27%|██▋       | 17608/65536 [3:17:31<8:17:05,  1.61it/s]
 27%|██▋       | 17609/65536 [3:17:32<8:32:52,  1.56it/s]
 27%|██▋       | 17610/65536 [3:17:32<8:46:30,  1.52it/s]
 27%|██▋       | 17611/65536 [3:17:33<8:43:08,  1.53it/s]
 27%|██▋       | 17612/65536 [3:17:34<8:47:41,  1.51it/s]
 27%|██▋       | 17613/65536 [3:17:34<8:43:36,  1.53it/s]
 27%|██▋       | 17614/65536 [3:17:35<8:49:14,  1.51it/s]
 27%|██▋       | 17615/65536 [3:17:36<8:41:59,  1.53it/s]
 27%|██▋       | 17616/65536 [3:17:36<8:44:20,  1.52it/s]
 27%|██▋       | 17617/65536 [3:17:37<8:44:16,  1.52it/s]
 27%|██▋       | 17618/65536 [3:17:38<8:44:48,  1.52it/s]
 27%|██▋       | 17619/65536 [3:17:38<8:42:27,  1.53it/s]
 27%|██▋       | 17620/65536 [3:17:39<8:51:56,  1.50it/s]
                                                         
{'loss': 0.9395, 'learning_rate': 7.600404065140197e-07, 'epoch': 1087.65}

 27%|██▋       | 17620/65536 [3:17:39<8:51:56,  1.50it/s]
 27%|██▋       | 17621/65536 [3:17:40<8:56:24,  1.49it/s]
 27%|██▋       | 17622/65536 [3:17:40<9:07:23,  1.46it/s]
 27%|██▋       | 17623/65536 [3:17:41<8:57:26,  1.49it/s]
 27%|██▋       | 17624/65536 [3:17:42<9:04:04,  1.47it/s]
 27%|██▋       | 17625/65536 [3:17:42<8:45:22,  1.52it/s]
 27%|██▋       | 17626/65536 [3:17:43<9:05:42,  1.46it/s]
 27%|██▋       | 17627/65536 [3:17:44<9:06:59,  1.46it/s]
 27%|██▋       | 17628/65536 [3:17:44<8:53:12,  1.50it/s]
 27%|██▋       | 17629/65536 [3:17:45<9:04:29,  1.47it/s]
 27%|██▋       | 17630/65536 [3:17:46<9:12:24,  1.45it/s]
 27%|██▋       | 17631/65536 [3:17:46<9:18:59,  1.43it/s]
 27%|██▋       | 17632/65536 [3:17:47<9:14:19,  1.44it/s]
 27%|██▋       | 17633/65536 [3:17:48<8:59:55,  1.48it/s]
 27%|██▋       | 17634/65536 [3:17:48<8:45:25,  1.52it/s]
 27%|██▋       | 17635/65536 [3:17:49<8:46:10,  1.52it/s]
 27%|██▋       | 17636/65536 [3:17:50<8:38:56,  1.54it/s]
 27%|██▋       | 17637/65536 [3:17:50<8:29:00,  1.57it/s]
 27%|██▋       | 17638/65536 [3:17:51<8:31:48,  1.56it/s]
 27%|██▋       | 17639/65536 [3:17:52<8:32:18,  1.56it/s]
 27%|██▋       | 17640/65536 [3:17:52<8:52:32,  1.50it/s]
                                                         
{'loss': 0.9241, 'learning_rate': 7.597649075547935e-07, 'epoch': 1088.89}

 27%|██▋       | 17640/65536 [3:17:52<8:52:32,  1.50it/s]
 27%|██▋       | 17641/65536 [3:17:53<8:59:20,  1.48it/s]
 27%|██▋       | 17642/65536 [3:17:54<9:19:36,  1.43it/s]
 27%|██▋       | 17643/65536 [3:17:54<9:07:26,  1.46it/s]
 27%|██▋       | 17644/65536 [3:17:55<9:12:17,  1.45it/s]
 27%|██▋       | 17645/65536 [3:17:56<9:14:42,  1.44it/s]
 27%|██▋       | 17646/65536 [3:17:56<9:04:29,  1.47it/s]
 27%|██▋       | 17647/65536 [3:17:57<9:10:54,  1.45it/s]
 27%|██▋       | 17648/65536 [3:17:58<8:50:40,  1.50it/s]
 27%|██▋       | 17649/65536 [3:17:58<8:54:33,  1.49it/s]
 27%|██▋       | 17650/65536 [3:17:59<8:50:42,  1.50it/s]
 27%|██▋       | 17651/65536 [3:18:00<8:54:44,  1.49it/s]
 27%|██▋       | 17652/65536 [3:18:00<8:53:32,  1.50it/s]
 27%|██▋       | 17653/65536 [3:18:01<8:57:48,  1.48it/s]
 27%|██▋       | 17654/65536 [3:18:02<8:53:14,  1.50it/s]
 27%|██▋       | 17655/65536 [3:18:02<8:43:17,  1.53it/s]
 27%|██▋       | 17656/65536 [3:18:03<8:41:08,  1.53it/s]
 27%|██▋       | 17657/65536 [3:18:04<8:44:24,  1.52it/s]
 27%|██▋       | 17658/65536 [3:18:04<8:48:57,  1.51it/s]
 27%|██▋       | 17659/65536 [3:18:05<9:06:03,  1.46it/s]
 27%|██▋       | 17660/65536 [3:18:06<8:56:05,  1.49it/s]
                                                         
{'loss': 0.9279, 'learning_rate': 7.594894085955674e-07, 'epoch': 1090.12}

 27%|██▋       | 17660/65536 [3:18:06<8:56:05,  1.49it/s]
 27%|██▋       | 17661/65536 [3:18:06<8:58:42,  1.48it/s]
 27%|██▋       | 17662/65536 [3:18:07<9:21:35,  1.42it/s]
 27%|██▋       | 17663/65536 [3:18:08<9:05:06,  1.46it/s]
 27%|██▋       | 17664/65536 [3:18:09<9:00:23,  1.48it/s]
 27%|██▋       | 17665/65536 [3:18:09<9:11:26,  1.45it/s]
 27%|██▋       | 17666/65536 [3:18:10<9:05:52,  1.46it/s]
 27%|██▋       | 17667/65536 [3:18:11<8:44:46,  1.52it/s]
 27%|██▋       | 17668/65536 [3:18:11<8:35:36,  1.55it/s]
 27%|██▋       | 17669/65536 [3:18:12<8:37:08,  1.54it/s]
 27%|██▋       | 17670/65536 [3:18:12<8:54:15,  1.49it/s]
 27%|██▋       | 17671/65536 [3:18:13<8:53:16,  1.50it/s]
 27%|██▋       | 17672/65536 [3:18:14<8:47:09,  1.51it/s]
 27%|██▋       | 17673/65536 [3:18:14<8:51:05,  1.50it/s]
 27%|██▋       | 17674/65536 [3:18:15<8:48:11,  1.51it/s]
 27%|██▋       | 17675/65536 [3:18:16<9:04:11,  1.47it/s]
 27%|██▋       | 17676/65536 [3:18:17<9:12:18,  1.44it/s]
 27%|██▋       | 17677/65536 [3:18:17<8:47:29,  1.51it/s]
 27%|██▋       | 17678/65536 [3:18:18<9:02:07,  1.47it/s]
 27%|██▋       | 17679/65536 [3:18:19<9:10:30,  1.45it/s]
 27%|██▋       | 17680/65536 [3:18:19<9:00:26,  1.48it/s]
                                                         
{'loss': 0.9137, 'learning_rate': 7.592139096363414e-07, 'epoch': 1091.36}

 27%|██▋       | 17680/65536 [3:18:19<9:00:26,  1.48it/s]
 27%|██▋       | 17681/65536 [3:18:20<8:58:27,  1.48it/s]
 27%|██▋       | 17682/65536 [3:18:21<9:08:37,  1.45it/s]
 27%|██▋       | 17683/65536 [3:18:21<9:12:14,  1.44it/s]
 27%|██▋       | 17684/65536 [3:18:22<9:11:32,  1.45it/s]
 27%|██▋       | 17685/65536 [3:18:23<8:54:09,  1.49it/s]
 27%|██▋       | 17686/65536 [3:18:23<8:44:22,  1.52it/s]
 27%|██▋       | 17687/65536 [3:18:24<8:45:37,  1.52it/s]
 27%|██▋       | 17688/65536 [3:18:25<8:47:10,  1.51it/s]
 27%|██▋       | 17689/65536 [3:18:25<8:57:11,  1.48it/s]
 27%|██▋       | 17690/65536 [3:18:26<8:53:54,  1.49it/s]
 27%|██▋       | 17691/65536 [3:18:27<9:18:34,  1.43it/s]
 27%|██▋       | 17692/65536 [3:18:27<9:00:26,  1.48it/s]
 27%|██▋       | 17693/65536 [3:18:28<9:06:17,  1.46it/s]
 27%|██▋       | 17694/65536 [3:18:29<8:59:08,  1.48it/s]
 27%|██▋       | 17695/65536 [3:18:29<8:46:51,  1.51it/s]
 27%|██▋       | 17696/65536 [3:18:30<8:56:20,  1.49it/s]
 27%|██▋       | 17697/65536 [3:18:31<8:55:17,  1.49it/s]
 27%|██▋       | 17698/65536 [3:18:31<8:42:51,  1.52it/s]
 27%|██▋       | 17699/65536 [3:18:32<8:44:40,  1.52it/s]
 27%|██▋       | 17700/65536 [3:18:33<8:52:34,  1.50it/s]
                                                         
{'loss': 0.9119, 'learning_rate': 7.589384106771152e-07, 'epoch': 1092.59}

 27%|██▋       | 17700/65536 [3:18:33<8:52:34,  1.50it/s]
 27%|██▋       | 17701/65536 [3:18:33<8:42:33,  1.53it/s]
 27%|██▋       | 17702/65536 [3:18:34<8:35:13,  1.55it/s]
 27%|██▋       | 17703/65536 [3:18:35<8:51:59,  1.50it/s]
 27%|██▋       | 17704/65536 [3:18:35<8:53:18,  1.49it/s]
 27%|██▋       | 17705/65536 [3:18:36<8:48:07,  1.51it/s]
 27%|██▋       | 17706/65536 [3:18:37<8:57:21,  1.48it/s]
 27%|██▋       | 17707/65536 [3:18:37<9:13:53,  1.44it/s]
 27%|██▋       | 17708/65536 [3:18:38<9:03:23,  1.47it/s]
 27%|██▋       | 17709/65536 [3:18:39<8:50:25,  1.50it/s]
 27%|██▋       | 17710/65536 [3:18:39<8:44:21,  1.52it/s]
 27%|██▋       | 17711/65536 [3:18:40<8:37:08,  1.54it/s]
 27%|██▋       | 17712/65536 [3:18:41<8:47:12,  1.51it/s]
 27%|██▋       | 17713/65536 [3:18:41<8:45:30,  1.52it/s]
 27%|██▋       | 17714/65536 [3:18:42<8:51:35,  1.50it/s]
 27%|██▋       | 17715/65536 [3:18:43<8:42:55,  1.52it/s]
 27%|██▋       | 17716/65536 [3:18:43<8:46:27,  1.51it/s]
 27%|██▋       | 17717/65536 [3:18:44<8:45:50,  1.52it/s]
 27%|██▋       | 17718/65536 [3:18:45<8:44:28,  1.52it/s]
 27%|██▋       | 17719/65536 [3:18:45<8:42:12,  1.53it/s]
 27%|██▋       | 17720/65536 [3:18:46<8:42:09,  1.53it/s]
                                                         
{'loss': 0.9403, 'learning_rate': 7.586629117178891e-07, 'epoch': 1093.83}

 27%|██▋       | 17720/65536 [3:18:46<8:42:09,  1.53it/s]
 27%|██▋       | 17721/65536 [3:18:47<9:02:27,  1.47it/s]
 27%|██▋       | 17722/65536 [3:18:47<8:59:22,  1.48it/s]
 27%|██▋       | 17723/65536 [3:18:48<9:23:05,  1.42it/s]
 27%|██▋       | 17724/65536 [3:18:49<9:07:19,  1.46it/s]
 27%|██▋       | 17725/65536 [3:18:49<9:05:20,  1.46it/s]
 27%|██▋       | 17726/65536 [3:18:50<8:52:08,  1.50it/s]
 27%|██▋       | 17727/65536 [3:18:51<9:00:43,  1.47it/s]
 27%|██▋       | 17728/65536 [3:18:51<8:58:09,  1.48it/s]
 27%|██▋       | 17729/65536 [3:18:52<9:01:00,  1.47it/s]
 27%|██▋       | 17730/65536 [3:18:53<8:48:00,  1.51it/s]
 27%|██▋       | 17731/65536 [3:18:53<8:41:01,  1.53it/s]
 27%|██▋       | 17732/65536 [3:18:54<9:03:54,  1.46it/s]
 27%|██▋       | 17733/65536 [3:18:55<8:52:34,  1.50it/s]
 27%|██▋       | 17734/65536 [3:18:55<8:55:59,  1.49it/s]
 27%|██▋       | 17735/65536 [3:18:56<9:00:37,  1.47it/s]
 27%|██▋       | 17736/65536 [3:18:57<8:52:58,  1.49it/s]
 27%|██▋       | 17737/65536 [3:18:57<8:50:31,  1.50it/s]
 27%|██▋       | 17738/65536 [3:18:58<8:49:11,  1.51it/s]
 27%|██▋       | 17739/65536 [3:18:59<8:58:03,  1.48it/s]
 27%|██▋       | 17740/65536 [3:19:00<9:16:28,  1.43it/s]
                                                         
{'loss': 0.9161, 'learning_rate': 7.583874127586629e-07, 'epoch': 1095.06}

 27%|██▋       | 17740/65536 [3:19:00<9:16:28,  1.43it/s]
 27%|██▋       | 17741/65536 [3:19:00<9:03:53,  1.46it/s]
 27%|██▋       | 17742/65536 [3:19:01<8:54:22,  1.49it/s]
 27%|██▋       | 17743/65536 [3:19:01<8:49:02,  1.51it/s]
 27%|██▋       | 17744/65536 [3:19:02<8:45:50,  1.51it/s]
 27%|██▋       | 17745/65536 [3:19:03<8:39:30,  1.53it/s]
 27%|██▋       | 17746/65536 [3:19:03<8:53:28,  1.49it/s]
 27%|██▋       | 17747/65536 [3:19:04<8:44:03,  1.52it/s]
 27%|██▋       | 17748/65536 [3:19:05<8:43:07,  1.52it/s]
 27%|██▋       | 17749/65536 [3:19:05<8:51:42,  1.50it/s]
 27%|██▋       | 17750/65536 [3:19:06<9:04:57,  1.46it/s]
 27%|██▋       | 17751/65536 [3:19:07<9:13:56,  1.44it/s]
 27%|██▋       | 17752/65536 [3:19:08<9:25:58,  1.41it/s]
 27%|██▋       | 17753/65536 [3:19:08<9:13:02,  1.44it/s]
 27%|██▋       | 17754/65536 [3:19:09<8:59:09,  1.48it/s]
 27%|██▋       | 17755/65536 [3:19:10<8:50:05,  1.50it/s]
 27%|██▋       | 17756/65536 [3:19:10<9:13:53,  1.44it/s]
 27%|██▋       | 17757/65536 [3:19:11<9:04:06,  1.46it/s]
 27%|██▋       | 17758/65536 [3:19:12<8:47:28,  1.51it/s]
 27%|██▋       | 17759/65536 [3:19:12<8:41:08,  1.53it/s]
 27%|██▋       | 17760/65536 [3:19:13<8:57:29,  1.48it/s]
                                                         
{'loss': 0.9086, 'learning_rate': 7.581119137994368e-07, 'epoch': 1096.3}

 27%|██▋       | 17760/65536 [3:19:13<8:57:29,  1.48it/s]
 27%|██▋       | 17761/65536 [3:19:14<8:55:17,  1.49it/s]
 27%|██▋       | 17762/65536 [3:19:14<9:06:37,  1.46it/s]
 27%|██▋       | 17763/65536 [3:19:15<9:08:03,  1.45it/s]
 27%|██▋       | 17764/65536 [3:19:16<9:04:56,  1.46it/s]
 27%|██▋       | 17765/65536 [3:19:16<9:01:08,  1.47it/s]
 27%|██▋       | 17766/65536 [3:19:17<8:51:16,  1.50it/s]
 27%|██▋       | 17767/65536 [3:19:18<8:42:43,  1.52it/s]
 27%|██▋       | 17768/65536 [3:19:18<8:48:26,  1.51it/s]
 27%|██▋       | 17769/65536 [3:19:19<8:44:57,  1.52it/s]
 27%|██▋       | 17770/65536 [3:19:20<8:53:12,  1.49it/s]
 27%|██▋       | 17771/65536 [3:19:20<8:53:50,  1.49it/s]
 27%|██▋       | 17772/65536 [3:19:21<9:16:21,  1.43it/s]
 27%|██▋       | 17773/65536 [3:19:22<9:23:28,  1.41it/s]
 27%|██▋       | 17774/65536 [3:19:22<9:01:34,  1.47it/s]
 27%|██▋       | 17775/65536 [3:19:23<8:47:13,  1.51it/s]
 27%|██▋       | 17776/65536 [3:19:24<8:47:48,  1.51it/s]
 27%|██▋       | 17777/65536 [3:19:24<8:44:14,  1.52it/s]
 27%|██▋       | 17778/65536 [3:19:25<8:50:28,  1.50it/s]
 27%|██▋       | 17779/65536 [3:19:26<8:45:04,  1.52it/s]
 27%|██▋       | 17780/65536 [3:19:26<8:51:51,  1.50it/s]
                                                         
{'loss': 0.9083, 'learning_rate': 7.578364148402107e-07, 'epoch': 1097.53}

 27%|██▋       | 17780/65536 [3:19:26<8:51:51,  1.50it/s]
 27%|██▋       | 17781/65536 [3:19:27<9:16:27,  1.43it/s]
 27%|██▋       | 17782/65536 [3:19:28<8:57:12,  1.48it/s]
 27%|██▋       | 17783/65536 [3:19:28<8:46:48,  1.51it/s]
 27%|██▋       | 17784/65536 [3:19:29<8:52:17,  1.50it/s]
 27%|██▋       | 17785/65536 [3:19:30<8:48:28,  1.51it/s]
 27%|██▋       | 17786/65536 [3:19:30<8:49:48,  1.50it/s]
 27%|██▋       | 17787/65536 [3:19:31<8:57:08,  1.48it/s]
 27%|██▋       | 17788/65536 [3:19:32<9:16:51,  1.43it/s]
 27%|██▋       | 17789/65536 [3:19:33<9:07:24,  1.45it/s]
 27%|██▋       | 17790/65536 [3:19:33<9:05:04,  1.46it/s]
 27%|██▋       | 17791/65536 [3:19:34<8:54:24,  1.49it/s]
 27%|██▋       | 17792/65536 [3:19:35<9:17:24,  1.43it/s]
 27%|██▋       | 17793/65536 [3:19:35<9:10:36,  1.45it/s]
 27%|██▋       | 17794/65536 [3:19:36<9:04:17,  1.46it/s]
 27%|██▋       | 17795/65536 [3:19:37<9:08:46,  1.45it/s]
 27%|██▋       | 17796/65536 [3:19:37<8:58:36,  1.48it/s]
 27%|██▋       | 17797/65536 [3:19:38<8:47:05,  1.51it/s]
 27%|██▋       | 17798/65536 [3:19:39<8:51:28,  1.50it/s]
 27%|██▋       | 17799/65536 [3:19:39<8:50:56,  1.50it/s]
 27%|██▋       | 17800/65536 [3:19:40<8:48:21,  1.51it/s]
                                                         
{'loss': 0.9039, 'learning_rate': 7.575609158809845e-07, 'epoch': 1098.77}

 27%|██▋       | 17800/65536 [3:19:40<8:48:21,  1.51it/s]
 27%|██▋       | 17801/65536 [3:19:41<8:45:12,  1.51it/s]
 27%|██▋       | 17802/65536 [3:19:41<9:01:54,  1.47it/s]
 27%|██▋       | 17803/65536 [3:19:42<8:53:54,  1.49it/s]
 27%|██▋       | 17804/65536 [3:19:43<9:06:25,  1.46it/s]
 27%|██▋       | 17805/65536 [3:19:43<8:56:24,  1.48it/s]
 27%|██▋       | 17806/65536 [3:19:44<8:54:01,  1.49it/s]
 27%|██▋       | 17807/65536 [3:19:45<8:40:21,  1.53it/s]
 27%|██▋       | 17808/65536 [3:19:45<8:57:50,  1.48it/s]
 27%|██▋       | 17809/65536 [3:19:46<8:56:18,  1.48it/s]
 27%|██▋       | 17810/65536 [3:19:47<8:50:21,  1.50it/s]
 27%|██▋       | 17811/65536 [3:19:47<8:50:02,  1.50it/s]
 27%|██▋       | 17812/65536 [3:19:48<8:47:51,  1.51it/s]
 27%|██▋       | 17813/65536 [3:19:49<8:44:13,  1.52it/s]
 27%|██▋       | 17814/65536 [3:19:49<8:36:28,  1.54it/s]
 27%|██▋       | 17815/65536 [3:19:50<8:31:19,  1.56it/s]
 27%|██▋       | 17816/65536 [3:19:51<8:32:17,  1.55it/s]
 27%|██▋       | 17817/65536 [3:19:51<8:59:54,  1.47it/s]
 27%|██▋       | 17818/65536 [3:19:52<9:12:56,  1.44it/s]
 27%|██▋       | 17819/65536 [3:19:53<9:03:47,  1.46it/s]
 27%|██▋       | 17820/65536 [3:19:53<9:09:27,  1.45it/s]
                                                         
{'loss': 0.9148, 'learning_rate': 7.572854169217584e-07, 'epoch': 1100.0}

 27%|██▋       | 17820/65536 [3:19:53<9:09:27,  1.45it/s]
 27%|██▋       | 17821/65536 [3:19:54<9:35:39,  1.38it/s]
 27%|██▋       | 17822/65536 [3:19:55<9:21:49,  1.42it/s]
 27%|██▋       | 17823/65536 [3:19:56<9:16:55,  1.43it/s]
 27%|██▋       | 17824/65536 [3:19:56<9:01:15,  1.47it/s]
 27%|██▋       | 17825/65536 [3:19:57<9:04:19,  1.46it/s]
 27%|██▋       | 17826/65536 [3:19:58<9:16:34,  1.43it/s]
 27%|██▋       | 17827/65536 [3:19:58<9:15:07,  1.43it/s]
 27%|██▋       | 17828/65536 [3:19:59<8:58:17,  1.48it/s]
 27%|██▋       | 17829/65536 [3:20:00<8:53:56,  1.49it/s]
 27%|██▋       | 17830/65536 [3:20:00<8:47:49,  1.51it/s]
 27%|██▋       | 17831/65536 [3:20:01<8:49:50,  1.50it/s]
 27%|██▋       | 17832/65536 [3:20:02<8:44:23,  1.52it/s]
 27%|██▋       | 17833/65536 [3:20:02<8:39:56,  1.53it/s]
 27%|██▋       | 17834/65536 [3:20:03<8:41:55,  1.52it/s]
 27%|██▋       | 17835/65536 [3:20:04<8:39:44,  1.53it/s]
 27%|██▋       | 17836/65536 [3:20:04<8:51:02,  1.50it/s]
 27%|██▋       | 17837/65536 [3:20:05<9:13:30,  1.44it/s]
 27%|██▋       | 17838/65536 [3:20:06<9:08:22,  1.45it/s]
 27%|██▋       | 17839/65536 [3:20:06<9:07:42,  1.45it/s]
 27%|██▋       | 17840/65536 [3:20:07<8:55:28,  1.48it/s]
                                                         
{'loss': 0.9011, 'learning_rate': 7.570099179625321e-07, 'epoch': 1101.23}

 27%|██▋       | 17840/65536 [3:20:07<8:55:28,  1.48it/s]
 27%|██▋       | 17841/65536 [3:20:08<8:53:09,  1.49it/s]
 27%|██▋       | 17842/65536 [3:20:08<8:41:09,  1.53it/s]
 27%|██▋       | 17843/65536 [3:20:09<8:52:51,  1.49it/s]
 27%|██▋       | 17844/65536 [3:20:10<8:55:37,  1.48it/s]
 27%|██▋       | 17845/65536 [3:20:10<8:57:52,  1.48it/s]
 27%|██▋       | 17846/65536 [3:20:11<8:44:30,  1.52it/s]
 27%|██▋       | 17847/65536 [3:20:12<9:06:37,  1.45it/s]
 27%|██▋       | 17848/65536 [3:20:12<8:54:48,  1.49it/s]
 27%|██▋       | 17849/65536 [3:20:13<8:48:11,  1.50it/s]
 27%|██▋       | 17850/65536 [3:20:14<8:46:31,  1.51it/s]
 27%|██▋       | 17851/65536 [3:20:14<8:35:39,  1.54it/s]
 27%|██▋       | 17852/65536 [3:20:15<8:39:00,  1.53it/s]
 27%|██▋       | 17853/65536 [3:20:16<9:06:47,  1.45it/s]
 27%|██▋       | 17854/65536 [3:20:16<9:06:41,  1.45it/s]
 27%|██▋       | 17855/65536 [3:20:17<9:03:45,  1.46it/s]
 27%|██▋       | 17856/65536 [3:20:18<8:59:54,  1.47it/s]
 27%|██▋       | 17857/65536 [3:20:18<8:44:05,  1.52it/s]
 27%|██▋       | 17858/65536 [3:20:19<8:40:18,  1.53it/s]
 27%|██▋       | 17859/65536 [3:20:20<8:51:49,  1.49it/s]
 27%|██▋       | 17860/65536 [3:20:20<8:53:16,  1.49it/s]
                                                         
{'loss': 0.9077, 'learning_rate': 7.56734419003306e-07, 'epoch': 1102.47}

 27%|██▋       | 17860/65536 [3:20:20<8:53:16,  1.49it/s]
 27%|██▋       | 17861/65536 [3:20:21<8:51:20,  1.50it/s]
 27%|██▋       | 17862/65536 [3:20:22<8:37:45,  1.53it/s]
 27%|██▋       | 17863/65536 [3:20:22<8:43:47,  1.52it/s]
 27%|██▋       | 17864/65536 [3:20:23<8:37:57,  1.53it/s]
 27%|██▋       | 17865/65536 [3:20:24<8:35:27,  1.54it/s]
 27%|██▋       | 17866/65536 [3:20:24<8:43:40,  1.52it/s]
 27%|██▋       | 17867/65536 [3:20:25<8:59:43,  1.47it/s]
 27%|██▋       | 17868/65536 [3:20:26<8:58:45,  1.47it/s]
 27%|██▋       | 17869/65536 [3:20:26<9:25:36,  1.40it/s]
 27%|██▋       | 17870/65536 [3:20:27<9:20:23,  1.42it/s]
 27%|██▋       | 17871/65536 [3:20:28<9:14:41,  1.43it/s]
 27%|██▋       | 17872/65536 [3:20:29<9:01:59,  1.47it/s]
 27%|██▋       | 17873/65536 [3:20:29<8:42:49,  1.52it/s]
 27%|██▋       | 17874/65536 [3:20:30<8:52:41,  1.49it/s]
 27%|██▋       | 17875/65536 [3:20:30<8:37:29,  1.54it/s]
 27%|██▋       | 17876/65536 [3:20:31<8:38:10,  1.53it/s]
 27%|██▋       | 17877/65536 [3:20:32<8:42:35,  1.52it/s]
 27%|██▋       | 17878/65536 [3:20:32<8:50:31,  1.50it/s]
 27%|██▋       | 17879/65536 [3:20:33<8:39:42,  1.53it/s]
 27%|██▋       | 17880/65536 [3:20:34<8:44:08,  1.52it/s]
                                                         
{'loss': 0.9105, 'learning_rate': 7.564589200440798e-07, 'epoch': 1103.7}

 27%|██▋       | 17880/65536 [3:20:34<8:44:08,  1.52it/s]
 27%|██▋       | 17881/65536 [3:20:34<8:47:23,  1.51it/s]
 27%|██▋       | 17882/65536 [3:20:35<9:00:28,  1.47it/s]
 27%|██▋       | 17883/65536 [3:20:36<8:55:26,  1.48it/s]
 27%|██▋       | 17884/65536 [3:20:36<8:49:15,  1.50it/s]
 27%|██▋       | 17885/65536 [3:20:37<9:17:58,  1.42it/s]
 27%|██▋       | 17886/65536 [3:20:38<9:02:53,  1.46it/s]
 27%|██▋       | 17887/65536 [3:20:39<9:00:02,  1.47it/s]
 27%|██▋       | 17888/65536 [3:20:39<8:43:38,  1.52it/s]
 27%|██▋       | 17889/65536 [3:20:40<9:00:33,  1.47it/s]
 27%|██▋       | 17890/65536 [3:20:41<9:00:06,  1.47it/s]
 27%|██▋       | 17891/65536 [3:20:41<8:46:16,  1.51it/s]
 27%|██▋       | 17892/65536 [3:20:42<8:48:38,  1.50it/s]
 27%|██▋       | 17893/65536 [3:20:42<8:43:55,  1.52it/s]
 27%|██▋       | 17894/65536 [3:20:43<8:38:15,  1.53it/s]
 27%|██▋       | 17895/65536 [3:20:44<8:56:10,  1.48it/s]
 27%|██▋       | 17896/65536 [3:20:45<9:03:26,  1.46it/s]
 27%|██▋       | 17897/65536 [3:20:45<8:48:22,  1.50it/s]
 27%|██▋       | 17898/65536 [3:20:46<8:56:32,  1.48it/s]
 27%|██▋       | 17899/65536 [3:20:47<8:53:43,  1.49it/s]
 27%|██▋       | 17900/65536 [3:20:47<8:57:56,  1.48it/s]
                                                         
{'loss': 0.924, 'learning_rate': 7.561834210848536e-07, 'epoch': 1104.94}

 27%|██▋       | 17900/65536 [3:20:47<8:57:56,  1.48it/s]
 27%|██▋       | 17901/65536 [3:20:48<8:45:30,  1.51it/s]
 27%|██▋       | 17902/65536 [3:20:49<9:03:24,  1.46it/s]
 27%|██▋       | 17903/65536 [3:20:49<8:58:22,  1.47it/s]
 27%|██▋       | 17904/65536 [3:20:50<8:51:56,  1.49it/s]
 27%|██▋       | 17905/65536 [3:20:51<8:43:55,  1.52it/s]
 27%|██▋       | 17906/65536 [3:20:51<9:01:43,  1.47it/s]
 27%|██▋       | 17907/65536 [3:20:52<8:52:11,  1.49it/s]
 27%|██▋       | 17908/65536 [3:20:53<8:48:34,  1.50it/s]
 27%|██▋       | 17909/65536 [3:20:53<9:23:00,  1.41it/s]
 27%|██▋       | 17910/65536 [3:20:54<9:09:29,  1.44it/s]
 27%|██▋       | 17911/65536 [3:20:55<9:01:40,  1.47it/s]
 27%|██▋       | 17912/65536 [3:20:55<8:58:10,  1.47it/s]
 27%|██▋       | 17913/65536 [3:20:56<8:53:19,  1.49it/s]
 27%|██▋       | 17914/65536 [3:20:57<8:50:59,  1.49it/s]
 27%|██▋       | 17915/65536 [3:20:57<8:54:17,  1.49it/s]
 27%|██▋       | 17916/65536 [3:20:58<8:56:16,  1.48it/s]
 27%|██▋       | 17917/65536 [3:20:59<8:46:05,  1.51it/s]
 27%|██▋       | 17918/65536 [3:20:59<9:06:51,  1.45it/s]
 27%|██▋       | 17919/65536 [3:21:00<9:15:50,  1.43it/s]
 27%|██▋       | 17920/65536 [3:21:01<9:11:34,  1.44it/s]
                                                         
{'loss': 0.916, 'learning_rate': 7.559079221256275e-07, 'epoch': 1106.17}

 27%|██▋       | 17920/65536 [3:21:01<9:11:34,  1.44it/s]
 27%|██▋       | 17921/65536 [3:21:01<8:59:30,  1.47it/s]
 27%|██▋       | 17922/65536 [3:21:02<9:00:56,  1.47it/s]
 27%|██▋       | 17923/65536 [3:21:03<8:52:12,  1.49it/s]
 27%|██▋       | 17924/65536 [3:21:04<8:56:30,  1.48it/s]
 27%|██▋       | 17925/65536 [3:21:04<9:08:16,  1.45it/s]
 27%|██▋       | 17926/65536 [3:21:05<9:19:28,  1.42it/s]
 27%|██▋       | 17927/65536 [3:21:06<9:10:15,  1.44it/s]
 27%|██▋       | 17928/65536 [3:21:06<8:58:21,  1.47it/s]
 27%|██▋       | 17929/65536 [3:21:07<8:46:33,  1.51it/s]
 27%|██▋       | 17930/65536 [3:21:08<8:45:47,  1.51it/s]
 27%|██▋       | 17931/65536 [3:21:08<8:43:03,  1.52it/s]
 27%|██▋       | 17932/65536 [3:21:09<8:53:05,  1.49it/s]
 27%|██▋       | 17933/65536 [3:21:10<8:50:18,  1.50it/s]
 27%|██▋       | 17934/65536 [3:21:10<9:20:52,  1.41it/s]
 27%|██▋       | 17935/65536 [3:21:11<9:17:35,  1.42it/s]
 27%|██▋       | 17936/65536 [3:21:12<9:13:15,  1.43it/s]
 27%|██▋       | 17937/65536 [3:21:12<8:56:28,  1.48it/s]
 27%|██▋       | 17938/65536 [3:21:13<8:36:32,  1.54it/s]
 27%|██▋       | 17939/65536 [3:21:14<8:47:40,  1.50it/s]
 27%|██▋       | 17940/65536 [3:21:14<8:54:09,  1.49it/s]
                                                         
{'loss': 0.8822, 'learning_rate': 7.556324231664013e-07, 'epoch': 1107.41}

 27%|██▋       | 17940/65536 [3:21:14<8:54:09,  1.49it/s]
 27%|██▋       | 17941/65536 [3:21:15<8:59:11,  1.47it/s]
 27%|██▋       | 17942/65536 [3:21:16<8:45:05,  1.51it/s]
 27%|██▋       | 17943/65536 [3:21:16<8:36:11,  1.54it/s]
 27%|██▋       | 17944/65536 [3:21:17<8:42:28,  1.52it/s]
 27%|██▋       | 17945/65536 [3:21:18<8:42:27,  1.52it/s]
 27%|██▋       | 17946/65536 [3:21:18<8:30:40,  1.55it/s]
 27%|██▋       | 17947/65536 [3:21:19<8:51:59,  1.49it/s]
 27%|██▋       | 17948/65536 [3:21:20<8:54:12,  1.48it/s]
 27%|██▋       | 17949/65536 [3:21:20<8:55:42,  1.48it/s]
 27%|██▋       | 17950/65536 [3:21:21<9:10:48,  1.44it/s]
 27%|██▋       | 17951/65536 [3:21:22<9:12:14,  1.44it/s]
 27%|██▋       | 17952/65536 [3:21:22<8:51:58,  1.49it/s]
 27%|██▋       | 17953/65536 [3:21:23<8:55:29,  1.48it/s]
 27%|██▋       | 17954/65536 [3:21:24<8:55:46,  1.48it/s]
 27%|██▋       | 17955/65536 [3:21:24<9:00:46,  1.47it/s]
 27%|██▋       | 17956/65536 [3:21:25<8:51:58,  1.49it/s]
 27%|██▋       | 17957/65536 [3:21:26<8:54:34,  1.48it/s]
 27%|██▋       | 17958/65536 [3:21:26<8:48:50,  1.50it/s]
 27%|██▋       | 17959/65536 [3:21:27<8:47:05,  1.50it/s]
 27%|██▋       | 17960/65536 [3:21:28<8:49:32,  1.50it/s]
                                                         
{'loss': 0.9136, 'learning_rate': 7.553569242071753e-07, 'epoch': 1108.64}

 27%|██▋       | 17960/65536 [3:21:28<8:49:32,  1.50it/s]
 27%|██▋       | 17961/65536 [3:21:28<9:02:38,  1.46it/s]
 27%|██▋       | 17962/65536 [3:21:29<8:59:45,  1.47it/s]
 27%|██▋       | 17963/65536 [3:21:30<9:07:49,  1.45it/s]
 27%|██▋       | 17964/65536 [3:21:31<8:50:57,  1.49it/s]
 27%|██▋       | 17965/65536 [3:21:31<8:45:57,  1.51it/s]
 27%|██▋       | 17966/65536 [3:21:32<9:04:55,  1.45it/s]
 27%|██▋       | 17967/65536 [3:21:33<9:00:31,  1.47it/s]
 27%|██▋       | 17968/65536 [3:21:33<8:56:11,  1.48it/s]
 27%|██▋       | 17969/65536 [3:21:34<8:40:23,  1.52it/s]
 27%|██▋       | 17970/65536 [3:21:35<9:01:27,  1.46it/s]
 27%|██▋       | 17971/65536 [3:21:35<8:40:58,  1.52it/s]
 27%|██▋       | 17972/65536 [3:21:36<8:55:15,  1.48it/s]
 27%|██▋       | 17973/65536 [3:21:37<8:46:21,  1.51it/s]
 27%|██▋       | 17974/65536 [3:21:37<8:48:49,  1.50it/s]
 27%|██▋       | 17975/65536 [3:21:38<8:57:11,  1.48it/s]
 27%|██▋       | 17976/65536 [3:21:39<9:04:00,  1.46it/s]
 27%|██▋       | 17977/65536 [3:21:39<8:49:02,  1.50it/s]
 27%|██▋       | 17978/65536 [3:21:40<8:41:41,  1.52it/s]
 27%|██▋       | 17979/65536 [3:21:41<8:42:15,  1.52it/s]
 27%|██▋       | 17980/65536 [3:21:41<8:53:19,  1.49it/s]
                                                         
{'loss': 0.9195, 'learning_rate': 7.55081425247949e-07, 'epoch': 1109.88}

 27%|██▋       | 17980/65536 [3:21:41<8:53:19,  1.49it/s]
 27%|██▋       | 17981/65536 [3:21:42<8:55:25,  1.48it/s]
 27%|██▋       | 17982/65536 [3:21:43<8:50:50,  1.49it/s]
 27%|██▋       | 17983/65536 [3:21:43<9:05:08,  1.45it/s]
 27%|██▋       | 17984/65536 [3:21:44<8:57:20,  1.47it/s]
 27%|██▋       | 17985/65536 [3:21:45<8:53:43,  1.48it/s]
 27%|██▋       | 17986/65536 [3:21:45<8:51:40,  1.49it/s]
 27%|██▋       | 17987/65536 [3:21:46<8:43:37,  1.51it/s]
 27%|██▋       | 17988/65536 [3:21:47<8:38:56,  1.53it/s]
 27%|██▋       | 17989/65536 [3:21:47<8:40:41,  1.52it/s]
 27%|██▋       | 17990/65536 [3:21:48<8:34:21,  1.54it/s]
 27%|██▋       | 17991/65536 [3:21:49<8:48:26,  1.50it/s]
 27%|██▋       | 17992/65536 [3:21:49<8:39:02,  1.53it/s]
 27%|██▋       | 17993/65536 [3:21:50<8:24:07,  1.57it/s]
 27%|██▋       | 17994/65536 [3:21:50<8:18:25,  1.59it/s]
 27%|██▋       | 17995/65536 [3:21:51<8:36:06,  1.54it/s]
 27%|██▋       | 17996/65536 [3:21:52<8:25:12,  1.57it/s]
 27%|██▋       | 17997/65536 [3:21:52<8:44:28,  1.51it/s]
 27%|██▋       | 17998/65536 [3:21:53<9:07:30,  1.45it/s]
 27%|██▋       | 17999/65536 [3:21:54<9:28:38,  1.39it/s]
 27%|██▋       | 18000/65536 [3:21:55<9:21:49,  1.41it/s]
                                                         
{'loss': 0.9259, 'learning_rate': 7.548059262887229e-07, 'epoch': 1111.11}

 27%|██▋       | 18000/65536 [3:21:55<9:21:49,  1.41it/s]
 27%|██▋       | 18001/65536 [3:21:55<9:06:33,  1.45it/s]
 27%|██▋       | 18002/65536 [3:21:56<8:50:29,  1.49it/s]
 27%|██▋       | 18003/65536 [3:21:57<9:00:26,  1.47it/s]
 27%|██▋       | 18004/65536 [3:21:57<8:49:57,  1.49it/s]
 27%|██▋       | 18005/65536 [3:21:58<8:42:27,  1.52it/s]
 27%|██▋       | 18006/65536 [3:21:59<8:39:25,  1.53it/s]
 27%|██▋       | 18007/65536 [3:21:59<8:45:01,  1.51it/s]
 27%|██▋       | 18008/65536 [3:22:00<8:53:30,  1.48it/s]
 27%|██▋       | 18009/65536 [3:22:01<9:01:10,  1.46it/s]
 27%|██▋       | 18010/65536 [3:22:01<9:05:42,  1.45it/s]
 27%|██▋       | 18011/65536 [3:22:02<9:07:48,  1.45it/s]
 27%|██▋       | 18012/65536 [3:22:03<9:03:24,  1.46it/s]
 27%|██▋       | 18013/65536 [3:22:03<8:56:24,  1.48it/s]
 27%|██▋       | 18014/65536 [3:22:04<8:40:41,  1.52it/s]
 27%|██▋       | 18015/65536 [3:22:05<8:59:43,  1.47it/s]
 27%|██▋       | 18016/65536 [3:22:05<9:00:10,  1.47it/s]
 27%|██▋       | 18017/65536 [3:22:06<8:55:55,  1.48it/s]
 27%|██▋       | 18018/65536 [3:22:07<9:10:37,  1.44it/s]
 27%|██▋       | 18019/65536 [3:22:08<9:09:37,  1.44it/s]
 27%|██▋       | 18020/65536 [3:22:08<8:59:16,  1.47it/s]
                                                         
{'loss': 0.9022, 'learning_rate': 7.545304273294968e-07, 'epoch': 1112.35}

 27%|██▋       | 18020/65536 [3:22:08<8:59:16,  1.47it/s]
 27%|██▋       | 18021/65536 [3:22:09<9:09:57,  1.44it/s]
 27%|██▋       | 18022/65536 [3:22:10<9:05:12,  1.45it/s]
 28%|██▊       | 18023/65536 [3:22:10<8:58:33,  1.47it/s]
 28%|██▊       | 18024/65536 [3:22:11<8:44:18,  1.51it/s]
 28%|██▊       | 18025/65536 [3:22:11<8:31:46,  1.55it/s]
 28%|██▊       | 18026/65536 [3:22:12<8:43:50,  1.51it/s]
 28%|██▊       | 18027/65536 [3:22:13<8:49:15,  1.50it/s]
 28%|██▊       | 18028/65536 [3:22:13<8:45:51,  1.51it/s]
 28%|██▊       | 18029/65536 [3:22:14<8:51:32,  1.49it/s]
 28%|██▊       | 18030/65536 [3:22:15<8:39:42,  1.52it/s]
 28%|██▊       | 18031/65536 [3:22:16<8:58:02,  1.47it/s]
 28%|██▊       | 18032/65536 [3:22:16<8:46:37,  1.50it/s]
 28%|██▊       | 18033/65536 [3:22:17<8:45:08,  1.51it/s]
 28%|██▊       | 18034/65536 [3:22:17<8:37:49,  1.53it/s]
 28%|██▊       | 18035/65536 [3:22:18<8:35:32,  1.54it/s]
 28%|██▊       | 18036/65536 [3:22:19<8:45:08,  1.51it/s]
 28%|██▊       | 18037/65536 [3:22:19<8:53:05,  1.49it/s]
 28%|██▊       | 18038/65536 [3:22:20<8:58:54,  1.47it/s]
 28%|██▊       | 18039/65536 [3:22:21<8:58:02,  1.47it/s]
 28%|██▊       | 18040/65536 [3:22:22<8:56:19,  1.48it/s]
                                                         
{'loss': 0.9117, 'learning_rate': 7.542549283702706e-07, 'epoch': 1113.58}

 28%|██▊       | 18040/65536 [3:22:22<8:56:19,  1.48it/s]
 28%|██▊       | 18041/65536 [3:22:22<9:02:22,  1.46it/s]
 28%|██▊       | 18042/65536 [3:22:23<9:04:12,  1.45it/s]
 28%|██▊       | 18043/65536 [3:22:24<8:54:10,  1.48it/s]
 28%|██▊       | 18044/65536 [3:22:24<8:38:12,  1.53it/s]
 28%|██▊       | 18045/65536 [3:22:25<8:35:57,  1.53it/s]
 28%|██▊       | 18046/65536 [3:22:25<8:40:58,  1.52it/s]
 28%|██▊       | 18047/65536 [3:22:26<9:06:16,  1.45it/s]
 28%|██▊       | 18048/65536 [3:22:27<9:17:06,  1.42it/s]
 28%|██▊       | 18049/65536 [3:22:28<9:21:06,  1.41it/s]
 28%|██▊       | 18050/65536 [3:22:28<9:17:26,  1.42it/s]
 28%|██▊       | 18051/65536 [3:22:29<9:04:01,  1.45it/s]
 28%|██▊       | 18052/65536 [3:22:30<8:58:19,  1.47it/s]
 28%|██▊       | 18053/65536 [3:22:30<8:48:12,  1.50it/s]
 28%|██▊       | 18054/65536 [3:22:31<8:47:50,  1.50it/s]
 28%|██▊       | 18055/65536 [3:22:32<8:43:01,  1.51it/s]
 28%|██▊       | 18056/65536 [3:22:32<8:38:16,  1.53it/s]
 28%|██▊       | 18057/65536 [3:22:33<8:42:27,  1.51it/s]
 28%|██▊       | 18058/65536 [3:22:34<8:35:30,  1.53it/s]
 28%|██▊       | 18059/65536 [3:22:34<8:33:45,  1.54it/s]
 28%|██▊       | 18060/65536 [3:22:35<8:30:50,  1.55it/s]
                                                         
{'loss': 0.9114, 'learning_rate': 7.539794294110445e-07, 'epoch': 1114.81}

 28%|██▊       | 18060/65536 [3:22:35<8:30:50,  1.55it/s]
 28%|██▊       | 18061/65536 [3:22:36<8:41:37,  1.52it/s]
 28%|██▊       | 18062/65536 [3:22:36<8:47:48,  1.50it/s]
 28%|██▊       | 18063/65536 [3:22:37<8:39:52,  1.52it/s]
 28%|██▊       | 18064/65536 [3:22:38<8:58:55,  1.47it/s]
 28%|██▊       | 18065/65536 [3:22:38<8:55:46,  1.48it/s]
 28%|██▊       | 18066/65536 [3:22:39<8:55:49,  1.48it/s]
 28%|██▊       | 18067/65536 [3:22:40<8:48:46,  1.50it/s]
 28%|██▊       | 18068/65536 [3:22:40<8:57:03,  1.47it/s]
 28%|██▊       | 18069/65536 [3:22:41<8:51:59,  1.49it/s]
 28%|██▊       | 18070/65536 [3:22:42<8:50:15,  1.49it/s]
 28%|██▊       | 18071/65536 [3:22:42<8:44:10,  1.51it/s]
 28%|██▊       | 18072/65536 [3:22:43<8:42:33,  1.51it/s]
 28%|██▊       | 18073/65536 [3:22:44<8:41:51,  1.52it/s]
 28%|██▊       | 18074/65536 [3:22:44<8:35:24,  1.53it/s]
 28%|██▊       | 18075/65536 [3:22:45<8:24:42,  1.57it/s]
 28%|██▊       | 18076/65536 [3:22:46<8:44:01,  1.51it/s]
 28%|██▊       | 18077/65536 [3:22:46<8:55:48,  1.48it/s]
 28%|██▊       | 18078/65536 [3:22:47<8:55:31,  1.48it/s]
 28%|██▊       | 18079/65536 [3:22:48<8:38:30,  1.53it/s]
 28%|██▊       | 18080/65536 [3:22:48<8:58:50,  1.47it/s]
                                                         
{'loss': 0.9284, 'learning_rate': 7.537039304518183e-07, 'epoch': 1116.05}

 28%|██▊       | 18080/65536 [3:22:48<8:58:50,  1.47it/s]
 28%|██▊       | 18081/65536 [3:22:49<9:03:00,  1.46it/s]
 28%|██▊       | 18082/65536 [3:22:50<8:57:22,  1.47it/s]
 28%|██▊       | 18083/65536 [3:22:50<8:48:53,  1.50it/s]
 28%|██▊       | 18084/65536 [3:22:51<8:49:53,  1.49it/s]
 28%|██▊       | 18085/65536 [3:22:52<8:43:25,  1.51it/s]
 28%|██▊       | 18086/65536 [3:22:52<8:47:36,  1.50it/s]
 28%|██▊       | 18087/65536 [3:22:53<8:49:16,  1.49it/s]
 28%|██▊       | 18088/65536 [3:22:54<8:57:38,  1.47it/s]
 28%|██▊       | 18089/65536 [3:22:54<8:58:02,  1.47it/s]
 28%|██▊       | 18090/65536 [3:22:55<8:59:51,  1.46it/s]
 28%|██▊       | 18091/65536 [3:22:56<8:54:29,  1.48it/s]
 28%|██▊       | 18092/65536 [3:22:56<8:35:42,  1.53it/s]
 28%|██▊       | 18093/65536 [3:22:57<8:39:27,  1.52it/s]
 28%|██▊       | 18094/65536 [3:22:58<8:59:26,  1.47it/s]
 28%|██▊       | 18095/65536 [3:22:58<8:56:15,  1.47it/s]
 28%|██▊       | 18096/65536 [3:22:59<9:22:11,  1.41it/s]
 28%|██▊       | 18097/65536 [3:23:00<8:53:31,  1.48it/s]
 28%|██▊       | 18098/65536 [3:23:00<8:53:27,  1.48it/s]
 28%|██▊       | 18099/65536 [3:23:01<8:39:50,  1.52it/s]
 28%|██▊       | 18100/65536 [3:23:02<8:35:18,  1.53it/s]
                                                         
{'loss': 0.9189, 'learning_rate': 7.534284314925921e-07, 'epoch': 1117.28}

 28%|██▊       | 18100/65536 [3:23:02<8:35:18,  1.53it/s]
 28%|██▊       | 18101/65536 [3:23:02<8:49:10,  1.49it/s]
 28%|██▊       | 18102/65536 [3:23:03<8:58:31,  1.47it/s]
 28%|██▊       | 18103/65536 [3:23:04<9:09:03,  1.44it/s]
 28%|██▊       | 18104/65536 [3:23:05<8:59:50,  1.46it/s]
 28%|██▊       | 18105/65536 [3:23:05<9:03:59,  1.45it/s]
 28%|██▊       | 18106/65536 [3:23:06<9:03:18,  1.45it/s]
 28%|██▊       | 18107/65536 [3:23:07<8:56:16,  1.47it/s]
 28%|██▊       | 18108/65536 [3:23:07<9:03:36,  1.45it/s]
 28%|██▊       | 18109/65536 [3:23:08<8:57:30,  1.47it/s]
 28%|██▊       | 18110/65536 [3:23:09<8:56:05,  1.47it/s]
 28%|██▊       | 18111/65536 [3:23:09<8:56:47,  1.47it/s]
 28%|██▊       | 18112/65536 [3:23:10<9:17:17,  1.42it/s]
 28%|██▊       | 18113/65536 [3:23:11<9:10:44,  1.44it/s]
 28%|██▊       | 18114/65536 [3:23:11<8:57:07,  1.47it/s]
 28%|██▊       | 18115/65536 [3:23:12<9:00:57,  1.46it/s]
 28%|██▊       | 18116/65536 [3:23:13<8:59:50,  1.46it/s]
 28%|██▊       | 18117/65536 [3:23:13<8:56:49,  1.47it/s]
 28%|██▊       | 18118/65536 [3:23:14<9:14:06,  1.43it/s]
 28%|██▊       | 18119/65536 [3:23:15<9:15:17,  1.42it/s]
 28%|██▊       | 18120/65536 [3:23:16<9:01:27,  1.46it/s]
                                                         
{'loss': 0.8746, 'learning_rate': 7.531529325333659e-07, 'epoch': 1118.52}

 28%|██▊       | 18120/65536 [3:23:16<9:01:27,  1.46it/s]
 28%|██▊       | 18121/65536 [3:23:16<8:56:56,  1.47it/s]
 28%|██▊       | 18122/65536 [3:23:17<8:54:53,  1.48it/s]
 28%|██▊       | 18123/65536 [3:23:18<8:49:47,  1.49it/s]
 28%|██▊       | 18124/65536 [3:23:18<8:48:49,  1.49it/s]
 28%|██▊       | 18125/65536 [3:23:19<8:40:56,  1.52it/s]
 28%|██▊       | 18126/65536 [3:23:19<8:36:52,  1.53it/s]
 28%|██▊       | 18127/65536 [3:23:20<8:48:55,  1.49it/s]
 28%|██▊       | 18128/65536 [3:23:21<9:19:00,  1.41it/s]
 28%|██▊       | 18129/65536 [3:23:22<9:12:08,  1.43it/s]
 28%|██▊       | 18130/65536 [3:23:22<9:14:20,  1.43it/s]
 28%|██▊       | 18131/65536 [3:23:23<9:00:13,  1.46it/s]
 28%|██▊       | 18132/65536 [3:23:24<9:01:52,  1.46it/s]
 28%|██▊       | 18133/65536 [3:23:24<9:09:14,  1.44it/s]
 28%|██▊       | 18134/65536 [3:23:25<9:05:26,  1.45it/s]
 28%|██▊       | 18135/65536 [3:23:26<8:56:49,  1.47it/s]
 28%|██▊       | 18136/65536 [3:23:26<8:47:03,  1.50it/s]
 28%|██▊       | 18137/65536 [3:23:27<8:35:08,  1.53it/s]
 28%|██▊       | 18138/65536 [3:23:28<8:34:34,  1.54it/s]
 28%|██▊       | 18139/65536 [3:23:28<8:36:26,  1.53it/s]
 28%|██▊       | 18140/65536 [3:23:29<8:47:10,  1.50it/s]
                                                         
{'loss': 0.9194, 'learning_rate': 7.528774335741398e-07, 'epoch': 1119.75}

 28%|██▊       | 18140/65536 [3:23:29<8:47:10,  1.50it/s]
 28%|██▊       | 18141/65536 [3:23:30<8:52:28,  1.48it/s]
 28%|██▊       | 18142/65536 [3:23:30<8:40:39,  1.52it/s]
 28%|██▊       | 18143/65536 [3:23:31<9:08:17,  1.44it/s]
 28%|██▊       | 18144/65536 [3:23:32<8:52:21,  1.48it/s]
 28%|██▊       | 18145/65536 [3:23:32<9:09:19,  1.44it/s]
 28%|██▊       | 18146/65536 [3:23:33<9:03:47,  1.45it/s]
 28%|██▊       | 18147/65536 [3:23:34<9:05:40,  1.45it/s]
 28%|██▊       | 18148/65536 [3:23:34<9:04:40,  1.45it/s]
 28%|██▊       | 18149/65536 [3:23:35<8:56:46,  1.47it/s]
 28%|██▊       | 18150/65536 [3:23:36<8:51:55,  1.48it/s]
 28%|██▊       | 18151/65536 [3:23:36<8:51:06,  1.49it/s]
 28%|██▊       | 18152/65536 [3:23:37<8:57:45,  1.47it/s]
 28%|██▊       | 18153/65536 [3:23:38<9:06:38,  1.44it/s]
 28%|██▊       | 18154/65536 [3:23:39<8:57:06,  1.47it/s]
 28%|██▊       | 18155/65536 [3:23:39<8:40:54,  1.52it/s]
 28%|██▊       | 18156/65536 [3:23:40<8:41:15,  1.51it/s]
 28%|██▊       | 18157/65536 [3:23:41<9:03:33,  1.45it/s]
 28%|██▊       | 18158/65536 [3:23:41<8:54:14,  1.48it/s]
 28%|██▊       | 18159/65536 [3:23:42<8:51:32,  1.49it/s]
 28%|██▊       | 18160/65536 [3:23:43<8:46:40,  1.50it/s]
                                                         
{'loss': 0.8968, 'learning_rate': 7.526019346149136e-07, 'epoch': 1120.99}

 28%|██▊       | 18160/65536 [3:23:43<8:46:40,  1.50it/s]
 28%|██▊       | 18161/65536 [3:23:43<9:10:27,  1.43it/s]
 28%|██▊       | 18162/65536 [3:23:44<9:06:18,  1.45it/s]
 28%|██▊       | 18163/65536 [3:23:45<9:07:44,  1.44it/s]
 28%|██▊       | 18164/65536 [3:23:45<8:56:08,  1.47it/s]
 28%|██▊       | 18165/65536 [3:23:46<9:03:02,  1.45it/s]
 28%|██▊       | 18166/65536 [3:23:47<9:04:30,  1.45it/s]
 28%|██▊       | 18167/65536 [3:23:47<9:05:42,  1.45it/s]
 28%|██▊       | 18168/65536 [3:23:48<8:59:21,  1.46it/s]
 28%|██▊       | 18169/65536 [3:23:49<9:01:20,  1.46it/s]
 28%|██▊       | 18170/65536 [3:23:49<9:01:32,  1.46it/s]
 28%|██▊       | 18171/65536 [3:23:50<8:56:01,  1.47it/s]
 28%|██▊       | 18172/65536 [3:23:51<8:48:41,  1.49it/s]
 28%|██▊       | 18173/65536 [3:23:51<8:47:57,  1.50it/s]
 28%|██▊       | 18174/65536 [3:23:52<8:51:08,  1.49it/s]
 28%|██▊       | 18175/65536 [3:23:53<8:44:08,  1.51it/s]
 28%|██▊       | 18176/65536 [3:23:53<8:32:08,  1.54it/s]
 28%|██▊       | 18177/65536 [3:23:54<9:00:27,  1.46it/s]
 28%|██▊       | 18178/65536 [3:23:55<9:05:06,  1.45it/s]
 28%|██▊       | 18179/65536 [3:23:56<9:11:12,  1.43it/s]
 28%|██▊       | 18180/65536 [3:23:56<9:11:29,  1.43it/s]
                                                         
{'loss': 0.9161, 'learning_rate': 7.523264356556874e-07, 'epoch': 1122.22}

 28%|██▊       | 18180/65536 [3:23:56<9:11:29,  1.43it/s]
 28%|██▊       | 18181/65536 [3:23:57<8:59:29,  1.46it/s]
 28%|██▊       | 18182/65536 [3:23:58<8:47:25,  1.50it/s]
 28%|██▊       | 18183/65536 [3:23:58<8:39:48,  1.52it/s]
 28%|██▊       | 18184/65536 [3:23:59<8:44:30,  1.50it/s]
 28%|██▊       | 18185/65536 [3:24:00<9:01:33,  1.46it/s]
 28%|██▊       | 18186/65536 [3:24:00<8:57:21,  1.47it/s]
 28%|██▊       | 18187/65536 [3:24:01<8:53:03,  1.48it/s]
 28%|██▊       | 18188/65536 [3:24:02<8:56:38,  1.47it/s]
 28%|██▊       | 18189/65536 [3:24:02<8:48:25,  1.49it/s]
 28%|██▊       | 18190/65536 [3:24:03<8:40:57,  1.51it/s]
 28%|██▊       | 18191/65536 [3:24:04<8:56:18,  1.47it/s]
 28%|██▊       | 18192/65536 [3:24:04<8:36:20,  1.53it/s]
 28%|██▊       | 18193/65536 [3:24:05<9:01:48,  1.46it/s]
 28%|██▊       | 18194/65536 [3:24:06<8:59:18,  1.46it/s]
 28%|██▊       | 18195/65536 [3:24:06<9:03:24,  1.45it/s]
 28%|██▊       | 18196/65536 [3:24:07<9:00:24,  1.46it/s]
 28%|██▊       | 18197/65536 [3:24:08<8:52:59,  1.48it/s]
 28%|██▊       | 18198/65536 [3:24:08<8:54:14,  1.48it/s]
 28%|██▊       | 18199/65536 [3:24:09<8:50:54,  1.49it/s]
 28%|██▊       | 18200/65536 [3:24:10<8:51:31,  1.48it/s]
                                                         
{'loss': 0.9124, 'learning_rate': 7.520509366964613e-07, 'epoch': 1123.46}

 28%|██▊       | 18200/65536 [3:24:10<8:51:31,  1.48it/s]
 28%|██▊       | 18201/65536 [3:24:11<9:22:59,  1.40it/s]
 28%|██▊       | 18202/65536 [3:24:11<8:59:05,  1.46it/s]
 28%|██▊       | 18203/65536 [3:24:12<8:53:10,  1.48it/s]
 28%|██▊       | 18204/65536 [3:24:12<8:46:19,  1.50it/s]
 28%|██▊       | 18205/65536 [3:24:13<8:41:05,  1.51it/s]
 28%|██▊       | 18206/65536 [3:24:14<8:38:22,  1.52it/s]
 28%|██▊       | 18207/65536 [3:24:14<8:37:31,  1.52it/s]
 28%|██▊       | 18208/65536 [3:24:15<8:42:55,  1.51it/s]
 28%|██▊       | 18209/65536 [3:24:16<9:11:27,  1.43it/s]
 28%|██▊       | 18210/65536 [3:24:17<9:02:18,  1.45it/s]
 28%|██▊       | 18211/65536 [3:24:17<8:48:25,  1.49it/s]
 28%|██▊       | 18212/65536 [3:24:18<8:48:02,  1.49it/s]
 28%|██▊       | 18213/65536 [3:24:19<8:50:02,  1.49it/s]
 28%|██▊       | 18214/65536 [3:24:19<8:54:57,  1.47it/s]
 28%|██▊       | 18215/65536 [3:24:20<8:55:49,  1.47it/s]
 28%|██▊       | 18216/65536 [3:24:21<8:56:03,  1.47it/s]
 28%|██▊       | 18217/65536 [3:24:21<9:16:36,  1.42it/s]
 28%|██▊       | 18218/65536 [3:24:22<8:59:46,  1.46it/s]
 28%|██▊       | 18219/65536 [3:24:23<8:54:22,  1.48it/s]
 28%|██▊       | 18220/65536 [3:24:23<9:07:07,  1.44it/s]
                                                         
{'loss': 0.8871, 'learning_rate': 7.517754377372351e-07, 'epoch': 1124.69}

 28%|██▊       | 18220/65536 [3:24:23<9:07:07,  1.44it/s]
 28%|██▊       | 18221/65536 [3:24:24<8:55:03,  1.47it/s]
 28%|██▊       | 18222/65536 [3:24:25<8:49:06,  1.49it/s]
 28%|██▊       | 18223/65536 [3:24:25<8:46:23,  1.50it/s]
 28%|██▊       | 18224/65536 [3:24:26<8:36:12,  1.53it/s]
 28%|██▊       | 18225/65536 [3:24:27<8:39:57,  1.52it/s]
 28%|██▊       | 18226/65536 [3:24:27<8:59:06,  1.46it/s]
 28%|██▊       | 18227/65536 [3:24:28<8:47:04,  1.50it/s]
 28%|██▊       | 18228/65536 [3:24:29<8:52:41,  1.48it/s]
 28%|██▊       | 18229/65536 [3:24:29<8:51:02,  1.48it/s]
 28%|██▊       | 18230/65536 [3:24:30<8:45:49,  1.50it/s]
 28%|██▊       | 18231/65536 [3:24:31<8:35:33,  1.53it/s]
 28%|██▊       | 18232/65536 [3:24:31<8:54:33,  1.47it/s]
 28%|██▊       | 18233/65536 [3:24:32<8:55:22,  1.47it/s]
 28%|██▊       | 18234/65536 [3:24:33<8:54:03,  1.48it/s]
 28%|██▊       | 18235/65536 [3:24:33<8:38:26,  1.52it/s]
 28%|██▊       | 18236/65536 [3:24:34<8:38:25,  1.52it/s]
 28%|██▊       | 18237/65536 [3:24:35<8:34:38,  1.53it/s]
 28%|██▊       | 18238/65536 [3:24:35<8:36:21,  1.53it/s]
 28%|██▊       | 18239/65536 [3:24:36<8:48:27,  1.49it/s]
 28%|██▊       | 18240/65536 [3:24:37<9:05:08,  1.45it/s]
                                                         
{'loss': 0.9256, 'learning_rate': 7.51499938778009e-07, 'epoch': 1125.93}

 28%|██▊       | 18240/65536 [3:24:37<9:05:08,  1.45it/s]
 28%|██▊       | 18241/65536 [3:24:37<8:53:30,  1.48it/s]
 28%|██▊       | 18242/65536 [3:24:38<9:14:44,  1.42it/s]
 28%|██▊       | 18243/65536 [3:24:39<9:05:42,  1.44it/s]
 28%|██▊       | 18244/65536 [3:24:40<9:16:12,  1.42it/s]
 28%|██▊       | 18245/65536 [3:24:40<8:54:21,  1.47it/s]
 28%|██▊       | 18246/65536 [3:24:41<8:50:55,  1.48it/s]
 28%|██▊       | 18247/65536 [3:24:41<8:54:31,  1.47it/s]
 28%|██▊       | 18248/65536 [3:24:42<8:57:20,  1.47it/s]
 28%|██▊       | 18249/65536 [3:24:43<8:48:57,  1.49it/s]
 28%|██▊       | 18250/65536 [3:24:44<8:52:45,  1.48it/s]
 28%|██▊       | 18251/65536 [3:24:44<8:43:34,  1.51it/s]
 28%|██▊       | 18252/65536 [3:24:45<8:42:13,  1.51it/s]
 28%|██▊       | 18253/65536 [3:24:45<8:41:33,  1.51it/s]
 28%|██▊       | 18254/65536 [3:24:46<8:46:51,  1.50it/s]
 28%|██▊       | 18255/65536 [3:24:47<8:43:51,  1.50it/s]
 28%|██▊       | 18256/65536 [3:24:47<8:33:31,  1.53it/s]
 28%|██▊       | 18257/65536 [3:24:48<8:47:42,  1.49it/s]
 28%|██▊       | 18258/65536 [3:24:49<9:16:24,  1.42it/s]
 28%|██▊       | 18259/65536 [3:24:50<8:54:39,  1.47it/s]
 28%|██▊       | 18260/65536 [3:24:50<8:43:29,  1.51it/s]
                                                         
{'loss': 0.9349, 'learning_rate': 7.512244398187828e-07, 'epoch': 1127.16}

 28%|██▊       | 18260/65536 [3:24:50<8:43:29,  1.51it/s]
 28%|██▊       | 18261/65536 [3:24:51<8:43:59,  1.50it/s]
 28%|██▊       | 18262/65536 [3:24:52<8:54:01,  1.48it/s]
 28%|██▊       | 18263/65536 [3:24:52<8:53:09,  1.48it/s]
 28%|██▊       | 18264/65536 [3:24:53<8:53:55,  1.48it/s]
 28%|██▊       | 18265/65536 [3:24:54<8:57:17,  1.47it/s]
 28%|██▊       | 18266/65536 [3:24:54<8:46:27,  1.50it/s]
 28%|██▊       | 18267/65536 [3:24:55<8:48:54,  1.49it/s]
 28%|██▊       | 18268/65536 [3:24:56<8:48:04,  1.49it/s]
 28%|██▊       | 18269/65536 [3:24:56<8:41:46,  1.51it/s]
 28%|██▊       | 18270/65536 [3:24:57<8:51:21,  1.48it/s]
 28%|██▊       | 18271/65536 [3:24:58<9:04:20,  1.45it/s]
 28%|██▊       | 18272/65536 [3:24:58<8:58:41,  1.46it/s]
 28%|██▊       | 18273/65536 [3:24:59<8:44:45,  1.50it/s]
 28%|██▊       | 18274/65536 [3:25:00<8:51:36,  1.48it/s]
 28%|██▊       | 18275/65536 [3:25:00<8:56:56,  1.47it/s]
 28%|██▊       | 18276/65536 [3:25:01<8:51:13,  1.48it/s]
 28%|██▊       | 18277/65536 [3:25:02<9:01:27,  1.45it/s]
 28%|██▊       | 18278/65536 [3:25:02<8:58:03,  1.46it/s]
 28%|██▊       | 18279/65536 [3:25:03<8:56:39,  1.47it/s]
 28%|██▊       | 18280/65536 [3:25:04<9:07:04,  1.44it/s]
                                                         
{'loss': 0.9053, 'learning_rate': 7.509489408595567e-07, 'epoch': 1128.4}

 28%|██▊       | 18280/65536 [3:25:04<9:07:04,  1.44it/s]
 28%|██▊       | 18281/65536 [3:25:04<8:58:15,  1.46it/s]
 28%|██▊       | 18282/65536 [3:25:05<8:48:59,  1.49it/s]
 28%|██▊       | 18283/65536 [3:25:06<8:50:07,  1.49it/s]
 28%|██▊       | 18284/65536 [3:25:06<8:38:58,  1.52it/s]
 28%|██▊       | 18285/65536 [3:25:07<8:51:32,  1.48it/s]
 28%|██▊       | 18286/65536 [3:25:08<8:59:03,  1.46it/s]
 28%|██▊       | 18287/65536 [3:25:08<8:56:20,  1.47it/s]
 28%|██▊       | 18288/65536 [3:25:09<8:56:31,  1.47it/s]
 28%|██▊       | 18289/65536 [3:25:10<8:51:37,  1.48it/s]
 28%|██▊       | 18290/65536 [3:25:11<9:01:01,  1.46it/s]
 28%|██▊       | 18291/65536 [3:25:11<8:48:20,  1.49it/s]
 28%|██▊       | 18292/65536 [3:25:12<8:37:04,  1.52it/s]
 28%|██▊       | 18293/65536 [3:25:13<8:49:51,  1.49it/s]
 28%|██▊       | 18294/65536 [3:25:13<8:50:53,  1.48it/s]
 28%|██▊       | 18295/65536 [3:25:14<8:44:11,  1.50it/s]
 28%|██▊       | 18296/65536 [3:25:14<8:34:08,  1.53it/s]
 28%|██▊       | 18297/65536 [3:25:15<8:43:58,  1.50it/s]
 28%|██▊       | 18298/65536 [3:25:16<8:49:34,  1.49it/s]
 28%|██▊       | 18299/65536 [3:25:17<8:53:39,  1.48it/s]
 28%|██▊       | 18300/65536 [3:25:17<8:53:10,  1.48it/s]
                                                         
{'loss': 0.9089, 'learning_rate': 7.506734419003306e-07, 'epoch': 1129.63}

 28%|██▊       | 18300/65536 [3:25:17<8:53:10,  1.48it/s]
 28%|██▊       | 18301/65536 [3:25:18<8:43:39,  1.50it/s]
 28%|██▊       | 18302/65536 [3:25:19<8:44:38,  1.50it/s]
 28%|██▊       | 18303/65536 [3:25:19<8:52:17,  1.48it/s]
 28%|██▊       | 18304/65536 [3:25:20<8:56:28,  1.47it/s]
 28%|██▊       | 18305/65536 [3:25:21<9:00:10,  1.46it/s]
 28%|██▊       | 18306/65536 [3:25:21<9:04:41,  1.45it/s]
 28%|██▊       | 18307/65536 [3:25:22<9:06:38,  1.44it/s]
 28%|██▊       | 18308/65536 [3:25:23<8:51:29,  1.48it/s]
 28%|██▊       | 18309/65536 [3:25:23<8:52:02,  1.48it/s]
 28%|██▊       | 18310/65536 [3:25:24<9:04:25,  1.45it/s]
 28%|██▊       | 18311/65536 [3:25:25<8:57:59,  1.46it/s]
 28%|██▊       | 18312/65536 [3:25:25<8:59:35,  1.46it/s]
 28%|██▊       | 18313/65536 [3:25:26<8:45:10,  1.50it/s]
 28%|██▊       | 18314/65536 [3:25:27<8:45:22,  1.50it/s]
 28%|██▊       | 18315/65536 [3:25:27<8:44:18,  1.50it/s]
 28%|██▊       | 18316/65536 [3:25:28<8:43:32,  1.50it/s]
 28%|██▊       | 18317/65536 [3:25:29<8:50:50,  1.48it/s]
 28%|██▊       | 18318/65536 [3:25:29<8:51:17,  1.48it/s]
 28%|██▊       | 18319/65536 [3:25:30<8:42:53,  1.51it/s]
 28%|██▊       | 18320/65536 [3:25:31<8:47:05,  1.49it/s]
                                                         
{'loss': 0.9175, 'learning_rate': 7.503979429411043e-07, 'epoch': 1130.86}

 28%|██▊       | 18320/65536 [3:25:31<8:47:05,  1.49it/s]
 28%|██▊       | 18321/65536 [3:25:31<8:43:10,  1.50it/s]
 28%|██▊       | 18322/65536 [3:25:32<8:44:37,  1.50it/s]
 28%|██▊       | 18323/65536 [3:25:33<9:07:53,  1.44it/s]
 28%|██▊       | 18324/65536 [3:25:33<8:56:11,  1.47it/s]
 28%|██▊       | 18325/65536 [3:25:34<8:46:50,  1.49it/s]
 28%|██▊       | 18326/65536 [3:25:35<8:50:15,  1.48it/s]
 28%|██▊       | 18327/65536 [3:25:35<8:54:55,  1.47it/s]
 28%|██▊       | 18328/65536 [3:25:36<8:48:53,  1.49it/s]
 28%|██▊       | 18329/65536 [3:25:37<9:07:11,  1.44it/s]
 28%|██▊       | 18330/65536 [3:25:38<8:56:31,  1.47it/s]
 28%|██▊       | 18331/65536 [3:25:38<9:01:05,  1.45it/s]
 28%|██▊       | 18332/65536 [3:25:39<8:54:40,  1.47it/s]
 28%|██▊       | 18333/65536 [3:25:40<8:50:50,  1.48it/s]
 28%|██▊       | 18334/65536 [3:25:40<8:51:17,  1.48it/s]
 28%|██▊       | 18335/65536 [3:25:41<8:56:14,  1.47it/s]
 28%|██▊       | 18336/65536 [3:25:42<8:58:47,  1.46it/s]
 28%|██▊       | 18337/65536 [3:25:42<9:05:14,  1.44it/s]
 28%|██▊       | 18338/65536 [3:25:43<8:48:26,  1.49it/s]
 28%|██▊       | 18339/65536 [3:25:44<9:14:49,  1.42it/s]
 28%|██▊       | 18340/65536 [3:25:44<9:05:01,  1.44it/s]
                                                         
{'loss': 0.9028, 'learning_rate': 7.501224439818783e-07, 'epoch': 1132.1}

 28%|██▊       | 18340/65536 [3:25:44<9:05:01,  1.44it/s]
 28%|██▊       | 18341/65536 [3:25:45<9:01:10,  1.45it/s]
 28%|██▊       | 18342/65536 [3:25:46<9:00:53,  1.45it/s]
 28%|██▊       | 18343/65536 [3:25:46<8:55:39,  1.47it/s]
 28%|██▊       | 18344/65536 [3:25:47<8:56:46,  1.47it/s]
 28%|██▊       | 18345/65536 [3:25:48<8:51:11,  1.48it/s]
 28%|██▊       | 18346/65536 [3:25:48<8:52:02,  1.48it/s]
 28%|██▊       | 18347/65536 [3:25:49<9:09:07,  1.43it/s]
 28%|██▊       | 18348/65536 [3:25:50<9:05:00,  1.44it/s]
 28%|██▊       | 18349/65536 [3:25:51<8:56:37,  1.47it/s]
 28%|██▊       | 18350/65536 [3:25:51<8:55:56,  1.47it/s]
 28%|██▊       | 18351/65536 [3:25:52<8:48:59,  1.49it/s]
 28%|██▊       | 18352/65536 [3:25:53<8:55:46,  1.47it/s]
 28%|██▊       | 18353/65536 [3:25:53<8:46:31,  1.49it/s]
 28%|██▊       | 18354/65536 [3:25:54<8:45:40,  1.50it/s]
 28%|██▊       | 18355/65536 [3:25:55<9:06:02,  1.44it/s]
 28%|██▊       | 18356/65536 [3:25:55<9:03:30,  1.45it/s]
 28%|██▊       | 18357/65536 [3:25:56<8:56:36,  1.47it/s]
 28%|██▊       | 18358/65536 [3:25:57<8:57:13,  1.46it/s]
 28%|██▊       | 18359/65536 [3:25:57<8:46:15,  1.49it/s]
 28%|██▊       | 18360/65536 [3:25:58<8:41:10,  1.51it/s]
                                                         
{'loss': 0.8964, 'learning_rate': 7.498469450226521e-07, 'epoch': 1133.33}

 28%|██▊       | 18360/65536 [3:25:58<8:41:10,  1.51it/s]
 28%|██▊       | 18361/65536 [3:25:59<8:39:48,  1.51it/s]
 28%|██▊       | 18362/65536 [3:25:59<8:42:23,  1.51it/s]
 28%|██▊       | 18363/65536 [3:26:00<8:45:21,  1.50it/s]
 28%|██▊       | 18364/65536 [3:26:01<8:36:46,  1.52it/s]
 28%|██▊       | 18365/65536 [3:26:01<8:44:32,  1.50it/s]
 28%|██▊       | 18366/65536 [3:26:02<9:04:42,  1.44it/s]
 28%|██▊       | 18367/65536 [3:26:03<8:58:35,  1.46it/s]
 28%|██▊       | 18368/65536 [3:26:03<8:55:49,  1.47it/s]
 28%|██▊       | 18369/65536 [3:26:04<8:44:59,  1.50it/s]
 28%|██▊       | 18370/65536 [3:26:05<8:50:14,  1.48it/s]
 28%|██▊       | 18371/65536 [3:26:06<9:23:12,  1.40it/s]
 28%|██▊       | 18372/65536 [3:26:06<9:13:31,  1.42it/s]
 28%|██▊       | 18373/65536 [3:26:07<8:53:40,  1.47it/s]
 28%|██▊       | 18374/65536 [3:26:07<8:45:39,  1.50it/s]
 28%|██▊       | 18375/65536 [3:26:08<8:48:07,  1.49it/s]
 28%|██▊       | 18376/65536 [3:26:09<8:43:19,  1.50it/s]
 28%|██▊       | 18377/65536 [3:26:09<8:40:46,  1.51it/s]
 28%|██▊       | 18378/65536 [3:26:10<8:54:34,  1.47it/s]
 28%|██▊       | 18379/65536 [3:26:11<8:56:07,  1.47it/s]
 28%|██▊       | 18380/65536 [3:26:12<9:00:28,  1.45it/s]
                                                         
{'loss': 0.905, 'learning_rate': 7.495714460634259e-07, 'epoch': 1134.57}

 28%|██▊       | 18380/65536 [3:26:12<9:00:28,  1.45it/s]
 28%|██▊       | 18381/65536 [3:26:12<8:58:14,  1.46it/s]
 28%|██▊       | 18382/65536 [3:26:13<8:58:04,  1.46it/s]
 28%|██▊       | 18383/65536 [3:26:14<8:56:19,  1.47it/s]
 28%|██▊       | 18384/65536 [3:26:14<8:44:18,  1.50it/s]
 28%|██▊       | 18385/65536 [3:26:15<8:57:55,  1.46it/s]
 28%|██▊       | 18386/65536 [3:26:16<8:49:35,  1.48it/s]
 28%|██▊       | 18387/65536 [3:26:16<8:39:07,  1.51it/s]
 28%|██▊       | 18388/65536 [3:26:17<9:07:58,  1.43it/s]
 28%|██▊       | 18389/65536 [3:26:18<8:51:43,  1.48it/s]
 28%|██▊       | 18390/65536 [3:26:18<9:02:34,  1.45it/s]
 28%|██▊       | 18391/65536 [3:26:19<8:55:29,  1.47it/s]
 28%|██▊       | 18392/65536 [3:26:20<8:50:23,  1.48it/s]
 28%|██▊       | 18393/65536 [3:26:20<9:06:39,  1.44it/s]
 28%|██▊       | 18394/65536 [3:26:21<8:58:39,  1.46it/s]
 28%|██▊       | 18395/65536 [3:26:22<8:51:53,  1.48it/s]
 28%|██▊       | 18396/65536 [3:26:22<8:47:50,  1.49it/s]
 28%|██▊       | 18397/65536 [3:26:23<8:39:06,  1.51it/s]
 28%|██▊       | 18398/65536 [3:26:24<9:01:47,  1.45it/s]
 28%|██▊       | 18399/65536 [3:26:24<8:48:50,  1.49it/s]
 28%|██▊       | 18400/65536 [3:26:25<8:43:17,  1.50it/s]
                                                         
{'loss': 0.9096, 'learning_rate': 7.492959471041998e-07, 'epoch': 1135.8}

 28%|██▊       | 18400/65536 [3:26:25<8:43:17,  1.50it/s]
 28%|██▊       | 18401/65536 [3:26:26<8:46:44,  1.49it/s]
 28%|██▊       | 18402/65536 [3:26:26<8:45:14,  1.50it/s]
 28%|██▊       | 18403/65536 [3:26:27<8:38:27,  1.52it/s]
 28%|██▊       | 18404/65536 [3:26:28<8:51:22,  1.48it/s]
 28%|██▊       | 18405/65536 [3:26:28<8:57:30,  1.46it/s]
 28%|██▊       | 18406/65536 [3:26:29<8:45:06,  1.50it/s]
 28%|██▊       | 18407/65536 [3:26:30<8:45:17,  1.50it/s]
 28%|██▊       | 18408/65536 [3:26:30<8:34:31,  1.53it/s]
 28%|██▊       | 18409/65536 [3:26:31<8:42:56,  1.50it/s]
 28%|██▊       | 18410/65536 [3:26:32<8:32:14,  1.53it/s]
 28%|██▊       | 18411/65536 [3:26:32<8:20:22,  1.57it/s]
 28%|██▊       | 18412/65536 [3:26:33<8:37:11,  1.52it/s]
 28%|██▊       | 18413/65536 [3:26:34<8:43:11,  1.50it/s]
 28%|██▊       | 18414/65536 [3:26:34<8:53:10,  1.47it/s]
 28%|██▊       | 18415/65536 [3:26:35<8:52:36,  1.47it/s]
 28%|██▊       | 18416/65536 [3:26:36<9:10:39,  1.43it/s]
 28%|██▊       | 18417/65536 [3:26:37<9:04:36,  1.44it/s]
 28%|██▊       | 18418/65536 [3:26:37<9:07:23,  1.43it/s]
 28%|██▊       | 18419/65536 [3:26:38<8:51:25,  1.48it/s]
 28%|██▊       | 18420/65536 [3:26:39<9:00:34,  1.45it/s]
                                                         
{'loss': 0.9315, 'learning_rate': 7.490204481449736e-07, 'epoch': 1137.04}

 28%|██▊       | 18420/65536 [3:26:39<9:00:34,  1.45it/s]
 28%|██▊       | 18421/65536 [3:26:39<9:02:12,  1.45it/s]
 28%|██▊       | 18422/65536 [3:26:40<9:00:10,  1.45it/s]
 28%|██▊       | 18423/65536 [3:26:41<8:52:57,  1.47it/s]
 28%|██▊       | 18424/65536 [3:26:41<9:06:23,  1.44it/s]
 28%|██▊       | 18425/65536 [3:26:42<8:53:56,  1.47it/s]
 28%|██▊       | 18426/65536 [3:26:43<8:48:38,  1.49it/s]
 28%|██▊       | 18427/65536 [3:26:43<8:54:42,  1.47it/s]
 28%|██▊       | 18428/65536 [3:26:44<8:42:46,  1.50it/s]
 28%|██▊       | 18429/65536 [3:26:45<8:32:52,  1.53it/s]
 28%|██▊       | 18430/65536 [3:26:45<8:37:23,  1.52it/s]
 28%|██▊       | 18431/65536 [3:26:46<8:40:05,  1.51it/s]
 28%|██▊       | 18432/65536 [3:26:47<8:35:56,  1.52it/s]
 28%|██▊       | 18433/65536 [3:26:47<8:39:29,  1.51it/s]
 28%|██▊       | 18434/65536 [3:26:48<8:46:34,  1.49it/s]
 28%|██▊       | 18435/65536 [3:26:49<8:42:08,  1.50it/s]
 28%|██▊       | 18436/65536 [3:26:49<8:59:21,  1.46it/s]
 28%|██▊       | 18437/65536 [3:26:50<9:02:09,  1.45it/s]
 28%|██▊       | 18438/65536 [3:26:51<8:58:44,  1.46it/s]
 28%|██▊       | 18439/65536 [3:26:51<8:59:13,  1.46it/s]
 28%|██▊       | 18440/65536 [3:26:52<8:57:30,  1.46it/s]
                                                         
{'loss': 0.9229, 'learning_rate': 7.487449491857475e-07, 'epoch': 1138.27}

 28%|██▊       | 18440/65536 [3:26:52<8:57:30,  1.46it/s]
 28%|██▊       | 18441/65536 [3:26:53<8:56:37,  1.46it/s]
 28%|██▊       | 18442/65536 [3:26:53<8:48:36,  1.48it/s]
 28%|██▊       | 18443/65536 [3:26:54<8:38:30,  1.51it/s]
 28%|██▊       | 18444/65536 [3:26:55<8:43:04,  1.50it/s]
 28%|██▊       | 18445/65536 [3:26:55<8:44:58,  1.50it/s]
 28%|██▊       | 18446/65536 [3:26:56<8:44:14,  1.50it/s]
 28%|██▊       | 18447/65536 [3:26:57<8:35:51,  1.52it/s]
 28%|██▊       | 18448/65536 [3:26:57<8:37:03,  1.52it/s]
 28%|██▊       | 18449/65536 [3:26:58<8:32:54,  1.53it/s]
 28%|██▊       | 18450/65536 [3:26:59<8:36:29,  1.52it/s]
 28%|██▊       | 18451/65536 [3:26:59<8:59:19,  1.46it/s]
 28%|██▊       | 18452/65536 [3:27:00<9:06:31,  1.44it/s]
 28%|██▊       | 18453/65536 [3:27:01<9:00:01,  1.45it/s]
 28%|██▊       | 18454/65536 [3:27:01<8:48:00,  1.49it/s]
 28%|██▊       | 18455/65536 [3:27:02<8:42:28,  1.50it/s]
 28%|██▊       | 18456/65536 [3:27:03<8:37:46,  1.52it/s]
 28%|██▊       | 18457/65536 [3:27:03<8:32:12,  1.53it/s]
 28%|██▊       | 18458/65536 [3:27:04<8:29:13,  1.54it/s]
 28%|██▊       | 18459/65536 [3:27:05<8:42:46,  1.50it/s]
 28%|██▊       | 18460/65536 [3:27:05<8:50:58,  1.48it/s]
                                                         
{'loss': 0.9285, 'learning_rate': 7.484694502265213e-07, 'epoch': 1139.51}

 28%|██▊       | 18460/65536 [3:27:05<8:50:58,  1.48it/s]
 28%|██▊       | 18461/65536 [3:27:06<8:50:53,  1.48it/s]
 28%|██▊       | 18462/65536 [3:27:07<9:10:30,  1.43it/s]
 28%|██▊       | 18463/65536 [3:27:08<9:11:37,  1.42it/s]
 28%|██▊       | 18464/65536 [3:27:08<9:01:08,  1.45it/s]
 28%|██▊       | 18465/65536 [3:27:09<9:00:58,  1.45it/s]
 28%|██▊       | 18466/65536 [3:27:10<8:55:41,  1.46it/s]
 28%|██▊       | 18467/65536 [3:27:10<8:46:39,  1.49it/s]
 28%|██▊       | 18468/65536 [3:27:11<8:54:50,  1.47it/s]
 28%|██▊       | 18469/65536 [3:27:12<9:15:21,  1.41it/s]
 28%|██▊       | 18470/65536 [3:27:12<8:56:13,  1.46it/s]
 28%|██▊       | 18471/65536 [3:27:13<8:48:07,  1.49it/s]
 28%|██▊       | 18472/65536 [3:27:14<8:42:14,  1.50it/s]
 28%|██▊       | 18473/65536 [3:27:14<8:49:27,  1.48it/s]
 28%|██▊       | 18474/65536 [3:27:15<8:53:53,  1.47it/s]
 28%|██▊       | 18475/65536 [3:27:16<8:56:33,  1.46it/s]
 28%|██▊       | 18476/65536 [3:27:16<8:50:11,  1.48it/s]
 28%|██▊       | 18477/65536 [3:27:17<8:51:21,  1.48it/s]
 28%|██▊       | 18478/65536 [3:27:18<8:55:34,  1.46it/s]
 28%|██▊       | 18479/65536 [3:27:18<9:00:53,  1.45it/s]
 28%|██▊       | 18480/65536 [3:27:19<8:51:15,  1.48it/s]
                                                         
{'loss': 0.9038, 'learning_rate': 7.481939512672952e-07, 'epoch': 1140.74}

 28%|██▊       | 18480/65536 [3:27:19<8:51:15,  1.48it/s]
 28%|██▊       | 18481/65536 [3:27:20<8:42:36,  1.50it/s]
 28%|██▊       | 18482/65536 [3:27:20<8:33:54,  1.53it/s]
 28%|██▊       | 18483/65536 [3:27:21<8:35:04,  1.52it/s]
 28%|██▊       | 18484/65536 [3:27:22<8:48:49,  1.48it/s]
 28%|██▊       | 18485/65536 [3:27:23<9:10:25,  1.42it/s]
 28%|██▊       | 18486/65536 [3:27:23<9:10:10,  1.43it/s]
 28%|██▊       | 18487/65536 [3:27:24<8:53:59,  1.47it/s]
 28%|██▊       | 18488/65536 [3:27:25<9:05:48,  1.44it/s]
 28%|██▊       | 18489/65536 [3:27:25<9:06:27,  1.43it/s]
 28%|██▊       | 18490/65536 [3:27:26<9:12:20,  1.42it/s]
 28%|██▊       | 18491/65536 [3:27:27<8:52:46,  1.47it/s]
 28%|██▊       | 18492/65536 [3:27:27<8:59:32,  1.45it/s]
 28%|██▊       | 18493/65536 [3:27:28<8:55:54,  1.46it/s]
 28%|██▊       | 18494/65536 [3:27:29<8:43:25,  1.50it/s]
 28%|██▊       | 18495/65536 [3:27:29<8:47:19,  1.49it/s]
 28%|██▊       | 18496/65536 [3:27:30<8:45:45,  1.49it/s]
 28%|██▊       | 18497/65536 [3:27:31<8:43:39,  1.50it/s]
 28%|██▊       | 18498/65536 [3:27:31<8:44:14,  1.50it/s]
 28%|██▊       | 18499/65536 [3:27:32<8:36:15,  1.52it/s]
 28%|██▊       | 18500/65536 [3:27:33<8:27:52,  1.54it/s]
                                                         
{'loss': 0.9019, 'learning_rate': 7.47918452308069e-07, 'epoch': 1141.98}

 28%|██▊       | 18500/65536 [3:27:33<8:27:52,  1.54it/s]
 28%|██▊       | 18501/65536 [3:27:33<9:09:47,  1.43it/s]
 28%|██▊       | 18502/65536 [3:27:34<9:00:07,  1.45it/s]
 28%|██▊       | 18503/65536 [3:27:35<9:05:46,  1.44it/s]
 28%|██▊       | 18504/65536 [3:27:35<8:49:24,  1.48it/s]
 28%|██▊       | 18505/65536 [3:27:36<9:07:15,  1.43it/s]
 28%|██▊       | 18506/65536 [3:27:37<9:00:26,  1.45it/s]
 28%|██▊       | 18507/65536 [3:27:37<8:54:33,  1.47it/s]
 28%|██▊       | 18508/65536 [3:27:38<8:45:57,  1.49it/s]
 28%|██▊       | 18509/65536 [3:27:39<8:45:20,  1.49it/s]
 28%|██▊       | 18510/65536 [3:27:40<9:02:42,  1.44it/s]
 28%|██▊       | 18511/65536 [3:27:40<9:07:48,  1.43it/s]
 28%|██▊       | 18512/65536 [3:27:41<9:00:49,  1.45it/s]
 28%|██▊       | 18513/65536 [3:27:42<8:52:55,  1.47it/s]
 28%|██▊       | 18514/65536 [3:27:42<8:40:26,  1.51it/s]
 28%|██▊       | 18515/65536 [3:27:43<8:32:30,  1.53it/s]
 28%|██▊       | 18516/65536 [3:27:44<8:32:00,  1.53it/s]
 28%|██▊       | 18517/65536 [3:27:44<8:34:57,  1.52it/s]
 28%|██▊       | 18518/65536 [3:27:45<8:43:46,  1.50it/s]
 28%|██▊       | 18519/65536 [3:27:46<8:55:48,  1.46it/s]
 28%|██▊       | 18520/65536 [3:27:46<9:00:33,  1.45it/s]
                                                         
{'loss': 0.9029, 'learning_rate': 7.476429533488429e-07, 'epoch': 1143.21}

 28%|██▊       | 18520/65536 [3:27:46<9:00:33,  1.45it/s]
 28%|██▊       | 18521/65536 [3:27:47<9:01:07,  1.45it/s]
 28%|██▊       | 18522/65536 [3:27:48<8:52:07,  1.47it/s]
 28%|██▊       | 18523/65536 [3:27:48<8:46:57,  1.49it/s]
 28%|██▊       | 18524/65536 [3:27:49<8:41:07,  1.50it/s]
 28%|██▊       | 18525/65536 [3:27:50<8:44:28,  1.49it/s]
 28%|██▊       | 18526/65536 [3:27:50<8:48:28,  1.48it/s]
 28%|██▊       | 18527/65536 [3:27:51<8:44:57,  1.49it/s]
 28%|██▊       | 18528/65536 [3:27:52<8:59:02,  1.45it/s]
 28%|██▊       | 18529/65536 [3:27:52<8:50:07,  1.48it/s]
 28%|██▊       | 18530/65536 [3:27:53<8:47:32,  1.49it/s]
 28%|██▊       | 18531/65536 [3:27:54<8:52:30,  1.47it/s]
 28%|██▊       | 18532/65536 [3:27:54<8:53:03,  1.47it/s]
 28%|██▊       | 18533/65536 [3:27:55<9:06:45,  1.43it/s]
 28%|██▊       | 18534/65536 [3:27:56<8:51:23,  1.47it/s]
 28%|██▊       | 18535/65536 [3:27:56<8:40:05,  1.51it/s]
 28%|██▊       | 18536/65536 [3:27:57<8:34:00,  1.52it/s]
 28%|██▊       | 18537/65536 [3:27:58<8:40:03,  1.51it/s]
 28%|██▊       | 18538/65536 [3:27:58<8:33:09,  1.53it/s]
 28%|██▊       | 18539/65536 [3:27:59<8:35:58,  1.52it/s]
 28%|██▊       | 18540/65536 [3:28:00<8:54:34,  1.47it/s]
                                                         
{'loss': 0.9179, 'learning_rate': 7.473674543896168e-07, 'epoch': 1144.44}

 28%|██▊       | 18540/65536 [3:28:00<8:54:34,  1.47it/s]
 28%|██▊       | 18541/65536 [3:28:00<9:07:48,  1.43it/s]
 28%|██▊       | 18542/65536 [3:28:01<8:49:53,  1.48it/s]
 28%|██▊       | 18543/65536 [3:28:02<8:37:20,  1.51it/s]
 28%|██▊       | 18544/65536 [3:28:02<8:46:45,  1.49it/s]
 28%|██▊       | 18545/65536 [3:28:03<8:42:35,  1.50it/s]
 28%|██▊       | 18546/65536 [3:28:04<8:55:43,  1.46it/s]
 28%|██▊       | 18547/65536 [3:28:04<8:46:09,  1.49it/s]
 28%|██▊       | 18548/65536 [3:28:05<8:53:17,  1.47it/s]
 28%|██▊       | 18549/65536 [3:28:06<8:53:10,  1.47it/s]
 28%|██▊       | 18550/65536 [3:28:07<9:12:45,  1.42it/s]
 28%|██▊       | 18551/65536 [3:28:07<9:14:38,  1.41it/s]
 28%|██▊       | 18552/65536 [3:28:08<9:11:32,  1.42it/s]
 28%|██▊       | 18553/65536 [3:28:09<9:03:57,  1.44it/s]
 28%|██▊       | 18554/65536 [3:28:09<8:51:12,  1.47it/s]
 28%|██▊       | 18555/65536 [3:28:10<8:53:50,  1.47it/s]
 28%|██▊       | 18556/65536 [3:28:11<8:46:19,  1.49it/s]
 28%|██▊       | 18557/65536 [3:28:11<8:42:05,  1.50it/s]
 28%|██▊       | 18558/65536 [3:28:12<8:41:13,  1.50it/s]
 28%|██▊       | 18559/65536 [3:28:13<8:43:09,  1.50it/s]
 28%|██▊       | 18560/65536 [3:28:13<8:38:04,  1.51it/s]
                                                         
{'loss': 0.9076, 'learning_rate': 7.470919554303906e-07, 'epoch': 1145.68}

 28%|██▊       | 18560/65536 [3:28:13<8:38:04,  1.51it/s]
 28%|██▊       | 18561/65536 [3:28:14<8:48:10,  1.48it/s]
 28%|██▊       | 18562/65536 [3:28:15<8:44:28,  1.49it/s]
 28%|██▊       | 18563/65536 [3:28:15<8:43:21,  1.50it/s]
 28%|██▊       | 18564/65536 [3:28:16<8:48:55,  1.48it/s]
 28%|██▊       | 18565/65536 [3:28:17<8:50:16,  1.48it/s]
 28%|██▊       | 18566/65536 [3:28:17<9:07:11,  1.43it/s]
 28%|██▊       | 18567/65536 [3:28:18<8:55:00,  1.46it/s]
 28%|██▊       | 18568/65536 [3:28:19<8:48:19,  1.48it/s]
 28%|██▊       | 18569/65536 [3:28:19<8:40:39,  1.50it/s]
 28%|██▊       | 18570/65536 [3:28:20<8:43:34,  1.50it/s]
 28%|██▊       | 18571/65536 [3:28:21<8:47:45,  1.48it/s]
 28%|██▊       | 18572/65536 [3:28:21<8:43:50,  1.49it/s]
 28%|██▊       | 18573/65536 [3:28:22<8:43:37,  1.49it/s]
 28%|██▊       | 18574/65536 [3:28:23<8:44:00,  1.49it/s]
 28%|██▊       | 18575/65536 [3:28:23<8:43:38,  1.49it/s]
 28%|██▊       | 18576/65536 [3:28:24<8:44:10,  1.49it/s]
 28%|██▊       | 18577/65536 [3:28:25<8:46:40,  1.49it/s]
 28%|██▊       | 18578/65536 [3:28:25<8:46:10,  1.49it/s]
 28%|██▊       | 18579/65536 [3:28:26<8:48:58,  1.48it/s]
 28%|██▊       | 18580/65536 [3:28:27<8:51:08,  1.47it/s]
                                                         
{'loss': 0.9066, 'learning_rate': 7.468164564711646e-07, 'epoch': 1146.91}

 28%|██▊       | 18580/65536 [3:28:27<8:51:08,  1.47it/s]
 28%|██▊       | 18581/65536 [3:28:27<8:36:18,  1.52it/s]
 28%|██▊       | 18582/65536 [3:28:28<9:06:45,  1.43it/s]
 28%|██▊       | 18583/65536 [3:28:29<8:47:24,  1.48it/s]
 28%|██▊       | 18584/65536 [3:28:30<8:55:59,  1.46it/s]
 28%|██▊       | 18585/65536 [3:28:30<8:53:29,  1.47it/s]
 28%|██▊       | 18586/65536 [3:28:31<8:50:40,  1.47it/s]
 28%|██▊       | 18587/65536 [3:28:32<8:43:13,  1.50it/s]
 28%|██▊       | 18588/65536 [3:28:32<8:31:55,  1.53it/s]
 28%|██▊       | 18589/65536 [3:28:33<8:28:32,  1.54it/s]
 28%|██▊       | 18590/65536 [3:28:34<8:40:53,  1.50it/s]
 28%|██▊       | 18591/65536 [3:28:34<8:46:55,  1.48it/s]
 28%|██▊       | 18592/65536 [3:28:35<8:36:15,  1.52it/s]
 28%|██▊       | 18593/65536 [3:28:35<8:35:05,  1.52it/s]
 28%|██▊       | 18594/65536 [3:28:36<8:46:52,  1.48it/s]
 28%|██▊       | 18595/65536 [3:28:37<8:37:22,  1.51it/s]
 28%|██▊       | 18596/65536 [3:28:37<8:35:31,  1.52it/s]
 28%|██▊       | 18597/65536 [3:28:38<8:28:18,  1.54it/s]
 28%|██▊       | 18598/65536 [3:28:39<8:53:18,  1.47it/s]
 28%|██▊       | 18599/65536 [3:28:39<8:43:11,  1.50it/s]
 28%|██▊       | 18600/65536 [3:28:40<8:26:03,  1.55it/s]
                                                         
{'loss': 0.9404, 'learning_rate': 7.465409575119383e-07, 'epoch': 1148.15}

 28%|██▊       | 18600/65536 [3:28:40<8:26:03,  1.55it/s]
 28%|██▊       | 18601/65536 [3:28:41<8:33:30,  1.52it/s]
 28%|██▊       | 18602/65536 [3:28:41<8:34:30,  1.52it/s]
 28%|██▊       | 18603/65536 [3:28:42<8:45:48,  1.49it/s]
 28%|██▊       | 18604/65536 [3:28:43<8:46:47,  1.48it/s]
 28%|██▊       | 18605/65536 [3:28:43<8:44:25,  1.49it/s]
 28%|██▊       | 18606/65536 [3:28:44<8:42:44,  1.50it/s]
 28%|██▊       | 18607/65536 [3:28:45<8:37:16,  1.51it/s]
 28%|██▊       | 18608/65536 [3:28:46<8:53:35,  1.47it/s]
 28%|██▊       | 18609/65536 [3:28:46<8:57:57,  1.45it/s]
 28%|██▊       | 18610/65536 [3:28:47<8:59:44,  1.45it/s]
 28%|██▊       | 18611/65536 [3:28:48<8:49:47,  1.48it/s]
 28%|██▊       | 18612/65536 [3:28:48<8:41:13,  1.50it/s]
 28%|██▊       | 18613/65536 [3:28:49<8:47:30,  1.48it/s]
 28%|██▊       | 18614/65536 [3:28:50<9:08:39,  1.43it/s]
 28%|██▊       | 18615/65536 [3:28:50<8:56:07,  1.46it/s]
 28%|██▊       | 18616/65536 [3:28:51<8:55:15,  1.46it/s]
 28%|██▊       | 18617/65536 [3:28:52<8:42:58,  1.50it/s]
 28%|██▊       | 18618/65536 [3:28:52<8:44:28,  1.49it/s]
 28%|██▊       | 18619/65536 [3:28:53<8:40:12,  1.50it/s]
 28%|██▊       | 18620/65536 [3:28:54<8:26:48,  1.54it/s]
                                                         
{'loss': 0.9179, 'learning_rate': 7.462654585527122e-07, 'epoch': 1149.38}

 28%|██▊       | 18620/65536 [3:28:54<8:26:48,  1.54it/s]
 28%|██▊       | 18621/65536 [3:28:54<8:22:40,  1.56it/s]
 28%|██▊       | 18622/65536 [3:28:55<8:21:31,  1.56it/s]
 28%|██▊       | 18623/65536 [3:28:55<8:15:47,  1.58it/s]
 28%|██▊       | 18624/65536 [3:28:56<8:28:24,  1.54it/s]
 28%|██▊       | 18625/65536 [3:28:57<8:43:13,  1.49it/s]
 28%|██▊       | 18626/65536 [3:28:57<8:32:03,  1.53it/s]
 28%|██▊       | 18627/65536 [3:28:58<8:29:12,  1.54it/s]
 28%|██▊       | 18628/65536 [3:28:59<8:43:47,  1.49it/s]
 28%|██▊       | 18629/65536 [3:29:00<9:02:33,  1.44it/s]
 28%|██▊       | 18630/65536 [3:29:00<9:07:05,  1.43it/s]
 28%|██▊       | 18631/65536 [3:29:01<9:14:34,  1.41it/s]
 28%|██▊       | 18632/65536 [3:29:02<9:18:34,  1.40it/s]
 28%|██▊       | 18633/65536 [3:29:02<9:09:54,  1.42it/s]
 28%|██▊       | 18634/65536 [3:29:03<8:51:40,  1.47it/s]
 28%|██▊       | 18635/65536 [3:29:04<8:56:32,  1.46it/s]
 28%|██▊       | 18636/65536 [3:29:04<9:03:49,  1.44it/s]
 28%|██▊       | 18637/65536 [3:29:05<9:04:07,  1.44it/s]
 28%|██▊       | 18638/65536 [3:29:06<8:49:53,  1.48it/s]
 28%|██▊       | 18639/65536 [3:29:06<8:35:39,  1.52it/s]
 28%|██▊       | 18640/65536 [3:29:07<8:32:59,  1.52it/s]
                                                         
{'loss': 0.8964, 'learning_rate': 7.45989959593486e-07, 'epoch': 1150.62}

 28%|██▊       | 18640/65536 [3:29:07<8:32:59,  1.52it/s]
 28%|██▊       | 18641/65536 [3:29:08<8:29:52,  1.53it/s]
 28%|██▊       | 18642/65536 [3:29:08<8:20:10,  1.56it/s]
 28%|██▊       | 18643/65536 [3:29:09<8:30:27,  1.53it/s]
 28%|██▊       | 18644/65536 [3:29:10<8:30:05,  1.53it/s]
 28%|██▊       | 18645/65536 [3:29:10<8:53:04,  1.47it/s]
 28%|██▊       | 18646/65536 [3:29:11<8:54:52,  1.46it/s]
 28%|██▊       | 18647/65536 [3:29:12<9:09:27,  1.42it/s]
 28%|██▊       | 18648/65536 [3:29:13<9:08:43,  1.42it/s]
 28%|██▊       | 18649/65536 [3:29:13<9:05:49,  1.43it/s]
 28%|██▊       | 18650/65536 [3:29:14<8:58:56,  1.45it/s]
 28%|██▊       | 18651/65536 [3:29:15<8:46:13,  1.48it/s]
 28%|██▊       | 18652/65536 [3:29:15<8:49:59,  1.47it/s]
 28%|██▊       | 18653/65536 [3:29:16<8:50:41,  1.47it/s]
 28%|██▊       | 18654/65536 [3:29:17<9:07:36,  1.43it/s]
 28%|██▊       | 18655/65536 [3:29:17<9:05:11,  1.43it/s]
 28%|██▊       | 18656/65536 [3:29:18<8:57:46,  1.45it/s]
 28%|██▊       | 18657/65536 [3:29:19<8:42:47,  1.49it/s]
 28%|██▊       | 18658/65536 [3:29:19<8:48:48,  1.48it/s]
 28%|██▊       | 18659/65536 [3:29:20<8:50:48,  1.47it/s]
 28%|██▊       | 18660/65536 [3:29:21<8:38:48,  1.51it/s]
                                                         
{'loss': 0.887, 'learning_rate': 7.457144606342598e-07, 'epoch': 1151.85}

 28%|██▊       | 18660/65536 [3:29:21<8:38:48,  1.51it/s]
 28%|██▊       | 18661/65536 [3:29:21<8:43:27,  1.49it/s]
 28%|██▊       | 18662/65536 [3:29:22<8:23:02,  1.55it/s]
 28%|██▊       | 18663/65536 [3:29:23<8:46:31,  1.48it/s]
 28%|██▊       | 18664/65536 [3:29:23<8:45:14,  1.49it/s]
 28%|██▊       | 18665/65536 [3:29:24<8:59:28,  1.45it/s]
 28%|██▊       | 18666/65536 [3:29:25<8:43:02,  1.49it/s]
 28%|██▊       | 18667/65536 [3:29:25<8:35:39,  1.51it/s]
 28%|██▊       | 18668/65536 [3:29:26<8:36:22,  1.51it/s]
 28%|██▊       | 18669/65536 [3:29:27<8:41:30,  1.50it/s]
 28%|██▊       | 18670/65536 [3:29:27<8:46:15,  1.48it/s]
 28%|██▊       | 18671/65536 [3:29:28<8:44:27,  1.49it/s]
 28%|██▊       | 18672/65536 [3:29:29<8:44:23,  1.49it/s]
 28%|██▊       | 18673/65536 [3:29:29<8:50:28,  1.47it/s]
 28%|██▊       | 18674/65536 [3:29:30<8:38:07,  1.51it/s]
 28%|██▊       | 18675/65536 [3:29:31<8:19:31,  1.56it/s]
 28%|██▊       | 18676/65536 [3:29:31<8:30:42,  1.53it/s]
 28%|██▊       | 18677/65536 [3:29:32<8:27:41,  1.54it/s]
 29%|██▊       | 18678/65536 [3:29:33<8:45:28,  1.49it/s]
 29%|██▊       | 18679/65536 [3:29:33<9:07:14,  1.43it/s]
 29%|██▊       | 18680/65536 [3:29:34<9:05:13,  1.43it/s]
                                                         
{'loss': 0.9132, 'learning_rate': 7.454389616750337e-07, 'epoch': 1153.09}

 29%|██▊       | 18680/65536 [3:29:34<9:05:13,  1.43it/s]
 29%|██▊       | 18681/65536 [3:29:35<9:02:04,  1.44it/s]
 29%|██▊       | 18682/65536 [3:29:35<8:46:19,  1.48it/s]
 29%|██▊       | 18683/65536 [3:29:36<9:01:03,  1.44it/s]
 29%|██▊       | 18684/65536 [3:29:37<8:52:46,  1.47it/s]
 29%|██▊       | 18685/65536 [3:29:37<8:45:40,  1.49it/s]
 29%|██▊       | 18686/65536 [3:29:38<8:44:27,  1.49it/s]
 29%|██▊       | 18687/65536 [3:29:39<9:07:05,  1.43it/s]
 29%|██▊       | 18688/65536 [3:29:40<8:55:26,  1.46it/s]
 29%|██▊       | 18689/65536 [3:29:40<8:53:14,  1.46it/s]
 29%|██▊       | 18690/65536 [3:29:41<8:54:13,  1.46it/s]
 29%|██▊       | 18691/65536 [3:29:42<8:32:00,  1.52it/s]
 29%|██▊       | 18692/65536 [3:29:42<8:31:17,  1.53it/s]
 29%|██▊       | 18693/65536 [3:29:43<8:31:46,  1.53it/s]
 29%|██▊       | 18694/65536 [3:29:43<8:35:59,  1.51it/s]
 29%|██▊       | 18695/65536 [3:29:44<8:43:35,  1.49it/s]
 29%|██▊       | 18696/65536 [3:29:45<8:37:18,  1.51it/s]
 29%|██▊       | 18697/65536 [3:29:46<8:48:27,  1.48it/s]
 29%|██▊       | 18698/65536 [3:29:46<8:44:42,  1.49it/s]
 29%|██▊       | 18699/65536 [3:29:47<8:50:37,  1.47it/s]
 29%|██▊       | 18700/65536 [3:29:48<8:34:36,  1.52it/s]
                                                         
{'loss': 0.9178, 'learning_rate': 7.451634627158074e-07, 'epoch': 1154.32}

 29%|██▊       | 18700/65536 [3:29:48<8:34:36,  1.52it/s]
 29%|██▊       | 18701/65536 [3:29:48<8:37:51,  1.51it/s]
 29%|██▊       | 18702/65536 [3:29:49<8:38:43,  1.50it/s]
 29%|██▊       | 18703/65536 [3:29:50<8:37:36,  1.51it/s]
 29%|██▊       | 18704/65536 [3:29:50<8:49:26,  1.47it/s]
 29%|██▊       | 18705/65536 [3:29:51<9:01:37,  1.44it/s]
 29%|██▊       | 18706/65536 [3:29:52<8:49:44,  1.47it/s]
 29%|██▊       | 18707/65536 [3:29:52<8:46:25,  1.48it/s]
 29%|██▊       | 18708/65536 [3:29:53<8:45:48,  1.48it/s]
 29%|██▊       | 18709/65536 [3:29:54<8:48:08,  1.48it/s]
 29%|██▊       | 18710/65536 [3:29:54<8:47:01,  1.48it/s]
 29%|██▊       | 18711/65536 [3:29:55<8:37:48,  1.51it/s]
 29%|██▊       | 18712/65536 [3:29:56<8:49:46,  1.47it/s]
 29%|██▊       | 18713/65536 [3:29:56<9:01:53,  1.44it/s]
 29%|██▊       | 18714/65536 [3:29:57<8:53:54,  1.46it/s]
 29%|██▊       | 18715/65536 [3:29:58<8:56:00,  1.46it/s]
 29%|██▊       | 18716/65536 [3:29:58<8:56:42,  1.45it/s]
 29%|██▊       | 18717/65536 [3:29:59<8:47:28,  1.48it/s]
 29%|██▊       | 18718/65536 [3:30:00<8:40:23,  1.50it/s]
 29%|██▊       | 18719/65536 [3:30:00<8:32:37,  1.52it/s]
 29%|██▊       | 18720/65536 [3:30:01<8:45:23,  1.49it/s]
                                                         
{'loss': 0.8846, 'learning_rate': 7.448879637565813e-07, 'epoch': 1155.56}

 29%|██▊       | 18720/65536 [3:30:01<8:45:23,  1.49it/s]
 29%|██▊       | 18721/65536 [3:30:02<8:39:59,  1.50it/s]
 29%|██▊       | 18722/65536 [3:30:02<8:34:21,  1.52it/s]
 29%|██▊       | 18723/65536 [3:30:03<8:39:59,  1.50it/s]
 29%|██▊       | 18724/65536 [3:30:04<8:51:01,  1.47it/s]
 29%|██▊       | 18725/65536 [3:30:04<8:41:06,  1.50it/s]
 29%|██▊       | 18726/65536 [3:30:05<8:41:55,  1.49it/s]
 29%|██▊       | 18727/65536 [3:30:06<8:52:43,  1.46it/s]
 29%|██▊       | 18728/65536 [3:30:07<9:09:45,  1.42it/s]
 29%|██▊       | 18729/65536 [3:30:07<8:58:50,  1.45it/s]
 29%|██▊       | 18730/65536 [3:30:08<9:01:23,  1.44it/s]
 29%|██▊       | 18731/65536 [3:30:09<8:54:50,  1.46it/s]
 29%|██▊       | 18732/65536 [3:30:09<8:41:55,  1.49it/s]
 29%|██▊       | 18733/65536 [3:30:10<8:31:03,  1.53it/s]
 29%|██▊       | 18734/65536 [3:30:10<8:22:52,  1.55it/s]
 29%|██▊       | 18735/65536 [3:30:11<8:19:43,  1.56it/s]
 29%|██▊       | 18736/65536 [3:30:12<8:22:07,  1.55it/s]
 29%|██▊       | 18737/65536 [3:30:12<8:29:16,  1.53it/s]
 29%|██▊       | 18738/65536 [3:30:13<8:37:54,  1.51it/s]
 29%|██▊       | 18739/65536 [3:30:14<8:22:56,  1.55it/s]
 29%|██▊       | 18740/65536 [3:30:14<8:52:15,  1.47it/s]
                                                         
{'loss': 0.9032, 'learning_rate': 7.446124647973551e-07, 'epoch': 1156.79}

 29%|██▊       | 18740/65536 [3:30:14<8:52:15,  1.47it/s]
 29%|██▊       | 18741/65536 [3:30:15<8:48:43,  1.48it/s]
 29%|██▊       | 18742/65536 [3:30:16<8:46:46,  1.48it/s]
 29%|██▊       | 18743/65536 [3:30:16<8:51:39,  1.47it/s]
 29%|██▊       | 18744/65536 [3:30:17<9:21:21,  1.39it/s]
 29%|██▊       | 18745/65536 [3:30:18<8:58:42,  1.45it/s]
 29%|██▊       | 18746/65536 [3:30:19<9:05:20,  1.43it/s]
 29%|██▊       | 18747/65536 [3:30:19<9:00:51,  1.44it/s]
 29%|██▊       | 18748/65536 [3:30:20<8:41:34,  1.50it/s]
 29%|██▊       | 18749/65536 [3:30:21<8:34:12,  1.52it/s]
 29%|██▊       | 18750/65536 [3:30:21<8:30:45,  1.53it/s]
 29%|██▊       | 18751/65536 [3:30:22<8:43:22,  1.49it/s]
 29%|██▊       | 18752/65536 [3:30:23<8:32:15,  1.52it/s]
 29%|██▊       | 18753/65536 [3:30:23<8:31:01,  1.53it/s]
 29%|██▊       | 18754/65536 [3:30:24<8:44:31,  1.49it/s]
 29%|██▊       | 18755/65536 [3:30:25<8:37:41,  1.51it/s]
 29%|██▊       | 18756/65536 [3:30:25<8:42:58,  1.49it/s]
 29%|██▊       | 18757/65536 [3:30:26<8:41:38,  1.49it/s]
 29%|██▊       | 18758/65536 [3:30:27<8:35:02,  1.51it/s]
 29%|██▊       | 18759/65536 [3:30:27<8:44:05,  1.49it/s]
 29%|██▊       | 18760/65536 [3:30:28<9:05:30,  1.43it/s]
                                                         
{'loss': 0.9119, 'learning_rate': 7.44336965838129e-07, 'epoch': 1158.02}

 29%|██▊       | 18760/65536 [3:30:28<9:05:30,  1.43it/s]
 29%|██▊       | 18761/65536 [3:30:29<8:58:43,  1.45it/s]
 29%|██▊       | 18762/65536 [3:30:29<8:57:45,  1.45it/s]
 29%|██▊       | 18763/65536 [3:30:30<8:56:00,  1.45it/s]
 29%|██▊       | 18764/65536 [3:30:31<8:40:17,  1.50it/s]
 29%|██▊       | 18765/65536 [3:30:31<8:42:23,  1.49it/s]
 29%|██▊       | 18766/65536 [3:30:32<8:34:48,  1.51it/s]
 29%|██▊       | 18767/65536 [3:30:33<8:44:29,  1.49it/s]
 29%|██▊       | 18768/65536 [3:30:33<8:39:24,  1.50it/s]
 29%|██▊       | 18769/65536 [3:30:34<8:40:24,  1.50it/s]
 29%|██▊       | 18770/65536 [3:30:35<8:17:46,  1.57it/s]
 29%|██▊       | 18771/65536 [3:30:35<8:31:14,  1.52it/s]
 29%|██▊       | 18772/65536 [3:30:36<8:24:30,  1.54it/s]
 29%|██▊       | 18773/65536 [3:30:37<8:20:44,  1.56it/s]
 29%|██▊       | 18774/65536 [3:30:37<8:20:40,  1.56it/s]
 29%|██▊       | 18775/65536 [3:30:38<8:26:04,  1.54it/s]
 29%|██▊       | 18776/65536 [3:30:39<9:12:07,  1.41it/s]
 29%|██▊       | 18777/65536 [3:30:39<8:51:26,  1.47it/s]
 29%|██▊       | 18778/65536 [3:30:40<8:54:27,  1.46it/s]
 29%|██▊       | 18779/65536 [3:30:41<8:46:44,  1.48it/s]
 29%|██▊       | 18780/65536 [3:30:41<9:12:02,  1.41it/s]
                                                         
{'loss': 0.9126, 'learning_rate': 7.440614668789029e-07, 'epoch': 1159.26}

 29%|██▊       | 18780/65536 [3:30:41<9:12:02,  1.41it/s]
 29%|██▊       | 18781/65536 [3:30:42<8:51:49,  1.47it/s]
 29%|██▊       | 18782/65536 [3:30:43<8:46:55,  1.48it/s]
 29%|██▊       | 18783/65536 [3:30:43<8:43:48,  1.49it/s]
 29%|██▊       | 18784/65536 [3:30:44<8:44:56,  1.48it/s]
 29%|██▊       | 18785/65536 [3:30:45<8:40:58,  1.50it/s]
 29%|██▊       | 18786/65536 [3:30:45<8:47:22,  1.48it/s]
 29%|██▊       | 18787/65536 [3:30:46<8:38:07,  1.50it/s]
 29%|██▊       | 18788/65536 [3:30:47<8:35:14,  1.51it/s]
 29%|██▊       | 18789/65536 [3:30:47<8:25:40,  1.54it/s]
 29%|██▊       | 18790/65536 [3:30:48<8:43:51,  1.49it/s]
 29%|██▊       | 18791/65536 [3:30:49<8:34:38,  1.51it/s]
 29%|██▊       | 18792/65536 [3:30:49<8:45:16,  1.48it/s]
 29%|██▊       | 18793/65536 [3:30:50<9:13:58,  1.41it/s]
 29%|██▊       | 18794/65536 [3:30:51<8:55:17,  1.46it/s]
 29%|██▊       | 18795/65536 [3:30:51<8:48:06,  1.48it/s]
 29%|██▊       | 18796/65536 [3:30:52<8:50:25,  1.47it/s]
 29%|██▊       | 18797/65536 [3:30:53<8:47:51,  1.48it/s]
 29%|██▊       | 18798/65536 [3:30:53<8:41:58,  1.49it/s]
 29%|██▊       | 18799/65536 [3:30:54<8:51:25,  1.47it/s]
 29%|██▊       | 18800/65536 [3:30:55<8:43:09,  1.49it/s]
                                                         
{'loss': 0.9012, 'learning_rate': 7.437859679196767e-07, 'epoch': 1160.49}

 29%|██▊       | 18800/65536 [3:30:55<8:43:09,  1.49it/s]
 29%|██▊       | 18801/65536 [3:30:56<8:48:07,  1.47it/s]
 29%|██▊       | 18802/65536 [3:30:56<8:42:11,  1.49it/s]
 29%|██▊       | 18803/65536 [3:30:57<8:40:47,  1.50it/s]
 29%|██▊       | 18804/65536 [3:30:57<8:34:58,  1.51it/s]
 29%|██▊       | 18805/65536 [3:30:58<8:35:15,  1.51it/s]
 29%|██▊       | 18806/65536 [3:30:59<8:49:34,  1.47it/s]
 29%|██▊       | 18807/65536 [3:31:00<8:47:47,  1.48it/s]
 29%|██▊       | 18808/65536 [3:31:00<8:42:30,  1.49it/s]
 29%|██▊       | 18809/65536 [3:31:01<8:56:46,  1.45it/s]
 29%|██▊       | 18810/65536 [3:31:02<8:54:07,  1.46it/s]
 29%|██▊       | 18811/65536 [3:31:02<8:57:00,  1.45it/s]
 29%|██▊       | 18812/65536 [3:31:03<8:48:50,  1.47it/s]
 29%|██▊       | 18813/65536 [3:31:04<8:41:57,  1.49it/s]
 29%|██▊       | 18814/65536 [3:31:04<8:40:29,  1.50it/s]
 29%|██▊       | 18815/65536 [3:31:05<8:34:46,  1.51it/s]
 29%|██▊       | 18816/65536 [3:31:06<8:37:24,  1.50it/s]
 29%|██▊       | 18817/65536 [3:31:06<8:43:32,  1.49it/s]
 29%|██▊       | 18818/65536 [3:31:07<8:41:56,  1.49it/s]
 29%|██▊       | 18819/65536 [3:31:08<8:57:22,  1.45it/s]
 29%|██▊       | 18820/65536 [3:31:08<8:55:35,  1.45it/s]
                                                         
{'loss': 0.9128, 'learning_rate': 7.435104689604506e-07, 'epoch': 1161.73}

 29%|██▊       | 18820/65536 [3:31:08<8:55:35,  1.45it/s]
 29%|██▊       | 18821/65536 [3:31:09<8:51:29,  1.46it/s]
 29%|██▊       | 18822/65536 [3:31:10<8:51:00,  1.47it/s]
 29%|██▊       | 18823/65536 [3:31:10<8:43:37,  1.49it/s]
 29%|██▊       | 18824/65536 [3:31:11<8:40:04,  1.50it/s]
 29%|██▊       | 18825/65536 [3:31:12<8:54:17,  1.46it/s]
 29%|██▊       | 18826/65536 [3:31:12<8:54:18,  1.46it/s]
 29%|██▊       | 18827/65536 [3:31:13<8:47:40,  1.48it/s]
 29%|██▊       | 18828/65536 [3:31:14<8:49:13,  1.47it/s]
 29%|██▊       | 18829/65536 [3:31:14<8:46:32,  1.48it/s]
 29%|██▊       | 18830/65536 [3:31:15<8:57:10,  1.45it/s]
 29%|██▊       | 18831/65536 [3:31:16<8:49:00,  1.47it/s]
 29%|██▊       | 18832/65536 [3:31:17<8:47:35,  1.48it/s]
 29%|██▊       | 18833/65536 [3:31:17<8:40:00,  1.50it/s]
 29%|██▊       | 18834/65536 [3:31:18<8:45:16,  1.48it/s]
 29%|██▊       | 18835/65536 [3:31:19<8:43:03,  1.49it/s]
 29%|██▊       | 18836/65536 [3:31:19<8:41:30,  1.49it/s]
 29%|██▊       | 18837/65536 [3:31:20<8:42:53,  1.49it/s]
 29%|██▊       | 18838/65536 [3:31:21<8:54:55,  1.45it/s]
 29%|██▊       | 18839/65536 [3:31:21<8:45:49,  1.48it/s]
 29%|██▊       | 18840/65536 [3:31:22<8:51:51,  1.46it/s]
                                                         
{'loss': 0.889, 'learning_rate': 7.432349700012244e-07, 'epoch': 1162.96}

 29%|██▊       | 18840/65536 [3:31:22<8:51:51,  1.46it/s]
 29%|██▊       | 18841/65536 [3:31:23<9:11:13,  1.41it/s]
 29%|██▉       | 18842/65536 [3:31:23<9:10:17,  1.41it/s]
 29%|██▉       | 18843/65536 [3:31:24<8:47:44,  1.47it/s]
 29%|██▉       | 18844/65536 [3:31:25<8:39:57,  1.50it/s]
 29%|██▉       | 18845/65536 [3:31:25<8:34:54,  1.51it/s]
 29%|██▉       | 18846/65536 [3:31:26<8:35:22,  1.51it/s]
 29%|██▉       | 18847/65536 [3:31:27<8:42:23,  1.49it/s]
 29%|██▉       | 18848/65536 [3:31:27<8:19:34,  1.56it/s]
 29%|██▉       | 18849/65536 [3:31:28<8:28:33,  1.53it/s]
 29%|██▉       | 18850/65536 [3:31:29<8:30:03,  1.53it/s]
 29%|██▉       | 18851/65536 [3:31:29<8:38:21,  1.50it/s]
 29%|██▉       | 18852/65536 [3:31:30<8:48:41,  1.47it/s]
 29%|██▉       | 18853/65536 [3:31:31<8:54:17,  1.46it/s]
 29%|██▉       | 18854/65536 [3:31:31<8:46:27,  1.48it/s]
 29%|██▉       | 18855/65536 [3:31:32<8:47:52,  1.47it/s]
 29%|██▉       | 18856/65536 [3:31:33<8:51:46,  1.46it/s]
 29%|██▉       | 18857/65536 [3:31:33<9:05:08,  1.43it/s]
 29%|██▉       | 18858/65536 [3:31:34<9:13:46,  1.40it/s]
 29%|██▉       | 18859/65536 [3:31:35<9:08:00,  1.42it/s]
 29%|██▉       | 18860/65536 [3:31:36<8:56:43,  1.45it/s]
                                                         
{'loss': 0.8986, 'learning_rate': 7.429594710419983e-07, 'epoch': 1164.2}

 29%|██▉       | 18860/65536 [3:31:36<8:56:43,  1.45it/s]
 29%|██▉       | 18861/65536 [3:31:36<8:46:21,  1.48it/s]
 29%|██▉       | 18862/65536 [3:31:37<8:35:17,  1.51it/s]
 29%|██▉       | 18863/65536 [3:31:37<8:28:48,  1.53it/s]
 29%|██▉       | 18864/65536 [3:31:38<8:35:16,  1.51it/s]
 29%|██▉       | 18865/65536 [3:31:39<8:26:49,  1.53it/s]
 29%|██▉       | 18866/65536 [3:31:39<8:25:26,  1.54it/s]
 29%|██▉       | 18867/65536 [3:31:40<8:20:27,  1.55it/s]
 29%|██▉       | 18868/65536 [3:31:41<8:26:23,  1.54it/s]
 29%|██▉       | 18869/65536 [3:31:41<8:25:37,  1.54it/s]
 29%|██▉       | 18870/65536 [3:31:42<8:25:21,  1.54it/s]
 29%|██▉       | 18871/65536 [3:31:43<8:25:15,  1.54it/s]
 29%|██▉       | 18872/65536 [3:31:43<8:43:15,  1.49it/s]
 29%|██▉       | 18873/65536 [3:31:44<8:57:54,  1.45it/s]
 29%|██▉       | 18874/65536 [3:31:45<9:08:54,  1.42it/s]
 29%|██▉       | 18875/65536 [3:31:45<9:00:28,  1.44it/s]
 29%|██▉       | 18876/65536 [3:31:46<9:05:35,  1.43it/s]
 29%|██▉       | 18877/65536 [3:31:47<9:11:40,  1.41it/s]
 29%|██▉       | 18878/65536 [3:31:48<8:58:06,  1.45it/s]
 29%|██▉       | 18879/65536 [3:31:48<9:03:29,  1.43it/s]
 29%|██▉       | 18880/65536 [3:31:49<8:58:49,  1.44it/s]
                                                         
{'loss': 0.9059, 'learning_rate': 7.426839720827722e-07, 'epoch': 1165.43}

 29%|██▉       | 18880/65536 [3:31:49<8:58:49,  1.44it/s]
 29%|██▉       | 18881/65536 [3:31:50<8:41:18,  1.49it/s]
 29%|██▉       | 18882/65536 [3:31:50<8:32:40,  1.52it/s]
 29%|██▉       | 18883/65536 [3:31:51<8:30:47,  1.52it/s]
 29%|██▉       | 18884/65536 [3:31:52<8:45:43,  1.48it/s]
 29%|██▉       | 18885/65536 [3:31:52<8:39:44,  1.50it/s]
 29%|██▉       | 18886/65536 [3:31:53<8:36:21,  1.51it/s]
 29%|██▉       | 18887/65536 [3:31:54<8:32:38,  1.52it/s]
 29%|██▉       | 18888/65536 [3:31:54<8:35:30,  1.51it/s]
 29%|██▉       | 18889/65536 [3:31:55<8:36:20,  1.51it/s]
 29%|██▉       | 18890/65536 [3:31:56<9:08:31,  1.42it/s]
 29%|██▉       | 18891/65536 [3:31:56<9:06:04,  1.42it/s]
 29%|██▉       | 18892/65536 [3:31:57<8:45:49,  1.48it/s]
 29%|██▉       | 18893/65536 [3:31:58<8:50:22,  1.47it/s]
 29%|██▉       | 18894/65536 [3:31:58<9:00:23,  1.44it/s]
 29%|██▉       | 18895/65536 [3:31:59<9:00:50,  1.44it/s]
 29%|██▉       | 18896/65536 [3:32:00<8:54:23,  1.45it/s]
 29%|██▉       | 18897/65536 [3:32:00<8:41:38,  1.49it/s]
 29%|██▉       | 18898/65536 [3:32:01<8:35:50,  1.51it/s]
 29%|██▉       | 18899/65536 [3:32:02<8:27:44,  1.53it/s]
 29%|██▉       | 18900/65536 [3:32:02<8:13:33,  1.57it/s]
                                                         
{'loss': 0.9155, 'learning_rate': 7.424084731235459e-07, 'epoch': 1166.67}

 29%|██▉       | 18900/65536 [3:32:02<8:13:33,  1.57it/s]
 29%|██▉       | 18901/65536 [3:32:03<8:23:39,  1.54it/s]
 29%|██▉       | 18902/65536 [3:32:04<8:18:19,  1.56it/s]
 29%|██▉       | 18903/65536 [3:32:04<8:38:47,  1.50it/s]
 29%|██▉       | 18904/65536 [3:32:05<8:36:44,  1.50it/s]
 29%|██▉       | 18905/65536 [3:32:06<8:29:36,  1.53it/s]
 29%|██▉       | 18906/65536 [3:32:06<8:50:14,  1.47it/s]
 29%|██▉       | 18907/65536 [3:32:07<8:42:59,  1.49it/s]
 29%|██▉       | 18908/65536 [3:32:08<8:33:47,  1.51it/s]
 29%|██▉       | 18909/65536 [3:32:08<8:21:50,  1.55it/s]
 29%|██▉       | 18910/65536 [3:32:09<8:26:34,  1.53it/s]
 29%|██▉       | 18911/65536 [3:32:10<8:17:05,  1.56it/s]
 29%|██▉       | 18912/65536 [3:32:10<8:19:40,  1.56it/s]
 29%|██▉       | 18913/65536 [3:32:11<8:36:54,  1.50it/s]
 29%|██▉       | 18914/65536 [3:32:12<8:31:42,  1.52it/s]
 29%|██▉       | 18915/65536 [3:32:12<8:45:02,  1.48it/s]
 29%|██▉       | 18916/65536 [3:32:13<8:59:48,  1.44it/s]
 29%|██▉       | 18917/65536 [3:32:14<9:00:59,  1.44it/s]
 29%|██▉       | 18918/65536 [3:32:14<8:42:10,  1.49it/s]
 29%|██▉       | 18919/65536 [3:32:15<8:46:59,  1.47it/s]
 29%|██▉       | 18920/65536 [3:32:16<8:34:22,  1.51it/s]
                                                         
{'loss': 0.9275, 'learning_rate': 7.421329741643198e-07, 'epoch': 1167.9}

 29%|██▉       | 18920/65536 [3:32:16<8:34:22,  1.51it/s]
 29%|██▉       | 18921/65536 [3:32:16<8:39:27,  1.50it/s]
 29%|██▉       | 18922/65536 [3:32:17<9:05:30,  1.42it/s]
 29%|██▉       | 18923/65536 [3:32:18<9:04:52,  1.43it/s]
 29%|██▉       | 18924/65536 [3:32:18<8:51:16,  1.46it/s]
 29%|██▉       | 18925/65536 [3:32:19<8:52:34,  1.46it/s]
 29%|██▉       | 18926/65536 [3:32:20<8:56:56,  1.45it/s]
 29%|██▉       | 18927/65536 [3:32:20<8:48:53,  1.47it/s]
 29%|██▉       | 18928/65536 [3:32:21<8:39:26,  1.50it/s]
 29%|██▉       | 18929/65536 [3:32:22<8:27:20,  1.53it/s]
 29%|██▉       | 18930/65536 [3:32:22<8:23:09,  1.54it/s]
 29%|██▉       | 18931/65536 [3:32:23<8:21:16,  1.55it/s]
 29%|██▉       | 18932/65536 [3:32:24<8:22:20,  1.55it/s]
 29%|██▉       | 18933/65536 [3:32:24<8:26:18,  1.53it/s]
 29%|██▉       | 18934/65536 [3:32:25<8:22:53,  1.54it/s]
 29%|██▉       | 18935/65536 [3:32:26<8:19:30,  1.55it/s]
 29%|██▉       | 18936/65536 [3:32:26<8:45:30,  1.48it/s]
 29%|██▉       | 18937/65536 [3:32:27<8:42:28,  1.49it/s]
 29%|██▉       | 18938/65536 [3:32:28<9:09:05,  1.41it/s]
 29%|██▉       | 18939/65536 [3:32:28<8:55:52,  1.45it/s]
 29%|██▉       | 18940/65536 [3:32:29<8:45:02,  1.48it/s]
                                                         
{'loss': 0.9182, 'learning_rate': 7.418574752050936e-07, 'epoch': 1169.14}

 29%|██▉       | 18940/65536 [3:32:29<8:45:02,  1.48it/s]
 29%|██▉       | 18941/65536 [3:32:30<8:41:40,  1.49it/s]
 29%|██▉       | 18942/65536 [3:32:30<8:34:48,  1.51it/s]
 29%|██▉       | 18943/65536 [3:32:31<8:27:51,  1.53it/s]
 29%|██▉       | 18944/65536 [3:32:32<8:30:56,  1.52it/s]
 29%|██▉       | 18945/65536 [3:32:32<8:30:51,  1.52it/s]
 29%|██▉       | 18946/65536 [3:32:33<8:41:52,  1.49it/s]
 29%|██▉       | 18947/65536 [3:32:34<8:36:58,  1.50it/s]
 29%|██▉       | 18948/65536 [3:32:34<8:30:10,  1.52it/s]
 29%|██▉       | 18949/65536 [3:32:35<8:43:12,  1.48it/s]
 29%|██▉       | 18950/65536 [3:32:36<8:36:24,  1.50it/s]
 29%|██▉       | 18951/65536 [3:32:36<8:32:51,  1.51it/s]
 29%|██▉       | 18952/65536 [3:32:37<8:39:10,  1.50it/s]
 29%|██▉       | 18953/65536 [3:32:38<8:37:04,  1.50it/s]
 29%|██▉       | 18954/65536 [3:32:38<8:38:53,  1.50it/s]
 29%|██▉       | 18955/65536 [3:32:39<8:50:44,  1.46it/s]
 29%|██▉       | 18956/65536 [3:32:40<8:46:15,  1.48it/s]
 29%|██▉       | 18957/65536 [3:32:40<8:38:28,  1.50it/s]
 29%|██▉       | 18958/65536 [3:32:41<8:24:20,  1.54it/s]
 29%|██▉       | 18959/65536 [3:32:42<8:36:36,  1.50it/s]
 29%|██▉       | 18960/65536 [3:32:42<8:27:03,  1.53it/s]
                                                         
{'loss': 0.9176, 'learning_rate': 7.415819762458675e-07, 'epoch': 1170.37}

 29%|██▉       | 18960/65536 [3:32:42<8:27:03,  1.53it/s]
 29%|██▉       | 18961/65536 [3:32:43<8:33:22,  1.51it/s]
 29%|██▉       | 18962/65536 [3:32:44<8:41:34,  1.49it/s]
 29%|██▉       | 18963/65536 [3:32:44<8:25:39,  1.54it/s]
 29%|██▉       | 18964/65536 [3:32:45<8:28:55,  1.53it/s]
 29%|██▉       | 18965/65536 [3:32:46<8:26:06,  1.53it/s]
 29%|██▉       | 18966/65536 [3:32:46<8:23:38,  1.54it/s]
 29%|██▉       | 18967/65536 [3:32:47<8:38:06,  1.50it/s]
 29%|██▉       | 18968/65536 [3:32:48<8:44:11,  1.48it/s]
 29%|██▉       | 18969/65536 [3:32:48<8:47:25,  1.47it/s]
 29%|██▉       | 18970/65536 [3:32:49<8:41:02,  1.49it/s]
 29%|██▉       | 18971/65536 [3:32:50<8:55:23,  1.45it/s]
 29%|██▉       | 18972/65536 [3:32:51<9:07:19,  1.42it/s]
 29%|██▉       | 18973/65536 [3:32:51<9:17:45,  1.39it/s]
 29%|██▉       | 18974/65536 [3:32:52<8:55:39,  1.45it/s]
 29%|██▉       | 18975/65536 [3:32:53<8:51:28,  1.46it/s]
 29%|██▉       | 18976/65536 [3:32:53<8:42:28,  1.49it/s]
 29%|██▉       | 18977/65536 [3:32:54<8:39:21,  1.49it/s]
 29%|██▉       | 18978/65536 [3:32:54<8:27:16,  1.53it/s]
 29%|██▉       | 18979/65536 [3:32:55<8:26:26,  1.53it/s]
 29%|██▉       | 18980/65536 [3:32:56<8:20:27,  1.55it/s]
                                                         
{'loss': 0.9223, 'learning_rate': 7.413064772866412e-07, 'epoch': 1171.6}

 29%|██▉       | 18980/65536 [3:32:56<8:20:27,  1.55it/s]
 29%|██▉       | 18981/65536 [3:32:56<8:32:20,  1.51it/s]
 29%|██▉       | 18982/65536 [3:32:57<8:31:02,  1.52it/s]
 29%|██▉       | 18983/65536 [3:32:58<8:48:55,  1.47it/s]
 29%|██▉       | 18984/65536 [3:32:59<8:43:29,  1.48it/s]
 29%|██▉       | 18985/65536 [3:32:59<8:46:05,  1.47it/s]
 29%|██▉       | 18986/65536 [3:33:00<8:45:49,  1.48it/s]
 29%|██▉       | 18987/65536 [3:33:01<9:17:04,  1.39it/s]
 29%|██▉       | 18988/65536 [3:33:01<9:10:22,  1.41it/s]
 29%|██▉       | 18989/65536 [3:33:02<8:56:35,  1.45it/s]
 29%|██▉       | 18990/65536 [3:33:03<8:48:47,  1.47it/s]
 29%|██▉       | 18991/65536 [3:33:03<8:34:42,  1.51it/s]
 29%|██▉       | 18992/65536 [3:33:04<8:48:45,  1.47it/s]
 29%|██▉       | 18993/65536 [3:33:05<8:44:43,  1.48it/s]
 29%|██▉       | 18994/65536 [3:33:05<8:52:15,  1.46it/s]
 29%|██▉       | 18995/65536 [3:33:06<8:41:00,  1.49it/s]
 29%|██▉       | 18996/65536 [3:33:07<8:33:28,  1.51it/s]
 29%|██▉       | 18997/65536 [3:33:07<8:33:57,  1.51it/s]
 29%|██▉       | 18998/65536 [3:33:08<8:38:42,  1.50it/s]
 29%|██▉       | 18999/65536 [3:33:09<8:55:46,  1.45it/s]
 29%|██▉       | 19000/65536 [3:33:09<8:49:20,  1.47it/s]
                                                         
{'loss': 0.8818, 'learning_rate': 7.410309783274151e-07, 'epoch': 1172.84}

 29%|██▉       | 19000/65536 [3:33:09<8:49:20,  1.47it/s]
 29%|██▉       | 19001/65536 [3:33:10<8:46:51,  1.47it/s]
 29%|██▉       | 19002/65536 [3:33:11<8:32:10,  1.51it/s]
 29%|██▉       | 19003/65536 [3:33:11<8:46:32,  1.47it/s]
 29%|██▉       | 19004/65536 [3:33:12<8:46:44,  1.47it/s]
 29%|██▉       | 19005/65536 [3:33:13<8:46:24,  1.47it/s]
 29%|██▉       | 19006/65536 [3:33:13<8:46:25,  1.47it/s]
 29%|██▉       | 19007/65536 [3:33:14<8:36:35,  1.50it/s]
 29%|██▉       | 19008/65536 [3:33:15<8:33:40,  1.51it/s]
 29%|██▉       | 19009/65536 [3:33:15<8:35:24,  1.50it/s]
 29%|██▉       | 19010/65536 [3:33:16<8:40:21,  1.49it/s]
 29%|██▉       | 19011/65536 [3:33:17<8:39:12,  1.49it/s]
 29%|██▉       | 19012/65536 [3:33:17<8:39:51,  1.49it/s]
 29%|██▉       | 19013/65536 [3:33:18<8:39:32,  1.49it/s]
 29%|██▉       | 19014/65536 [3:33:19<8:35:02,  1.51it/s]
 29%|██▉       | 19015/65536 [3:33:19<8:36:55,  1.50it/s]
 29%|██▉       | 19016/65536 [3:33:20<8:24:12,  1.54it/s]
 29%|██▉       | 19017/65536 [3:33:21<8:39:53,  1.49it/s]
 29%|██▉       | 19018/65536 [3:33:22<9:03:03,  1.43it/s]
 29%|██▉       | 19019/65536 [3:33:22<9:06:56,  1.42it/s]
 29%|██▉       | 19020/65536 [3:33:23<8:52:14,  1.46it/s]
                                                         
{'loss': 0.9149, 'learning_rate': 7.40755479368189e-07, 'epoch': 1174.07}

 29%|██▉       | 19020/65536 [3:33:23<8:52:14,  1.46it/s]
 29%|██▉       | 19021/65536 [3:33:24<8:42:07,  1.48it/s]
 29%|██▉       | 19022/65536 [3:33:24<8:38:07,  1.50it/s]
 29%|██▉       | 19023/65536 [3:33:25<8:47:40,  1.47it/s]
 29%|██▉       | 19024/65536 [3:33:25<8:21:54,  1.54it/s]
 29%|██▉       | 19025/65536 [3:33:26<8:35:08,  1.50it/s]
 29%|██▉       | 19026/65536 [3:33:27<8:26:13,  1.53it/s]
 29%|██▉       | 19027/65536 [3:33:27<8:32:14,  1.51it/s]
 29%|██▉       | 19028/65536 [3:33:28<8:35:29,  1.50it/s]
 29%|██▉       | 19029/65536 [3:33:29<8:34:08,  1.51it/s]
 29%|██▉       | 19030/65536 [3:33:30<8:37:45,  1.50it/s]
 29%|██▉       | 19031/65536 [3:33:30<8:44:22,  1.48it/s]
 29%|██▉       | 19032/65536 [3:33:31<8:46:19,  1.47it/s]
 29%|██▉       | 19033/65536 [3:33:32<8:35:20,  1.50it/s]
 29%|██▉       | 19034/65536 [3:33:32<8:29:15,  1.52it/s]
 29%|██▉       | 19035/65536 [3:33:33<8:30:23,  1.52it/s]
 29%|██▉       | 19036/65536 [3:33:34<8:42:53,  1.48it/s]
 29%|██▉       | 19037/65536 [3:33:34<8:57:01,  1.44it/s]
 29%|██▉       | 19038/65536 [3:33:35<8:47:22,  1.47it/s]
 29%|██▉       | 19039/65536 [3:33:36<8:43:17,  1.48it/s]
 29%|██▉       | 19040/65536 [3:33:36<8:49:26,  1.46it/s]
                                                         
{'loss': 0.9248, 'learning_rate': 7.404799804089627e-07, 'epoch': 1175.31}

 29%|██▉       | 19040/65536 [3:33:36<8:49:26,  1.46it/s]
 29%|██▉       | 19041/65536 [3:33:37<8:39:16,  1.49it/s]
 29%|██▉       | 19042/65536 [3:33:38<8:38:35,  1.49it/s]
 29%|██▉       | 19043/65536 [3:33:38<8:42:25,  1.48it/s]
 29%|██▉       | 19044/65536 [3:33:39<8:40:58,  1.49it/s]
 29%|██▉       | 19045/65536 [3:33:40<8:49:33,  1.46it/s]
 29%|██▉       | 19046/65536 [3:33:40<8:45:13,  1.48it/s]
 29%|██▉       | 19047/65536 [3:33:41<8:33:35,  1.51it/s]
 29%|██▉       | 19048/65536 [3:33:42<8:30:30,  1.52it/s]
 29%|██▉       | 19049/65536 [3:33:42<8:21:32,  1.54it/s]
 29%|██▉       | 19050/65536 [3:33:43<8:18:55,  1.55it/s]
 29%|██▉       | 19051/65536 [3:33:44<8:27:09,  1.53it/s]
 29%|██▉       | 19052/65536 [3:33:44<8:59:06,  1.44it/s]
 29%|██▉       | 19053/65536 [3:33:45<8:53:41,  1.45it/s]
 29%|██▉       | 19054/65536 [3:33:46<8:55:11,  1.45it/s]
 29%|██▉       | 19055/65536 [3:33:46<8:38:20,  1.49it/s]
 29%|██▉       | 19056/65536 [3:33:47<8:31:47,  1.51it/s]
 29%|██▉       | 19057/65536 [3:33:48<8:31:00,  1.52it/s]
 29%|██▉       | 19058/65536 [3:33:48<8:23:43,  1.54it/s]
 29%|██▉       | 19059/65536 [3:33:49<8:25:48,  1.53it/s]
 29%|██▉       | 19060/65536 [3:33:50<8:33:58,  1.51it/s]
                                                         
{'loss': 0.896, 'learning_rate': 7.402044814497367e-07, 'epoch': 1176.54}

 29%|██▉       | 19060/65536 [3:33:50<8:33:58,  1.51it/s]
 29%|██▉       | 19061/65536 [3:33:50<8:39:31,  1.49it/s]
 29%|██▉       | 19062/65536 [3:33:51<8:32:58,  1.51it/s]
 29%|██▉       | 19063/65536 [3:33:52<8:38:01,  1.50it/s]
 29%|██▉       | 19064/65536 [3:33:52<8:41:27,  1.49it/s]
 29%|██▉       | 19065/65536 [3:33:53<8:24:39,  1.53it/s]
 29%|██▉       | 19066/65536 [3:33:54<8:25:17,  1.53it/s]
 29%|██▉       | 19067/65536 [3:33:54<8:43:45,  1.48it/s]
 29%|██▉       | 19068/65536 [3:33:55<9:19:54,  1.38it/s]
 29%|██▉       | 19069/65536 [3:33:56<9:04:26,  1.42it/s]
 29%|██▉       | 19070/65536 [3:33:56<8:46:32,  1.47it/s]
 29%|██▉       | 19071/65536 [3:33:57<9:05:58,  1.42it/s]
 29%|██▉       | 19072/65536 [3:33:58<8:58:32,  1.44it/s]
 29%|██▉       | 19073/65536 [3:33:58<8:48:56,  1.46it/s]
 29%|██▉       | 19074/65536 [3:33:59<8:50:25,  1.46it/s]
 29%|██▉       | 19075/65536 [3:34:00<8:38:14,  1.49it/s]
 29%|██▉       | 19076/65536 [3:34:00<8:30:56,  1.52it/s]
 29%|██▉       | 19077/65536 [3:34:01<8:22:50,  1.54it/s]
 29%|██▉       | 19078/65536 [3:34:02<8:18:10,  1.55it/s]
 29%|██▉       | 19079/65536 [3:34:02<8:22:15,  1.54it/s]
 29%|██▉       | 19080/65536 [3:34:03<8:39:06,  1.49it/s]
                                                         
{'loss': 0.8999, 'learning_rate': 7.399289824905105e-07, 'epoch': 1177.78}

 29%|██▉       | 19080/65536 [3:34:03<8:39:06,  1.49it/s]
 29%|██▉       | 19081/65536 [3:34:04<8:23:33,  1.54it/s]
 29%|██▉       | 19082/65536 [3:34:04<8:42:04,  1.48it/s]
 29%|██▉       | 19083/65536 [3:34:05<8:49:34,  1.46it/s]
 29%|██▉       | 19084/65536 [3:34:06<9:02:50,  1.43it/s]
 29%|██▉       | 19085/65536 [3:34:07<8:54:11,  1.45it/s]
 29%|██▉       | 19086/65536 [3:34:07<8:45:16,  1.47it/s]
 29%|██▉       | 19087/65536 [3:34:08<8:31:08,  1.51it/s]
 29%|██▉       | 19088/65536 [3:34:08<8:22:07,  1.54it/s]
 29%|██▉       | 19089/65536 [3:34:09<8:25:43,  1.53it/s]
 29%|██▉       | 19090/65536 [3:34:10<8:38:26,  1.49it/s]
 29%|██▉       | 19091/65536 [3:34:10<8:47:10,  1.47it/s]
 29%|██▉       | 19092/65536 [3:34:11<8:51:15,  1.46it/s]
 29%|██▉       | 19093/65536 [3:34:12<8:43:17,  1.48it/s]
 29%|██▉       | 19094/65536 [3:34:13<8:44:50,  1.47it/s]
 29%|██▉       | 19095/65536 [3:34:13<8:52:00,  1.45it/s]
 29%|██▉       | 19096/65536 [3:34:14<8:54:37,  1.45it/s]
 29%|██▉       | 19097/65536 [3:34:15<8:45:32,  1.47it/s]
 29%|██▉       | 19098/65536 [3:34:15<8:42:00,  1.48it/s]
 29%|██▉       | 19099/65536 [3:34:16<8:32:23,  1.51it/s]
 29%|██▉       | 19100/65536 [3:34:17<8:55:57,  1.44it/s]
                                                         
{'loss': 0.9144, 'learning_rate': 7.396534835312844e-07, 'epoch': 1179.01}

 29%|██▉       | 19100/65536 [3:34:17<8:55:57,  1.44it/s]
 29%|██▉       | 19101/65536 [3:34:17<8:37:36,  1.50it/s]
 29%|██▉       | 19102/65536 [3:34:18<8:45:46,  1.47it/s]
 29%|██▉       | 19103/65536 [3:34:19<8:36:43,  1.50it/s]
 29%|██▉       | 19104/65536 [3:34:19<8:51:30,  1.46it/s]
 29%|██▉       | 19105/65536 [3:34:20<8:45:14,  1.47it/s]
 29%|██▉       | 19106/65536 [3:34:21<8:51:15,  1.46it/s]
 29%|██▉       | 19107/65536 [3:34:21<8:46:02,  1.47it/s]
 29%|██▉       | 19108/65536 [3:34:22<8:34:49,  1.50it/s]
 29%|██▉       | 19109/65536 [3:34:23<8:41:25,  1.48it/s]
 29%|██▉       | 19110/65536 [3:34:23<8:40:39,  1.49it/s]
 29%|██▉       | 19111/65536 [3:34:24<8:32:56,  1.51it/s]
 29%|██▉       | 19112/65536 [3:34:25<8:34:57,  1.50it/s]
 29%|██▉       | 19113/65536 [3:34:25<8:55:09,  1.45it/s]
 29%|██▉       | 19114/65536 [3:34:26<8:46:45,  1.47it/s]
 29%|██▉       | 19115/65536 [3:34:27<8:42:35,  1.48it/s]
 29%|██▉       | 19116/65536 [3:34:27<8:42:53,  1.48it/s]
 29%|██▉       | 19117/65536 [3:34:28<9:06:00,  1.42it/s]
 29%|██▉       | 19118/65536 [3:34:29<8:56:02,  1.44it/s]
 29%|██▉       | 19119/65536 [3:34:30<8:48:13,  1.46it/s]
 29%|██▉       | 19120/65536 [3:34:30<8:35:52,  1.50it/s]
                                                         
{'loss': 0.888, 'learning_rate': 7.393779845720582e-07, 'epoch': 1180.25}

 29%|██▉       | 19120/65536 [3:34:30<8:35:52,  1.50it/s]
 29%|██▉       | 19121/65536 [3:34:31<8:19:42,  1.55it/s]
 29%|██▉       | 19122/65536 [3:34:31<8:29:15,  1.52it/s]
 29%|██▉       | 19123/65536 [3:34:32<8:39:16,  1.49it/s]
 29%|██▉       | 19124/65536 [3:34:33<8:46:26,  1.47it/s]
 29%|██▉       | 19125/65536 [3:34:33<8:32:34,  1.51it/s]
 29%|██▉       | 19126/65536 [3:34:34<8:36:39,  1.50it/s]
 29%|██▉       | 19127/65536 [3:34:35<8:47:13,  1.47it/s]
 29%|██▉       | 19128/65536 [3:34:36<8:49:55,  1.46it/s]
 29%|██▉       | 19129/65536 [3:34:36<8:38:44,  1.49it/s]
 29%|██▉       | 19130/65536 [3:34:37<8:22:44,  1.54it/s]
 29%|██▉       | 19131/65536 [3:34:37<8:34:11,  1.50it/s]
 29%|██▉       | 19132/65536 [3:34:38<8:27:06,  1.53it/s]
 29%|██▉       | 19133/65536 [3:34:39<8:50:07,  1.46it/s]
 29%|██▉       | 19134/65536 [3:34:40<8:46:19,  1.47it/s]
 29%|██▉       | 19135/65536 [3:34:40<8:42:41,  1.48it/s]
 29%|██▉       | 19136/65536 [3:34:41<8:32:48,  1.51it/s]
 29%|██▉       | 19137/65536 [3:34:41<8:32:52,  1.51it/s]
 29%|██▉       | 19138/65536 [3:34:42<8:50:10,  1.46it/s]
 29%|██▉       | 19139/65536 [3:34:43<8:42:53,  1.48it/s]
 29%|██▉       | 19140/65536 [3:34:44<8:41:25,  1.48it/s]
                                                         
{'loss': 0.9209, 'learning_rate': 7.391024856128321e-07, 'epoch': 1181.48}

 29%|██▉       | 19140/65536 [3:34:44<8:41:25,  1.48it/s]
 29%|██▉       | 19141/65536 [3:34:44<9:03:23,  1.42it/s]
 29%|██▉       | 19142/65536 [3:34:45<9:00:53,  1.43it/s]
 29%|██▉       | 19143/65536 [3:34:46<8:42:31,  1.48it/s]
 29%|██▉       | 19144/65536 [3:34:46<8:44:03,  1.48it/s]
 29%|██▉       | 19145/65536 [3:34:47<8:41:52,  1.48it/s]
 29%|██▉       | 19146/65536 [3:34:48<8:21:12,  1.54it/s]
 29%|██▉       | 19147/65536 [3:34:48<8:23:56,  1.53it/s]
 29%|██▉       | 19148/65536 [3:34:49<8:31:06,  1.51it/s]
 29%|██▉       | 19149/65536 [3:34:50<8:51:28,  1.45it/s]
 29%|██▉       | 19150/65536 [3:34:50<8:40:33,  1.49it/s]
 29%|██▉       | 19151/65536 [3:34:51<8:31:52,  1.51it/s]
 29%|██▉       | 19152/65536 [3:34:52<8:29:19,  1.52it/s]
 29%|██▉       | 19153/65536 [3:34:52<8:39:18,  1.49it/s]
 29%|██▉       | 19154/65536 [3:34:53<8:36:57,  1.50it/s]
 29%|██▉       | 19155/65536 [3:34:54<8:48:03,  1.46it/s]
 29%|██▉       | 19156/65536 [3:34:54<8:37:37,  1.49it/s]
 29%|██▉       | 19157/65536 [3:34:55<8:42:36,  1.48it/s]
 29%|██▉       | 19158/65536 [3:34:56<8:55:43,  1.44it/s]
 29%|██▉       | 19159/65536 [3:34:56<8:51:14,  1.46it/s]
 29%|██▉       | 19160/65536 [3:34:57<8:47:56,  1.46it/s]
                                                         
{'loss': 0.9015, 'learning_rate': 7.38826986653606e-07, 'epoch': 1182.72}

 29%|██▉       | 19160/65536 [3:34:57<8:47:56,  1.46it/s]
 29%|██▉       | 19161/65536 [3:34:58<8:57:39,  1.44it/s]
 29%|██▉       | 19162/65536 [3:34:58<8:21:18,  1.54it/s]
 29%|██▉       | 19163/65536 [3:34:59<8:29:08,  1.52it/s]
 29%|██▉       | 19164/65536 [3:35:00<8:30:19,  1.51it/s]
 29%|██▉       | 19165/65536 [3:35:00<8:42:50,  1.48it/s]
 29%|██▉       | 19166/65536 [3:35:01<8:48:01,  1.46it/s]
 29%|██▉       | 19167/65536 [3:35:02<8:44:28,  1.47it/s]
 29%|██▉       | 19168/65536 [3:35:02<8:47:04,  1.47it/s]
 29%|██▉       | 19169/65536 [3:35:03<8:37:44,  1.49it/s]
 29%|██▉       | 19170/65536 [3:35:04<8:35:07,  1.50it/s]
 29%|██▉       | 19171/65536 [3:35:04<8:37:23,  1.49it/s]
 29%|██▉       | 19172/65536 [3:35:05<8:38:02,  1.49it/s]
 29%|██▉       | 19173/65536 [3:35:06<8:27:06,  1.52it/s]
 29%|██▉       | 19174/65536 [3:35:06<8:39:25,  1.49it/s]
 29%|██▉       | 19175/65536 [3:35:07<8:36:05,  1.50it/s]
 29%|██▉       | 19176/65536 [3:35:08<8:39:13,  1.49it/s]
 29%|██▉       | 19177/65536 [3:35:08<8:33:05,  1.51it/s]
 29%|██▉       | 19178/65536 [3:35:09<8:32:00,  1.51it/s]
 29%|██▉       | 19179/65536 [3:35:10<8:30:51,  1.51it/s]
 29%|██▉       | 19180/65536 [3:35:10<8:42:32,  1.48it/s]
                                                         
{'loss': 0.895, 'learning_rate': 7.385514876943798e-07, 'epoch': 1183.95}

 29%|██▉       | 19180/65536 [3:35:10<8:42:32,  1.48it/s]
 29%|██▉       | 19181/65536 [3:35:11<9:06:15,  1.41it/s]
 29%|██▉       | 19182/65536 [3:35:12<9:01:13,  1.43it/s]
 29%|██▉       | 19183/65536 [3:35:13<8:53:02,  1.45it/s]
 29%|██▉       | 19184/65536 [3:35:13<8:39:37,  1.49it/s]
 29%|██▉       | 19185/65536 [3:35:14<8:43:17,  1.48it/s]
 29%|██▉       | 19186/65536 [3:35:15<8:30:57,  1.51it/s]
 29%|██▉       | 19187/65536 [3:35:15<8:23:26,  1.53it/s]
 29%|██▉       | 19188/65536 [3:35:16<8:20:30,  1.54it/s]
 29%|██▉       | 19189/65536 [3:35:16<8:20:32,  1.54it/s]
 29%|██▉       | 19190/65536 [3:35:17<8:21:17,  1.54it/s]
 29%|██▉       | 19191/65536 [3:35:18<8:36:52,  1.49it/s]
 29%|██▉       | 19192/65536 [3:35:18<8:23:26,  1.53it/s]
 29%|██▉       | 19193/65536 [3:35:19<8:28:22,  1.52it/s]
 29%|██▉       | 19194/65536 [3:35:20<8:34:19,  1.50it/s]
 29%|██▉       | 19195/65536 [3:35:20<8:26:20,  1.53it/s]
 29%|██▉       | 19196/65536 [3:35:21<8:41:46,  1.48it/s]
 29%|██▉       | 19197/65536 [3:35:22<8:38:09,  1.49it/s]
 29%|██▉       | 19198/65536 [3:35:23<8:49:03,  1.46it/s]
 29%|██▉       | 19199/65536 [3:35:23<8:45:56,  1.47it/s]
 29%|██▉       | 19200/65536 [3:35:24<8:29:40,  1.52it/s]
                                                         
{'loss': 0.919, 'learning_rate': 7.382759887351537e-07, 'epoch': 1185.19}

 29%|██▉       | 19200/65536 [3:35:24<8:29:40,  1.52it/s]
 29%|██▉       | 19201/65536 [3:35:25<8:42:07,  1.48it/s]
 29%|██▉       | 19202/65536 [3:35:25<8:53:34,  1.45it/s]
 29%|██▉       | 19203/65536 [3:35:26<9:01:54,  1.42it/s]
 29%|██▉       | 19204/65536 [3:35:27<8:59:33,  1.43it/s]
 29%|██▉       | 19205/65536 [3:35:27<8:37:54,  1.49it/s]
 29%|██▉       | 19206/65536 [3:35:28<8:36:26,  1.50it/s]
 29%|██▉       | 19207/65536 [3:35:29<8:47:20,  1.46it/s]
 29%|██▉       | 19208/65536 [3:35:29<8:39:23,  1.49it/s]
 29%|██▉       | 19209/65536 [3:35:30<8:32:10,  1.51it/s]
 29%|██▉       | 19210/65536 [3:35:31<8:37:22,  1.49it/s]
 29%|██▉       | 19211/65536 [3:35:31<8:29:34,  1.52it/s]
 29%|██▉       | 19212/65536 [3:35:32<8:22:04,  1.54it/s]
 29%|██▉       | 19213/65536 [3:35:32<8:09:51,  1.58it/s]
 29%|██▉       | 19214/65536 [3:35:33<8:34:31,  1.50it/s]
 29%|██▉       | 19215/65536 [3:35:34<8:31:31,  1.51it/s]
 29%|██▉       | 19216/65536 [3:35:35<8:30:45,  1.51it/s]
 29%|██▉       | 19217/65536 [3:35:35<8:12:41,  1.57it/s]
 29%|██▉       | 19218/65536 [3:35:36<8:22:24,  1.54it/s]
 29%|██▉       | 19219/65536 [3:35:36<8:28:56,  1.52it/s]
 29%|██▉       | 19220/65536 [3:35:37<8:43:51,  1.47it/s]
                                                         
{'loss': 0.9127, 'learning_rate': 7.380004897759275e-07, 'epoch': 1186.42}

 29%|██▉       | 19220/65536 [3:35:37<8:43:51,  1.47it/s]
 29%|██▉       | 19221/65536 [3:35:38<8:44:50,  1.47it/s]
 29%|██▉       | 19222/65536 [3:35:39<8:36:58,  1.49it/s]
 29%|██▉       | 19223/65536 [3:35:39<8:34:32,  1.50it/s]
 29%|██▉       | 19224/65536 [3:35:40<8:35:58,  1.50it/s]
 29%|██▉       | 19225/65536 [3:35:41<8:39:13,  1.49it/s]
 29%|██▉       | 19226/65536 [3:35:41<8:37:29,  1.49it/s]
 29%|██▉       | 19227/65536 [3:35:42<8:41:30,  1.48it/s]
 29%|██▉       | 19228/65536 [3:35:43<8:41:19,  1.48it/s]
 29%|██▉       | 19229/65536 [3:35:43<8:46:07,  1.47it/s]
 29%|██▉       | 19230/65536 [3:35:44<8:59:22,  1.43it/s]
 29%|██▉       | 19231/65536 [3:35:45<9:10:54,  1.40it/s]
 29%|██▉       | 19232/65536 [3:35:45<8:51:33,  1.45it/s]
 29%|██▉       | 19233/65536 [3:35:46<8:37:45,  1.49it/s]
 29%|██▉       | 19234/65536 [3:35:47<8:23:32,  1.53it/s]
 29%|██▉       | 19235/65536 [3:35:47<8:27:44,  1.52it/s]
 29%|██▉       | 19236/65536 [3:35:48<8:36:56,  1.49it/s]
 29%|██▉       | 19237/65536 [3:35:49<8:36:57,  1.49it/s]
 29%|██▉       | 19238/65536 [3:35:49<8:31:47,  1.51it/s]
 29%|██▉       | 19239/65536 [3:35:50<8:31:53,  1.51it/s]
 29%|██▉       | 19240/65536 [3:35:51<8:35:18,  1.50it/s]
                                                         
{'loss': 0.9079, 'learning_rate': 7.377249908167013e-07, 'epoch': 1187.65}

 29%|██▉       | 19240/65536 [3:35:51<8:35:18,  1.50it/s]
 29%|██▉       | 19241/65536 [3:35:51<8:41:03,  1.48it/s]
 29%|██▉       | 19242/65536 [3:35:52<8:35:33,  1.50it/s]
 29%|██▉       | 19243/65536 [3:35:53<8:42:46,  1.48it/s]
 29%|██▉       | 19244/65536 [3:35:53<8:36:49,  1.49it/s]
 29%|██▉       | 19245/65536 [3:35:54<8:37:47,  1.49it/s]
 29%|██▉       | 19246/65536 [3:35:55<9:11:27,  1.40it/s]
 29%|██▉       | 19247/65536 [3:35:55<8:48:51,  1.46it/s]
 29%|██▉       | 19248/65536 [3:35:56<8:52:05,  1.45it/s]
 29%|██▉       | 19249/65536 [3:35:57<8:45:16,  1.47it/s]
 29%|██▉       | 19250/65536 [3:35:58<8:47:01,  1.46it/s]
 29%|██▉       | 19251/65536 [3:35:58<8:31:50,  1.51it/s]
 29%|██▉       | 19252/65536 [3:35:59<8:27:45,  1.52it/s]
 29%|██▉       | 19253/65536 [3:35:59<8:30:34,  1.51it/s]
 29%|██▉       | 19254/65536 [3:36:00<8:34:18,  1.50it/s]
 29%|██▉       | 19255/65536 [3:36:01<8:45:14,  1.47it/s]
 29%|██▉       | 19256/65536 [3:36:02<8:44:35,  1.47it/s]
 29%|██▉       | 19257/65536 [3:36:02<8:31:39,  1.51it/s]
 29%|██▉       | 19258/65536 [3:36:03<8:40:18,  1.48it/s]
 29%|██▉       | 19259/65536 [3:36:03<8:27:49,  1.52it/s]
 29%|██▉       | 19260/65536 [3:36:04<8:32:33,  1.50it/s]
                                                         
{'loss': 0.9076, 'learning_rate': 7.374494918574752e-07, 'epoch': 1188.89}

 29%|██▉       | 19260/65536 [3:36:04<8:32:33,  1.50it/s]
 29%|██▉       | 19261/65536 [3:36:05<8:30:03,  1.51it/s]
 29%|██▉       | 19262/65536 [3:36:06<8:48:51,  1.46it/s]
 29%|██▉       | 19263/65536 [3:36:06<8:31:41,  1.51it/s]
 29%|██▉       | 19264/65536 [3:36:07<8:46:00,  1.47it/s]
 29%|██▉       | 19265/65536 [3:36:08<8:47:09,  1.46it/s]
 29%|██▉       | 19266/65536 [3:36:08<8:29:11,  1.51it/s]
 29%|██▉       | 19267/65536 [3:36:09<8:32:59,  1.50it/s]
 29%|██▉       | 19268/65536 [3:36:09<8:21:18,  1.54it/s]
 29%|██▉       | 19269/65536 [3:36:10<8:28:28,  1.52it/s]
 29%|██▉       | 19270/65536 [3:36:11<8:24:43,  1.53it/s]
 29%|██▉       | 19271/65536 [3:36:11<8:22:05,  1.54it/s]
 29%|██▉       | 19272/65536 [3:36:12<8:28:13,  1.52it/s]
 29%|██▉       | 19273/65536 [3:36:13<8:35:08,  1.50it/s]
 29%|██▉       | 19274/65536 [3:36:13<8:35:50,  1.49it/s]
 29%|██▉       | 19275/65536 [3:36:14<8:31:00,  1.51it/s]
 29%|██▉       | 19276/65536 [3:36:15<8:33:42,  1.50it/s]
 29%|██▉       | 19277/65536 [3:36:15<8:36:25,  1.49it/s]
 29%|██▉       | 19278/65536 [3:36:16<8:24:01,  1.53it/s]
 29%|██▉       | 19279/65536 [3:36:17<8:48:29,  1.46it/s]
 29%|██▉       | 19280/65536 [3:36:17<8:33:59,  1.50it/s]
                                                         
{'loss': 0.9338, 'learning_rate': 7.37173992898249e-07, 'epoch': 1190.12}

 29%|██▉       | 19280/65536 [3:36:17<8:33:59,  1.50it/s]
 29%|██▉       | 19281/65536 [3:36:18<8:24:12,  1.53it/s]
 29%|██▉       | 19282/65536 [3:36:19<8:21:17,  1.54it/s]
 29%|██▉       | 19283/65536 [3:36:19<8:30:10,  1.51it/s]
 29%|██▉       | 19284/65536 [3:36:20<8:29:12,  1.51it/s]
 29%|██▉       | 19285/65536 [3:36:21<8:30:51,  1.51it/s]
 29%|██▉       | 19286/65536 [3:36:21<8:24:12,  1.53it/s]
 29%|██▉       | 19287/65536 [3:36:22<8:27:29,  1.52it/s]
 29%|██▉       | 19288/65536 [3:36:23<8:37:25,  1.49it/s]
 29%|██▉       | 19289/65536 [3:36:24<8:57:16,  1.43it/s]
 29%|██▉       | 19290/65536 [3:36:24<8:54:53,  1.44it/s]
 29%|██▉       | 19291/65536 [3:36:25<8:39:25,  1.48it/s]
 29%|██▉       | 19292/65536 [3:36:26<8:43:33,  1.47it/s]
 29%|██▉       | 19293/65536 [3:36:26<8:31:53,  1.51it/s]
 29%|██▉       | 19294/65536 [3:36:27<8:32:42,  1.50it/s]
 29%|██▉       | 19295/65536 [3:36:28<8:55:16,  1.44it/s]
 29%|██▉       | 19296/65536 [3:36:28<8:58:52,  1.43it/s]
 29%|██▉       | 19297/65536 [3:36:29<8:50:12,  1.45it/s]
 29%|██▉       | 19298/65536 [3:36:30<8:37:29,  1.49it/s]
 29%|██▉       | 19299/65536 [3:36:30<8:43:01,  1.47it/s]
 29%|██▉       | 19300/65536 [3:36:31<8:33:25,  1.50it/s]
                                                         
{'loss': 0.9115, 'learning_rate': 7.36898493939023e-07, 'epoch': 1191.36}

 29%|██▉       | 19300/65536 [3:36:31<8:33:25,  1.50it/s]
 29%|██▉       | 19301/65536 [3:36:32<8:23:50,  1.53it/s]
 29%|██▉       | 19302/65536 [3:36:32<8:33:16,  1.50it/s]
 29%|██▉       | 19303/65536 [3:36:33<8:38:45,  1.49it/s]
 29%|██▉       | 19304/65536 [3:36:34<8:35:36,  1.49it/s]
 29%|██▉       | 19305/65536 [3:36:34<8:35:53,  1.49it/s]
 29%|██▉       | 19306/65536 [3:36:35<8:42:49,  1.47it/s]
 29%|██▉       | 19307/65536 [3:36:36<8:42:41,  1.47it/s]
 29%|██▉       | 19308/65536 [3:36:36<8:41:16,  1.48it/s]
 29%|██▉       | 19309/65536 [3:36:37<8:32:33,  1.50it/s]
 29%|██▉       | 19310/65536 [3:36:38<8:36:03,  1.49it/s]
 29%|██▉       | 19311/65536 [3:36:38<9:02:28,  1.42it/s]
 29%|██▉       | 19312/65536 [3:36:39<8:58:30,  1.43it/s]
 29%|██▉       | 19313/65536 [3:36:40<8:54:14,  1.44it/s]
 29%|██▉       | 19314/65536 [3:36:40<8:44:46,  1.47it/s]
 29%|██▉       | 19315/65536 [3:36:41<9:01:02,  1.42it/s]
 29%|██▉       | 19316/65536 [3:36:42<8:52:05,  1.45it/s]
 29%|██▉       | 19317/65536 [3:36:42<8:43:30,  1.47it/s]
 29%|██▉       | 19318/65536 [3:36:43<8:28:46,  1.51it/s]
 29%|██▉       | 19319/65536 [3:36:44<8:27:24,  1.52it/s]
 29%|██▉       | 19320/65536 [3:36:44<8:19:06,  1.54it/s]
                                                         
{'loss': 0.8803, 'learning_rate': 7.366229949797967e-07, 'epoch': 1192.59}

 29%|██▉       | 19320/65536 [3:36:44<8:19:06,  1.54it/s]
 29%|██▉       | 19321/65536 [3:36:45<8:18:03,  1.55it/s]
 29%|██▉       | 19322/65536 [3:36:46<8:24:23,  1.53it/s]
 29%|██▉       | 19323/65536 [3:36:46<8:25:51,  1.52it/s]
 29%|██▉       | 19324/65536 [3:36:47<8:39:25,  1.48it/s]
 29%|██▉       | 19325/65536 [3:36:48<8:28:19,  1.52it/s]
 29%|██▉       | 19326/65536 [3:36:48<8:29:39,  1.51it/s]
 29%|██▉       | 19327/65536 [3:36:49<8:57:42,  1.43it/s]
 29%|██▉       | 19328/65536 [3:36:50<8:56:43,  1.43it/s]
 29%|██▉       | 19329/65536 [3:36:51<9:02:53,  1.42it/s]
 29%|██▉       | 19330/65536 [3:36:51<8:58:19,  1.43it/s]
 29%|██▉       | 19331/65536 [3:36:52<8:38:24,  1.49it/s]
 29%|██▉       | 19332/65536 [3:36:52<8:27:45,  1.52it/s]
 29%|██▉       | 19333/65536 [3:36:53<8:31:15,  1.51it/s]
 30%|██▉       | 19334/65536 [3:36:54<8:38:51,  1.48it/s]
 30%|██▉       | 19335/65536 [3:36:55<8:33:05,  1.50it/s]
 30%|██▉       | 19336/65536 [3:36:55<8:30:57,  1.51it/s]
 30%|██▉       | 19337/65536 [3:36:56<8:50:25,  1.45it/s]
 30%|██▉       | 19338/65536 [3:36:57<8:32:57,  1.50it/s]
 30%|██▉       | 19339/65536 [3:36:57<8:37:25,  1.49it/s]
 30%|██▉       | 19340/65536 [3:36:58<8:20:21,  1.54it/s]
                                                         
{'loss': 0.913, 'learning_rate': 7.363474960205706e-07, 'epoch': 1193.83}

 30%|██▉       | 19340/65536 [3:36:58<8:20:21,  1.54it/s]
 30%|██▉       | 19341/65536 [3:36:58<8:25:15,  1.52it/s]
 30%|██▉       | 19342/65536 [3:36:59<8:24:35,  1.53it/s]
 30%|██▉       | 19343/65536 [3:37:00<9:02:19,  1.42it/s]
 30%|██▉       | 19344/65536 [3:37:01<9:03:22,  1.42it/s]
 30%|██▉       | 19345/65536 [3:37:01<8:53:47,  1.44it/s]
 30%|██▉       | 19346/65536 [3:37:02<8:54:06,  1.44it/s]
 30%|██▉       | 19347/65536 [3:37:03<8:36:22,  1.49it/s]
 30%|██▉       | 19348/65536 [3:37:03<8:39:46,  1.48it/s]
 30%|██▉       | 19349/65536 [3:37:04<8:33:57,  1.50it/s]
 30%|██▉       | 19350/65536 [3:37:05<8:32:17,  1.50it/s]
 30%|██▉       | 19351/65536 [3:37:05<8:29:15,  1.51it/s]
 30%|██▉       | 19352/65536 [3:37:06<8:30:59,  1.51it/s]
 30%|██▉       | 19353/65536 [3:37:07<8:22:37,  1.53it/s]
 30%|██▉       | 19354/65536 [3:37:07<8:25:54,  1.52it/s]
 30%|██▉       | 19355/65536 [3:37:08<8:29:37,  1.51it/s]
 30%|██▉       | 19356/65536 [3:37:09<8:36:29,  1.49it/s]
 30%|██▉       | 19357/65536 [3:37:09<8:38:34,  1.48it/s]
 30%|██▉       | 19358/65536 [3:37:10<8:36:09,  1.49it/s]
 30%|██▉       | 19359/65536 [3:37:11<8:36:09,  1.49it/s]
 30%|██▉       | 19360/65536 [3:37:11<8:46:38,  1.46it/s]
                                                         
{'loss': 0.9092, 'learning_rate': 7.360719970613444e-07, 'epoch': 1195.06}

 30%|██▉       | 19360/65536 [3:37:11<8:46:38,  1.46it/s]
 30%|██▉       | 19361/65536 [3:37:12<8:40:56,  1.48it/s]
 30%|██▉       | 19362/65536 [3:37:13<8:37:53,  1.49it/s]
 30%|██▉       | 19363/65536 [3:37:13<8:39:24,  1.48it/s]
 30%|██▉       | 19364/65536 [3:37:14<8:41:51,  1.47it/s]
 30%|██▉       | 19365/65536 [3:37:15<8:56:21,  1.43it/s]
 30%|██▉       | 19366/65536 [3:37:15<8:52:00,  1.45it/s]
 30%|██▉       | 19367/65536 [3:37:16<8:51:53,  1.45it/s]
 30%|██▉       | 19368/65536 [3:37:17<8:43:05,  1.47it/s]
 30%|██▉       | 19369/65536 [3:37:17<8:41:56,  1.47it/s]
 30%|██▉       | 19370/65536 [3:37:18<8:42:09,  1.47it/s]
 30%|██▉       | 19371/65536 [3:37:19<8:26:50,  1.52it/s]
 30%|██▉       | 19372/65536 [3:37:19<8:20:09,  1.54it/s]
 30%|██▉       | 19373/65536 [3:37:20<8:26:17,  1.52it/s]
 30%|██▉       | 19374/65536 [3:37:21<8:23:52,  1.53it/s]
 30%|██▉       | 19375/65536 [3:37:21<8:28:53,  1.51it/s]
 30%|██▉       | 19376/65536 [3:37:22<8:42:41,  1.47it/s]
 30%|██▉       | 19377/65536 [3:37:23<8:38:58,  1.48it/s]
 30%|██▉       | 19378/65536 [3:37:23<8:29:10,  1.51it/s]
 30%|██▉       | 19379/65536 [3:37:24<8:25:42,  1.52it/s]
 30%|██▉       | 19380/65536 [3:37:25<8:38:55,  1.48it/s]
                                                         
{'loss': 0.9025, 'learning_rate': 7.357964981021183e-07, 'epoch': 1196.3}

 30%|██▉       | 19380/65536 [3:37:25<8:38:55,  1.48it/s]
 30%|██▉       | 19381/65536 [3:37:25<8:35:45,  1.49it/s]
 30%|██▉       | 19382/65536 [3:37:26<8:28:31,  1.51it/s]
 30%|██▉       | 19383/65536 [3:37:27<8:26:05,  1.52it/s]
 30%|██▉       | 19384/65536 [3:37:27<8:24:29,  1.52it/s]
 30%|██▉       | 19385/65536 [3:37:28<8:26:13,  1.52it/s]
 30%|██▉       | 19386/65536 [3:37:29<8:23:50,  1.53it/s]
 30%|██▉       | 19387/65536 [3:37:29<8:34:16,  1.50it/s]
 30%|██▉       | 19388/65536 [3:37:30<8:38:06,  1.48it/s]
 30%|██▉       | 19389/65536 [3:37:31<8:36:19,  1.49it/s]
 30%|██▉       | 19390/65536 [3:37:31<8:30:12,  1.51it/s]
 30%|██▉       | 19391/65536 [3:37:32<8:27:47,  1.51it/s]
 30%|██▉       | 19392/65536 [3:37:33<8:47:55,  1.46it/s]
 30%|██▉       | 19393/65536 [3:37:34<8:58:18,  1.43it/s]
 30%|██▉       | 19394/65536 [3:37:34<8:36:06,  1.49it/s]
 30%|██▉       | 19395/65536 [3:37:35<8:44:38,  1.47it/s]
 30%|██▉       | 19396/65536 [3:37:35<8:37:33,  1.49it/s]
 30%|██▉       | 19397/65536 [3:37:36<8:45:32,  1.46it/s]
 30%|██▉       | 19398/65536 [3:37:37<8:46:16,  1.46it/s]
 30%|██▉       | 19399/65536 [3:37:38<8:32:05,  1.50it/s]
 30%|██▉       | 19400/65536 [3:37:38<8:39:44,  1.48it/s]
                                                         
{'loss': 0.9021, 'learning_rate': 7.355209991428922e-07, 'epoch': 1197.53}

 30%|██▉       | 19400/65536 [3:37:38<8:39:44,  1.48it/s]
 30%|██▉       | 19401/65536 [3:37:39<8:42:25,  1.47it/s]
 30%|██▉       | 19402/65536 [3:37:40<8:40:03,  1.48it/s]
 30%|██▉       | 19403/65536 [3:37:40<8:36:32,  1.49it/s]
 30%|██▉       | 19404/65536 [3:37:41<8:45:57,  1.46it/s]
 30%|██▉       | 19405/65536 [3:37:42<8:25:51,  1.52it/s]
 30%|██▉       | 19406/65536 [3:37:42<8:25:43,  1.52it/s]
 30%|██▉       | 19407/65536 [3:37:43<8:23:22,  1.53it/s]
 30%|██▉       | 19408/65536 [3:37:44<8:38:17,  1.48it/s]
 30%|██▉       | 19409/65536 [3:37:44<8:34:00,  1.50it/s]
 30%|██▉       | 19410/65536 [3:37:45<8:27:50,  1.51it/s]
 30%|██▉       | 19411/65536 [3:37:46<8:29:27,  1.51it/s]
 30%|██▉       | 19412/65536 [3:37:46<8:45:42,  1.46it/s]
 30%|██▉       | 19413/65536 [3:37:47<8:48:53,  1.45it/s]
 30%|██▉       | 19414/65536 [3:37:48<8:38:29,  1.48it/s]
 30%|██▉       | 19415/65536 [3:37:48<8:33:04,  1.50it/s]
 30%|██▉       | 19416/65536 [3:37:49<8:24:19,  1.52it/s]
 30%|██▉       | 19417/65536 [3:37:50<8:21:57,  1.53it/s]
 30%|██▉       | 19418/65536 [3:37:50<8:26:27,  1.52it/s]
 30%|██▉       | 19419/65536 [3:37:51<8:30:13,  1.51it/s]
 30%|██▉       | 19420/65536 [3:37:52<8:40:55,  1.48it/s]
                                                         
{'loss': 0.8977, 'learning_rate': 7.35245500183666e-07, 'epoch': 1198.77}

 30%|██▉       | 19420/65536 [3:37:52<8:40:55,  1.48it/s]
 30%|██▉       | 19421/65536 [3:37:52<8:43:52,  1.47it/s]
 30%|██▉       | 19422/65536 [3:37:53<8:34:06,  1.49it/s]
 30%|██▉       | 19423/65536 [3:37:54<8:30:06,  1.51it/s]
 30%|██▉       | 19424/65536 [3:37:54<8:53:57,  1.44it/s]
 30%|██▉       | 19425/65536 [3:37:55<8:41:44,  1.47it/s]
 30%|██▉       | 19426/65536 [3:37:56<8:31:50,  1.50it/s]
 30%|██▉       | 19427/65536 [3:37:56<8:39:05,  1.48it/s]
 30%|██▉       | 19428/65536 [3:37:57<8:29:00,  1.51it/s]
 30%|██▉       | 19429/65536 [3:37:58<8:38:04,  1.48it/s]
 30%|██▉       | 19430/65536 [3:37:58<8:26:19,  1.52it/s]
 30%|██▉       | 19431/65536 [3:37:59<8:21:56,  1.53it/s]
 30%|██▉       | 19432/65536 [3:38:00<8:21:12,  1.53it/s]
 30%|██▉       | 19433/65536 [3:38:00<8:33:36,  1.50it/s]
 30%|██▉       | 19434/65536 [3:38:01<8:39:16,  1.48it/s]
 30%|██▉       | 19435/65536 [3:38:02<8:40:20,  1.48it/s]
 30%|██▉       | 19436/65536 [3:38:02<8:31:07,  1.50it/s]
 30%|██▉       | 19437/65536 [3:38:03<8:31:57,  1.50it/s]
 30%|██▉       | 19438/65536 [3:38:04<8:26:01,  1.52it/s]
 30%|██▉       | 19439/65536 [3:38:04<8:29:53,  1.51it/s]
 30%|██▉       | 19440/65536 [3:38:05<8:39:22,  1.48it/s]
                                                         
{'loss': 0.9184, 'learning_rate': 7.349700012244398e-07, 'epoch': 1200.0}

 30%|██▉       | 19440/65536 [3:38:05<8:39:22,  1.48it/s]
 30%|██▉       | 19441/65536 [3:38:06<8:48:45,  1.45it/s]
 30%|██▉       | 19442/65536 [3:38:06<8:40:43,  1.48it/s]
 30%|██▉       | 19443/65536 [3:38:07<8:36:32,  1.49it/s]
 30%|██▉       | 19444/65536 [3:38:08<8:37:59,  1.48it/s]
 30%|██▉       | 19445/65536 [3:38:08<8:33:44,  1.50it/s]
 30%|██▉       | 19446/65536 [3:38:09<8:32:19,  1.50it/s]
 30%|██▉       | 19447/65536 [3:38:10<8:28:23,  1.51it/s]
 30%|██▉       | 19448/65536 [3:38:10<8:35:55,  1.49it/s]
 30%|██▉       | 19449/65536 [3:38:11<8:30:02,  1.51it/s]
 30%|██▉       | 19450/65536 [3:38:12<8:34:11,  1.49it/s]
 30%|██▉       | 19451/65536 [3:38:12<8:55:15,  1.43it/s]
 30%|██▉       | 19452/65536 [3:38:13<8:44:02,  1.47it/s]
 30%|██▉       | 19453/65536 [3:38:14<8:29:31,  1.51it/s]
 30%|██▉       | 19454/65536 [3:38:14<8:18:36,  1.54it/s]
 30%|██▉       | 19455/65536 [3:38:15<8:21:24,  1.53it/s]
 30%|██▉       | 19456/65536 [3:38:16<8:38:37,  1.48it/s]
 30%|██▉       | 19457/65536 [3:38:16<8:48:06,  1.45it/s]
 30%|██▉       | 19458/65536 [3:38:17<8:45:35,  1.46it/s]
 30%|██▉       | 19459/65536 [3:38:18<8:39:02,  1.48it/s]
 30%|██▉       | 19460/65536 [3:38:18<8:35:03,  1.49it/s]
                                                         
{'loss': 0.907, 'learning_rate': 7.346945022652136e-07, 'epoch': 1201.23}

 30%|██▉       | 19460/65536 [3:38:18<8:35:03,  1.49it/s]
 30%|██▉       | 19461/65536 [3:38:19<8:32:13,  1.50it/s]
 30%|██▉       | 19462/65536 [3:38:20<8:24:02,  1.52it/s]
 30%|██▉       | 19463/65536 [3:38:20<8:23:54,  1.52it/s]
 30%|██▉       | 19464/65536 [3:38:21<8:20:14,  1.53it/s]
 30%|██▉       | 19465/65536 [3:38:22<8:16:00,  1.55it/s]
 30%|██▉       | 19466/65536 [3:38:22<8:19:45,  1.54it/s]
 30%|██▉       | 19467/65536 [3:38:23<8:29:02,  1.51it/s]
 30%|██▉       | 19468/65536 [3:38:24<8:48:19,  1.45it/s]
 30%|██▉       | 19469/65536 [3:38:24<8:41:53,  1.47it/s]
 30%|██▉       | 19470/65536 [3:38:25<8:39:35,  1.48it/s]
 30%|██▉       | 19471/65536 [3:38:26<8:34:55,  1.49it/s]
 30%|██▉       | 19472/65536 [3:38:26<8:37:19,  1.48it/s]
 30%|██▉       | 19473/65536 [3:38:27<9:01:37,  1.42it/s]
 30%|██▉       | 19474/65536 [3:38:28<8:51:26,  1.44it/s]
 30%|██▉       | 19475/65536 [3:38:29<8:59:12,  1.42it/s]
 30%|██▉       | 19476/65536 [3:38:29<8:52:26,  1.44it/s]
 30%|██▉       | 19477/65536 [3:38:30<8:36:33,  1.49it/s]
 30%|██▉       | 19478/65536 [3:38:30<8:27:25,  1.51it/s]
 30%|██▉       | 19479/65536 [3:38:31<8:20:45,  1.53it/s]
 30%|██▉       | 19480/65536 [3:38:32<8:07:08,  1.58it/s]
                                                         
{'loss': 0.9142, 'learning_rate': 7.344190033059875e-07, 'epoch': 1202.47}

 30%|██▉       | 19480/65536 [3:38:32<8:07:08,  1.58it/s]
 30%|██▉       | 19481/65536 [3:38:32<8:18:26,  1.54it/s]
 30%|██▉       | 19482/65536 [3:38:33<8:18:53,  1.54it/s]
 30%|██▉       | 19483/65536 [3:38:34<8:29:08,  1.51it/s]
 30%|██▉       | 19484/65536 [3:38:34<8:33:27,  1.49it/s]
 30%|██▉       | 19485/65536 [3:38:35<8:32:13,  1.50it/s]
 30%|██▉       | 19486/65536 [3:38:36<8:44:09,  1.46it/s]
 30%|██▉       | 19487/65536 [3:38:37<8:55:46,  1.43it/s]
 30%|██▉       | 19488/65536 [3:38:37<8:34:00,  1.49it/s]
 30%|██▉       | 19489/65536 [3:38:38<8:54:52,  1.43it/s]
 30%|██▉       | 19490/65536 [3:38:39<8:53:21,  1.44it/s]
 30%|██▉       | 19491/65536 [3:38:39<8:42:33,  1.47it/s]
 30%|██▉       | 19492/65536 [3:38:40<8:24:47,  1.52it/s]
 30%|██▉       | 19493/65536 [3:38:41<8:28:12,  1.51it/s]
 30%|██▉       | 19494/65536 [3:38:41<8:42:46,  1.47it/s]
 30%|██▉       | 19495/65536 [3:38:42<8:40:52,  1.47it/s]
 30%|██▉       | 19496/65536 [3:38:43<8:33:33,  1.49it/s]
 30%|██▉       | 19497/65536 [3:38:43<8:34:40,  1.49it/s]
 30%|██▉       | 19498/65536 [3:38:44<8:32:31,  1.50it/s]
 30%|██▉       | 19499/65536 [3:38:45<8:27:21,  1.51it/s]
 30%|██▉       | 19500/65536 [3:38:45<8:46:22,  1.46it/s]
                                                         
{'loss': 0.9151, 'learning_rate': 7.341435043467614e-07, 'epoch': 1203.7}

 30%|██▉       | 19500/65536 [3:38:45<8:46:22,  1.46it/s]
 30%|██▉       | 19501/65536 [3:38:46<8:52:30,  1.44it/s]
 30%|██▉       | 19502/65536 [3:38:47<8:41:49,  1.47it/s]
 30%|██▉       | 19503/65536 [3:38:47<8:25:31,  1.52it/s]
 30%|██▉       | 19504/65536 [3:38:48<8:18:03,  1.54it/s]
 30%|██▉       | 19505/65536 [3:38:49<8:30:04,  1.50it/s]
 30%|██▉       | 19506/65536 [3:38:49<8:30:08,  1.50it/s]
 30%|██▉       | 19507/65536 [3:38:50<8:33:39,  1.49it/s]
 30%|██▉       | 19508/65536 [3:38:51<8:23:57,  1.52it/s]
 30%|██▉       | 19509/65536 [3:38:51<8:43:29,  1.47it/s]
 30%|██▉       | 19510/65536 [3:38:52<8:43:12,  1.47it/s]
 30%|██▉       | 19511/65536 [3:38:53<8:36:00,  1.49it/s]
 30%|██▉       | 19512/65536 [3:38:53<8:41:09,  1.47it/s]
 30%|██▉       | 19513/65536 [3:38:54<8:40:22,  1.47it/s]
 30%|██▉       | 19514/65536 [3:38:55<8:26:59,  1.51it/s]
 30%|██▉       | 19515/65536 [3:38:55<8:27:08,  1.51it/s]
 30%|██▉       | 19516/65536 [3:38:56<8:15:18,  1.55it/s]
 30%|██▉       | 19517/65536 [3:38:57<8:28:06,  1.51it/s]
 30%|██▉       | 19518/65536 [3:38:57<8:28:22,  1.51it/s]
 30%|██▉       | 19519/65536 [3:38:58<8:24:55,  1.52it/s]
 30%|██▉       | 19520/65536 [3:38:59<8:24:12,  1.52it/s]
                                                         
{'loss': 0.9141, 'learning_rate': 7.338680053875351e-07, 'epoch': 1204.94}

 30%|██▉       | 19520/65536 [3:38:59<8:24:12,  1.52it/s]
 30%|██▉       | 19521/65536 [3:38:59<8:33:24,  1.49it/s]
 30%|██▉       | 19522/65536 [3:39:00<8:44:10,  1.46it/s]
 30%|██▉       | 19523/65536 [3:39:01<8:44:39,  1.46it/s]
 30%|██▉       | 19524/65536 [3:39:01<8:49:45,  1.45it/s]
 30%|██▉       | 19525/65536 [3:39:02<8:35:37,  1.49it/s]
 30%|██▉       | 19526/65536 [3:39:03<8:40:54,  1.47it/s]
 30%|██▉       | 19527/65536 [3:39:03<8:19:40,  1.53it/s]
 30%|██▉       | 19528/65536 [3:39:04<8:35:40,  1.49it/s]
 30%|██▉       | 19529/65536 [3:39:05<9:03:32,  1.41it/s]
 30%|██▉       | 19530/65536 [3:39:05<8:48:58,  1.45it/s]
 30%|██▉       | 19531/65536 [3:39:06<8:51:48,  1.44it/s]
 30%|██▉       | 19532/65536 [3:39:07<8:44:45,  1.46it/s]
 30%|██▉       | 19533/65536 [3:39:07<8:31:41,  1.50it/s]
 30%|██▉       | 19534/65536 [3:39:08<8:28:58,  1.51it/s]
 30%|██▉       | 19535/65536 [3:39:09<8:30:15,  1.50it/s]
 30%|██▉       | 19536/65536 [3:39:09<8:28:29,  1.51it/s]
 30%|██▉       | 19537/65536 [3:39:10<8:26:10,  1.51it/s]
 30%|██▉       | 19538/65536 [3:39:11<8:56:30,  1.43it/s]
 30%|██▉       | 19539/65536 [3:39:12<8:53:12,  1.44it/s]
 30%|██▉       | 19540/65536 [3:39:12<8:59:24,  1.42it/s]
                                                         
{'loss': 0.8908, 'learning_rate': 7.33592506428309e-07, 'epoch': 1206.17}

 30%|██▉       | 19540/65536 [3:39:12<8:59:24,  1.42it/s]
 30%|██▉       | 19541/65536 [3:39:13<8:54:10,  1.44it/s]
 30%|██▉       | 19542/65536 [3:39:14<8:39:03,  1.48it/s]
 30%|██▉       | 19543/65536 [3:39:14<8:42:13,  1.47it/s]
 30%|██▉       | 19544/65536 [3:39:15<8:37:06,  1.48it/s]
 30%|██▉       | 19545/65536 [3:39:16<8:50:53,  1.44it/s]
 30%|██▉       | 19546/65536 [3:39:16<8:25:39,  1.52it/s]
 30%|██▉       | 19547/65536 [3:39:17<8:27:09,  1.51it/s]
 30%|██▉       | 19548/65536 [3:39:18<8:25:06,  1.52it/s]
 30%|██▉       | 19549/65536 [3:39:18<8:38:54,  1.48it/s]
 30%|██▉       | 19550/65536 [3:39:19<8:35:15,  1.49it/s]
 30%|██▉       | 19551/65536 [3:39:20<8:29:10,  1.51it/s]
 30%|██▉       | 19552/65536 [3:39:20<8:22:25,  1.53it/s]
 30%|██▉       | 19553/65536 [3:39:21<8:27:07,  1.51it/s]
 30%|██▉       | 19554/65536 [3:39:22<8:49:13,  1.45it/s]
 30%|██▉       | 19555/65536 [3:39:22<8:32:53,  1.49it/s]
 30%|██▉       | 19556/65536 [3:39:23<8:29:37,  1.50it/s]
 30%|██▉       | 19557/65536 [3:39:24<8:33:53,  1.49it/s]
 30%|██▉       | 19558/65536 [3:39:24<8:33:55,  1.49it/s]
 30%|██▉       | 19559/65536 [3:39:25<8:38:49,  1.48it/s]
 30%|██▉       | 19560/65536 [3:39:26<8:21:40,  1.53it/s]
                                                         
{'loss': 0.902, 'learning_rate': 7.333170074690828e-07, 'epoch': 1207.41}

 30%|██▉       | 19560/65536 [3:39:26<8:21:40,  1.53it/s]
 30%|██▉       | 19561/65536 [3:39:26<8:31:56,  1.50it/s]
 30%|██▉       | 19562/65536 [3:39:27<8:34:57,  1.49it/s]
 30%|██▉       | 19563/65536 [3:39:28<8:42:13,  1.47it/s]
 30%|██▉       | 19564/65536 [3:39:28<8:36:07,  1.48it/s]
 30%|██▉       | 19565/65536 [3:39:29<8:34:10,  1.49it/s]
 30%|██▉       | 19566/65536 [3:39:30<8:41:56,  1.47it/s]
 30%|██▉       | 19567/65536 [3:39:30<8:29:05,  1.50it/s]
 30%|██▉       | 19568/65536 [3:39:31<8:33:20,  1.49it/s]
 30%|██▉       | 19569/65536 [3:39:32<8:24:32,  1.52it/s]
 30%|██▉       | 19570/65536 [3:39:32<8:51:47,  1.44it/s]
 30%|██▉       | 19571/65536 [3:39:33<8:50:40,  1.44it/s]
 30%|██▉       | 19572/65536 [3:39:34<8:38:48,  1.48it/s]
 30%|██▉       | 19573/65536 [3:39:34<8:25:43,  1.51it/s]
 30%|██▉       | 19574/65536 [3:39:35<8:22:44,  1.52it/s]
 30%|██▉       | 19575/65536 [3:39:36<8:27:31,  1.51it/s]
 30%|██▉       | 19576/65536 [3:39:36<8:14:33,  1.55it/s]
 30%|██▉       | 19577/65536 [3:39:37<8:10:13,  1.56it/s]
 30%|██▉       | 19578/65536 [3:39:38<8:22:54,  1.52it/s]
 30%|██▉       | 19579/65536 [3:39:38<8:27:55,  1.51it/s]
 30%|██▉       | 19580/65536 [3:39:39<8:29:06,  1.50it/s]
                                                         
{'loss': 0.9073, 'learning_rate': 7.330415085098567e-07, 'epoch': 1208.64}

 30%|██▉       | 19580/65536 [3:39:39<8:29:06,  1.50it/s]
 30%|██▉       | 19581/65536 [3:39:40<8:11:25,  1.56it/s]
 30%|██▉       | 19582/65536 [3:39:40<8:16:07,  1.54it/s]
 30%|██▉       | 19583/65536 [3:39:41<8:14:49,  1.55it/s]
 30%|██▉       | 19584/65536 [3:39:42<8:14:15,  1.55it/s]
 30%|██▉       | 19585/65536 [3:39:42<8:36:33,  1.48it/s]
 30%|██▉       | 19586/65536 [3:39:43<8:49:37,  1.45it/s]
 30%|██▉       | 19587/65536 [3:39:44<8:43:52,  1.46it/s]
 30%|██▉       | 19588/65536 [3:39:44<8:36:31,  1.48it/s]
 30%|██▉       | 19589/65536 [3:39:45<8:42:29,  1.47it/s]
 30%|██▉       | 19590/65536 [3:39:46<8:35:58,  1.48it/s]
 30%|██▉       | 19591/65536 [3:39:46<8:45:45,  1.46it/s]
 30%|██▉       | 19592/65536 [3:39:47<8:37:02,  1.48it/s]
 30%|██▉       | 19593/65536 [3:39:48<8:50:40,  1.44it/s]
 30%|██▉       | 19594/65536 [3:39:48<8:41:01,  1.47it/s]
 30%|██▉       | 19595/65536 [3:39:49<8:30:16,  1.50it/s]
 30%|██▉       | 19596/65536 [3:39:50<8:27:24,  1.51it/s]
 30%|██▉       | 19597/65536 [3:39:50<8:33:26,  1.49it/s]
 30%|██▉       | 19598/65536 [3:39:51<8:34:16,  1.49it/s]
 30%|██▉       | 19599/65536 [3:39:52<8:40:37,  1.47it/s]
 30%|██▉       | 19600/65536 [3:39:52<8:38:48,  1.48it/s]
                                                         
{'loss': 0.9073, 'learning_rate': 7.327660095506305e-07, 'epoch': 1209.88}

 30%|██▉       | 19600/65536 [3:39:52<8:38:48,  1.48it/s]
 30%|██▉       | 19601/65536 [3:39:53<8:43:22,  1.46it/s]
 30%|██▉       | 19602/65536 [3:39:54<8:40:08,  1.47it/s]
 30%|██▉       | 19603/65536 [3:39:55<8:47:47,  1.45it/s]
 30%|██▉       | 19604/65536 [3:39:55<8:42:56,  1.46it/s]
 30%|██▉       | 19605/65536 [3:39:56<8:35:06,  1.49it/s]
 30%|██▉       | 19606/65536 [3:39:56<8:30:19,  1.50it/s]
 30%|██▉       | 19607/65536 [3:39:57<8:28:07,  1.51it/s]
 30%|██▉       | 19608/65536 [3:39:58<8:35:54,  1.48it/s]
 30%|██▉       | 19609/65536 [3:39:59<8:38:05,  1.48it/s]
 30%|██▉       | 19610/65536 [3:39:59<8:32:05,  1.49it/s]
 30%|██▉       | 19611/65536 [3:40:00<8:29:37,  1.50it/s]
 30%|██▉       | 19612/65536 [3:40:01<8:42:03,  1.47it/s]
 30%|██▉       | 19613/65536 [3:40:01<8:37:00,  1.48it/s]
 30%|██▉       | 19614/65536 [3:40:02<8:36:37,  1.48it/s]
 30%|██▉       | 19615/65536 [3:40:03<8:25:01,  1.52it/s]
 30%|██▉       | 19616/65536 [3:40:03<8:32:22,  1.49it/s]
 30%|██▉       | 19617/65536 [3:40:04<8:47:20,  1.45it/s]
 30%|██▉       | 19618/65536 [3:40:05<8:37:43,  1.48it/s]
 30%|██▉       | 19619/65536 [3:40:05<9:01:37,  1.41it/s]
 30%|██▉       | 19620/65536 [3:40:06<8:48:44,  1.45it/s]
                                                         
{'loss': 0.9063, 'learning_rate': 7.324905105914044e-07, 'epoch': 1211.11}

 30%|██▉       | 19620/65536 [3:40:06<8:48:44,  1.45it/s]
 30%|██▉       | 19621/65536 [3:40:07<8:58:10,  1.42it/s]
 30%|██▉       | 19622/65536 [3:40:07<8:42:10,  1.47it/s]
 30%|██▉       | 19623/65536 [3:40:08<8:43:46,  1.46it/s]
 30%|██▉       | 19624/65536 [3:40:09<8:35:14,  1.49it/s]
 30%|██▉       | 19625/65536 [3:40:09<8:27:47,  1.51it/s]
 30%|██▉       | 19626/65536 [3:40:10<8:30:41,  1.50it/s]
 30%|██▉       | 19627/65536 [3:40:11<8:39:22,  1.47it/s]
 30%|██▉       | 19628/65536 [3:40:11<8:41:55,  1.47it/s]
 30%|██▉       | 19629/65536 [3:40:12<8:25:30,  1.51it/s]
 30%|██▉       | 19630/65536 [3:40:13<8:20:37,  1.53it/s]
 30%|██▉       | 19631/65536 [3:40:13<8:32:13,  1.49it/s]
 30%|██▉       | 19632/65536 [3:40:14<8:31:01,  1.50it/s]
 30%|██▉       | 19633/65536 [3:40:15<8:35:24,  1.48it/s]
 30%|██▉       | 19634/65536 [3:40:15<8:33:18,  1.49it/s]
 30%|██▉       | 19635/65536 [3:40:16<8:45:51,  1.45it/s]
 30%|██▉       | 19636/65536 [3:40:17<8:49:35,  1.44it/s]
 30%|██▉       | 19637/65536 [3:40:17<8:35:14,  1.48it/s]
 30%|██▉       | 19638/65536 [3:40:18<8:33:17,  1.49it/s]
 30%|██▉       | 19639/65536 [3:40:19<8:30:45,  1.50it/s]
 30%|██▉       | 19640/65536 [3:40:19<8:24:21,  1.52it/s]
                                                         
{'loss': 0.8967, 'learning_rate': 7.322150116321783e-07, 'epoch': 1212.35}

 30%|██▉       | 19640/65536 [3:40:19<8:24:21,  1.52it/s]
 30%|██▉       | 19641/65536 [3:40:20<8:29:20,  1.50it/s]
 30%|██▉       | 19642/65536 [3:40:21<8:31:32,  1.50it/s]
 30%|██▉       | 19643/65536 [3:40:21<8:33:04,  1.49it/s]
 30%|██▉       | 19644/65536 [3:40:22<8:37:56,  1.48it/s]
 30%|██▉       | 19645/65536 [3:40:23<8:27:23,  1.51it/s]
 30%|██▉       | 19646/65536 [3:40:23<8:18:19,  1.53it/s]
 30%|██▉       | 19647/65536 [3:40:24<8:19:26,  1.53it/s]
 30%|██▉       | 19648/65536 [3:40:25<8:29:44,  1.50it/s]
 30%|██▉       | 19649/65536 [3:40:25<8:36:25,  1.48it/s]
 30%|██▉       | 19650/65536 [3:40:26<8:39:40,  1.47it/s]
 30%|██▉       | 19651/65536 [3:40:27<9:00:48,  1.41it/s]
 30%|██▉       | 19652/65536 [3:40:28<8:52:35,  1.44it/s]
 30%|██▉       | 19653/65536 [3:40:28<9:03:19,  1.41it/s]
 30%|██▉       | 19654/65536 [3:40:29<8:51:52,  1.44it/s]
 30%|██▉       | 19655/65536 [3:40:30<8:37:14,  1.48it/s]
 30%|██▉       | 19656/65536 [3:40:30<8:24:44,  1.51it/s]
 30%|██▉       | 19657/65536 [3:40:31<8:38:52,  1.47it/s]
 30%|██▉       | 19658/65536 [3:40:32<8:44:21,  1.46it/s]
 30%|██▉       | 19659/65536 [3:40:32<8:39:37,  1.47it/s]
 30%|██▉       | 19660/65536 [3:40:33<8:27:55,  1.51it/s]
                                                         
{'loss': 0.8988, 'learning_rate': 7.31939512672952e-07, 'epoch': 1213.58}

 30%|██▉       | 19660/65536 [3:40:33<8:27:55,  1.51it/s]
 30%|███       | 19661/65536 [3:40:34<8:28:41,  1.50it/s]
 30%|███       | 19662/65536 [3:40:34<8:24:46,  1.51it/s]
 30%|███       | 19663/65536 [3:40:35<8:24:20,  1.52it/s]
 30%|███       | 19664/65536 [3:40:36<8:15:28,  1.54it/s]
 30%|███       | 19665/65536 [3:40:36<8:27:30,  1.51it/s]
 30%|███       | 19666/65536 [3:40:37<8:36:24,  1.48it/s]
 30%|███       | 19667/65536 [3:40:38<8:57:47,  1.42it/s]
 30%|███       | 19668/65536 [3:40:38<8:56:29,  1.42it/s]
 30%|███       | 19669/65536 [3:40:39<8:40:33,  1.47it/s]
 30%|███       | 19670/65536 [3:40:40<8:43:02,  1.46it/s]
 30%|███       | 19671/65536 [3:40:40<8:45:11,  1.46it/s]
 30%|███       | 19672/65536 [3:40:41<8:47:07,  1.45it/s]
 30%|███       | 19673/65536 [3:40:42<8:43:51,  1.46it/s]
 30%|███       | 19674/65536 [3:40:42<8:39:23,  1.47it/s]
 30%|███       | 19675/65536 [3:40:43<8:27:46,  1.51it/s]
 30%|███       | 19676/65536 [3:40:44<8:20:46,  1.53it/s]
 30%|███       | 19677/65536 [3:40:44<8:25:06,  1.51it/s]
 30%|███       | 19678/65536 [3:40:45<8:21:17,  1.52it/s]
 30%|███       | 19679/65536 [3:40:46<8:22:26,  1.52it/s]
 30%|███       | 19680/65536 [3:40:46<8:09:47,  1.56it/s]
                                                         
{'loss': 0.9202, 'learning_rate': 7.31664013713726e-07, 'epoch': 1214.81}

 30%|███       | 19680/65536 [3:40:46<8:09:47,  1.56it/s]
 30%|███       | 19681/65536 [3:40:47<8:10:29,  1.56it/s]
 30%|███       | 19682/65536 [3:40:48<8:25:19,  1.51it/s]
 30%|███       | 19683/65536 [3:40:48<8:26:03,  1.51it/s]
 30%|███       | 19684/65536 [3:40:49<8:46:55,  1.45it/s]
 30%|███       | 19685/65536 [3:40:50<8:47:19,  1.45it/s]
 30%|███       | 19686/65536 [3:40:50<8:32:37,  1.49it/s]
 30%|███       | 19687/65536 [3:40:51<8:20:05,  1.53it/s]
 30%|███       | 19688/65536 [3:40:52<8:20:52,  1.53it/s]
 30%|███       | 19689/65536 [3:40:52<8:18:24,  1.53it/s]
 30%|███       | 19690/65536 [3:40:53<8:20:35,  1.53it/s]
 30%|███       | 19691/65536 [3:40:54<8:21:07,  1.52it/s]
 30%|███       | 19692/65536 [3:40:54<8:34:19,  1.49it/s]
 30%|███       | 19693/65536 [3:40:55<8:38:31,  1.47it/s]
 30%|███       | 19694/65536 [3:40:56<8:34:16,  1.49it/s]
 30%|███       | 19695/65536 [3:40:56<8:32:29,  1.49it/s]
 30%|███       | 19696/65536 [3:40:57<8:14:43,  1.54it/s]
 30%|███       | 19697/65536 [3:40:58<8:21:51,  1.52it/s]
 30%|███       | 19698/65536 [3:40:58<8:29:17,  1.50it/s]
 30%|███       | 19699/65536 [3:40:59<8:29:29,  1.50it/s]
 30%|███       | 19700/65536 [3:41:00<8:49:03,  1.44it/s]
                                                         
{'loss': 0.922, 'learning_rate': 7.313885147544998e-07, 'epoch': 1216.05}

 30%|███       | 19700/65536 [3:41:00<8:49:03,  1.44it/s]
 30%|███       | 19701/65536 [3:41:00<8:38:02,  1.47it/s]
 30%|███       | 19702/65536 [3:41:01<8:24:09,  1.52it/s]
 30%|███       | 19703/65536 [3:41:02<8:15:28,  1.54it/s]
 30%|███       | 19704/65536 [3:41:02<8:24:24,  1.51it/s]
 30%|███       | 19705/65536 [3:41:03<8:34:29,  1.48it/s]
 30%|███       | 19706/65536 [3:41:04<8:40:03,  1.47it/s]
 30%|███       | 19707/65536 [3:41:04<8:55:01,  1.43it/s]
 30%|███       | 19708/65536 [3:41:05<8:33:03,  1.49it/s]
 30%|███       | 19709/65536 [3:41:06<8:22:34,  1.52it/s]
 30%|███       | 19710/65536 [3:41:06<8:23:14,  1.52it/s]
 30%|███       | 19711/65536 [3:41:07<8:21:39,  1.52it/s]
 30%|███       | 19712/65536 [3:41:08<8:18:15,  1.53it/s]
 30%|███       | 19713/65536 [3:41:08<8:25:04,  1.51it/s]
 30%|███       | 19714/65536 [3:41:09<8:32:28,  1.49it/s]
 30%|███       | 19715/65536 [3:41:10<8:20:20,  1.53it/s]
 30%|███       | 19716/65536 [3:41:10<8:42:27,  1.46it/s]
 30%|███       | 19717/65536 [3:41:11<8:36:33,  1.48it/s]
 30%|███       | 19718/65536 [3:41:12<8:29:21,  1.50it/s]
 30%|███       | 19719/65536 [3:41:12<8:29:16,  1.50it/s]
 30%|███       | 19720/65536 [3:41:13<8:45:11,  1.45it/s]
                                                         
{'loss': 0.9225, 'learning_rate': 7.311130157952736e-07, 'epoch': 1217.28}

 30%|███       | 19720/65536 [3:41:13<8:45:11,  1.45it/s]
 30%|███       | 19721/65536 [3:41:14<8:25:13,  1.51it/s]
 30%|███       | 19722/65536 [3:41:14<8:17:14,  1.54it/s]
 30%|███       | 19723/65536 [3:41:15<8:41:22,  1.46it/s]
 30%|███       | 19724/65536 [3:41:16<8:30:48,  1.49it/s]
 30%|███       | 19725/65536 [3:41:16<8:32:37,  1.49it/s]
 30%|███       | 19726/65536 [3:41:17<8:33:56,  1.49it/s]
 30%|███       | 19727/65536 [3:41:18<8:23:51,  1.52it/s]
 30%|███       | 19728/65536 [3:41:18<8:18:48,  1.53it/s]
 30%|███       | 19729/65536 [3:41:19<8:16:53,  1.54it/s]
 30%|███       | 19730/65536 [3:41:20<8:33:25,  1.49it/s]
 30%|███       | 19731/65536 [3:41:20<8:29:58,  1.50it/s]
 30%|███       | 19732/65536 [3:41:21<8:47:46,  1.45it/s]
 30%|███       | 19733/65536 [3:41:22<8:33:53,  1.49it/s]
 30%|███       | 19734/65536 [3:41:22<8:36:14,  1.48it/s]
 30%|███       | 19735/65536 [3:41:23<8:46:07,  1.45it/s]
 30%|███       | 19736/65536 [3:41:24<8:43:42,  1.46it/s]
 30%|███       | 19737/65536 [3:41:25<8:43:33,  1.46it/s]
 30%|███       | 19738/65536 [3:41:25<8:34:11,  1.48it/s]
 30%|███       | 19739/65536 [3:41:26<8:30:11,  1.50it/s]
 30%|███       | 19740/65536 [3:41:26<8:22:00,  1.52it/s]
                                                         
{'loss': 0.9137, 'learning_rate': 7.308375168360474e-07, 'epoch': 1218.52}

 30%|███       | 19740/65536 [3:41:26<8:22:00,  1.52it/s]
 30%|███       | 19741/65536 [3:41:27<8:30:38,  1.49it/s]
 30%|███       | 19742/65536 [3:41:28<8:37:42,  1.47it/s]
 30%|███       | 19743/65536 [3:41:28<8:27:21,  1.50it/s]
 30%|███       | 19744/65536 [3:41:29<8:32:09,  1.49it/s]
 30%|███       | 19745/65536 [3:41:30<8:30:49,  1.49it/s]
 30%|███       | 19746/65536 [3:41:30<8:23:10,  1.52it/s]
 30%|███       | 19747/65536 [3:41:31<8:31:05,  1.49it/s]
 30%|███       | 19748/65536 [3:41:32<8:46:58,  1.45it/s]
 30%|███       | 19749/65536 [3:41:33<8:35:04,  1.48it/s]
 30%|███       | 19750/65536 [3:41:33<8:29:18,  1.50it/s]
 30%|███       | 19751/65536 [3:41:34<8:32:06,  1.49it/s]
 30%|███       | 19752/65536 [3:41:34<8:17:51,  1.53it/s]
 30%|███       | 19753/65536 [3:41:35<8:18:09,  1.53it/s]
 30%|███       | 19754/65536 [3:41:36<8:30:35,  1.49it/s]
 30%|███       | 19755/65536 [3:41:37<8:32:43,  1.49it/s]
 30%|███       | 19756/65536 [3:41:37<8:22:53,  1.52it/s]
 30%|███       | 19757/65536 [3:41:38<8:18:05,  1.53it/s]
 30%|███       | 19758/65536 [3:41:39<8:42:45,  1.46it/s]
 30%|███       | 19759/65536 [3:41:39<8:41:15,  1.46it/s]
 30%|███       | 19760/65536 [3:41:40<8:43:26,  1.46it/s]
                                                         
{'loss': 0.886, 'learning_rate': 7.305620178768213e-07, 'epoch': 1219.75}

 30%|███       | 19760/65536 [3:41:40<8:43:26,  1.46it/s]
 30%|███       | 19761/65536 [3:41:41<8:37:38,  1.47it/s]
 30%|███       | 19762/65536 [3:41:41<8:48:32,  1.44it/s]
 30%|███       | 19763/65536 [3:41:42<8:34:53,  1.48it/s]
 30%|███       | 19764/65536 [3:41:43<8:24:55,  1.51it/s]
 30%|███       | 19765/65536 [3:41:43<8:47:21,  1.45it/s]
 30%|███       | 19766/65536 [3:41:44<8:46:21,  1.45it/s]
 30%|███       | 19767/65536 [3:41:45<8:53:00,  1.43it/s]
 30%|███       | 19768/65536 [3:41:45<8:33:23,  1.49it/s]
 30%|███       | 19769/65536 [3:41:46<8:26:27,  1.51it/s]
 30%|███       | 19770/65536 [3:41:47<8:32:38,  1.49it/s]
 30%|███       | 19771/65536 [3:41:47<8:37:03,  1.48it/s]
 30%|███       | 19772/65536 [3:41:48<8:35:29,  1.48it/s]
 30%|███       | 19773/65536 [3:41:49<8:25:52,  1.51it/s]
 30%|███       | 19774/65536 [3:41:49<8:20:34,  1.52it/s]
 30%|███       | 19775/65536 [3:41:50<8:24:06,  1.51it/s]
 30%|███       | 19776/65536 [3:41:51<8:26:21,  1.51it/s]
 30%|███       | 19777/65536 [3:41:51<8:23:12,  1.52it/s]
 30%|███       | 19778/65536 [3:41:52<8:17:27,  1.53it/s]
 30%|███       | 19779/65536 [3:41:53<8:18:06,  1.53it/s]
 30%|███       | 19780/65536 [3:41:53<8:26:09,  1.51it/s]
                                                         
{'loss': 0.9284, 'learning_rate': 7.302865189175951e-07, 'epoch': 1220.99}

 30%|███       | 19780/65536 [3:41:53<8:26:09,  1.51it/s]
 30%|███       | 19781/65536 [3:41:54<8:51:18,  1.44it/s]
 30%|███       | 19782/65536 [3:41:55<8:36:53,  1.48it/s]
 30%|███       | 19783/65536 [3:41:55<8:39:24,  1.47it/s]
 30%|███       | 19784/65536 [3:41:56<8:27:12,  1.50it/s]
 30%|███       | 19785/65536 [3:41:57<8:28:12,  1.50it/s]
 30%|███       | 19786/65536 [3:41:57<8:31:23,  1.49it/s]
 30%|███       | 19787/65536 [3:41:58<8:19:50,  1.53it/s]
 30%|███       | 19788/65536 [3:41:59<8:16:52,  1.53it/s]
 30%|███       | 19789/65536 [3:41:59<8:34:15,  1.48it/s]
 30%|███       | 19790/65536 [3:42:00<8:20:24,  1.52it/s]
 30%|███       | 19791/65536 [3:42:01<8:16:41,  1.53it/s]
 30%|███       | 19792/65536 [3:42:01<8:32:22,  1.49it/s]
 30%|███       | 19793/65536 [3:42:02<8:37:26,  1.47it/s]
 30%|███       | 19794/65536 [3:42:03<8:37:45,  1.47it/s]
 30%|███       | 19795/65536 [3:42:03<8:36:38,  1.48it/s]
 30%|███       | 19796/65536 [3:42:04<8:41:02,  1.46it/s]
 30%|███       | 19797/65536 [3:42:05<8:54:32,  1.43it/s]
 30%|███       | 19798/65536 [3:42:06<8:51:19,  1.43it/s]
 30%|███       | 19799/65536 [3:42:06<8:46:55,  1.45it/s]
 30%|███       | 19800/65536 [3:42:07<8:36:30,  1.48it/s]
                                                         
{'loss': 0.903, 'learning_rate': 7.300110199583689e-07, 'epoch': 1222.22}

 30%|███       | 19800/65536 [3:42:07<8:36:30,  1.48it/s]
 30%|███       | 19801/65536 [3:42:07<8:26:02,  1.51it/s]
 30%|███       | 19802/65536 [3:42:08<8:18:53,  1.53it/s]
 30%|███       | 19803/65536 [3:42:09<8:34:31,  1.48it/s]
 30%|███       | 19804/65536 [3:42:09<8:25:18,  1.51it/s]
 30%|███       | 19805/65536 [3:42:10<8:28:40,  1.50it/s]
 30%|███       | 19806/65536 [3:42:11<8:35:47,  1.48it/s]
 30%|███       | 19807/65536 [3:42:11<8:19:55,  1.52it/s]
 30%|███       | 19808/65536 [3:42:12<8:26:18,  1.51it/s]
 30%|███       | 19809/65536 [3:42:13<8:32:14,  1.49it/s]
 30%|███       | 19810/65536 [3:42:13<8:29:27,  1.50it/s]
 30%|███       | 19811/65536 [3:42:14<8:38:49,  1.47it/s]
 30%|███       | 19812/65536 [3:42:15<8:36:13,  1.48it/s]
 30%|███       | 19813/65536 [3:42:16<8:47:15,  1.45it/s]
 30%|███       | 19814/65536 [3:42:16<8:29:49,  1.49it/s]
 30%|███       | 19815/65536 [3:42:17<8:43:34,  1.46it/s]
 30%|███       | 19816/65536 [3:42:18<8:41:41,  1.46it/s]
 30%|███       | 19817/65536 [3:42:18<8:35:36,  1.48it/s]
 30%|███       | 19818/65536 [3:42:19<8:35:51,  1.48it/s]
 30%|███       | 19819/65536 [3:42:20<8:39:58,  1.47it/s]
 30%|███       | 19820/65536 [3:42:20<8:33:58,  1.48it/s]
                                                         
{'loss': 0.9188, 'learning_rate': 7.297355209991428e-07, 'epoch': 1223.46}

 30%|███       | 19820/65536 [3:42:20<8:33:58,  1.48it/s]
 30%|███       | 19821/65536 [3:42:21<8:47:46,  1.44it/s]
 30%|███       | 19822/65536 [3:42:22<8:38:25,  1.47it/s]
 30%|███       | 19823/65536 [3:42:22<8:40:26,  1.46it/s]
 30%|███       | 19824/65536 [3:42:23<8:33:57,  1.48it/s]
 30%|███       | 19825/65536 [3:42:24<8:20:15,  1.52it/s]
 30%|███       | 19826/65536 [3:42:24<8:11:09,  1.55it/s]
 30%|███       | 19827/65536 [3:42:25<8:16:34,  1.53it/s]
 30%|███       | 19828/65536 [3:42:26<8:25:02,  1.51it/s]
 30%|███       | 19829/65536 [3:42:26<8:33:04,  1.48it/s]
 30%|███       | 19830/65536 [3:42:27<8:43:24,  1.46it/s]
 30%|███       | 19831/65536 [3:42:28<8:41:40,  1.46it/s]
 30%|███       | 19832/65536 [3:42:28<8:43:22,  1.46it/s]
 30%|███       | 19833/65536 [3:42:29<8:30:15,  1.49it/s]
 30%|███       | 19834/65536 [3:42:30<8:23:55,  1.51it/s]
 30%|███       | 19835/65536 [3:42:30<8:23:36,  1.51it/s]
 30%|███       | 19836/65536 [3:42:31<8:28:30,  1.50it/s]
 30%|███       | 19837/65536 [3:42:32<8:19:17,  1.53it/s]
 30%|███       | 19838/65536 [3:42:32<8:26:18,  1.50it/s]
 30%|███       | 19839/65536 [3:42:33<8:12:08,  1.55it/s]
 30%|███       | 19840/65536 [3:42:34<8:22:05,  1.52it/s]
                                                         
{'loss': 0.9182, 'learning_rate': 7.294600220399166e-07, 'epoch': 1224.69}

 30%|███       | 19840/65536 [3:42:34<8:22:05,  1.52it/s]
 30%|███       | 19841/65536 [3:42:34<8:15:51,  1.54it/s]
 30%|███       | 19842/65536 [3:42:35<8:21:00,  1.52it/s]
 30%|███       | 19843/65536 [3:42:36<8:22:34,  1.52it/s]
 30%|███       | 19844/65536 [3:42:36<8:22:25,  1.52it/s]
 30%|███       | 19845/65536 [3:42:37<8:27:15,  1.50it/s]
 30%|███       | 19846/65536 [3:42:38<8:47:16,  1.44it/s]
 30%|███       | 19847/65536 [3:42:38<8:55:30,  1.42it/s]
 30%|███       | 19848/65536 [3:42:39<8:40:54,  1.46it/s]
 30%|███       | 19849/65536 [3:42:40<9:01:20,  1.41it/s]
 30%|███       | 19850/65536 [3:42:40<8:46:18,  1.45it/s]
 30%|███       | 19851/65536 [3:42:41<8:41:36,  1.46it/s]
 30%|███       | 19852/65536 [3:42:42<8:33:16,  1.48it/s]
 30%|███       | 19853/65536 [3:42:42<8:35:25,  1.48it/s]
 30%|███       | 19854/65536 [3:42:43<8:30:47,  1.49it/s]
 30%|███       | 19855/65536 [3:42:44<8:22:11,  1.52it/s]
 30%|███       | 19856/65536 [3:42:44<8:15:27,  1.54it/s]
 30%|███       | 19857/65536 [3:42:45<8:20:24,  1.52it/s]
 30%|███       | 19858/65536 [3:42:46<8:21:49,  1.52it/s]
 30%|███       | 19859/65536 [3:42:46<8:27:13,  1.50it/s]
 30%|███       | 19860/65536 [3:42:47<8:34:18,  1.48it/s]
                                                         
{'loss': 0.9012, 'learning_rate': 7.291845230806905e-07, 'epoch': 1225.93}

 30%|███       | 19860/65536 [3:42:47<8:34:18,  1.48it/s]
 30%|███       | 19861/65536 [3:42:48<8:31:45,  1.49it/s]
 30%|███       | 19862/65536 [3:42:49<8:55:02,  1.42it/s]
 30%|███       | 19863/65536 [3:42:49<8:48:28,  1.44it/s]
 30%|███       | 19864/65536 [3:42:50<8:47:15,  1.44it/s]
 30%|███       | 19865/65536 [3:42:51<8:33:02,  1.48it/s]
 30%|███       | 19866/65536 [3:42:51<8:45:17,  1.45it/s]
 30%|███       | 19867/65536 [3:42:52<8:26:00,  1.50it/s]
 30%|███       | 19868/65536 [3:42:53<8:33:28,  1.48it/s]
 30%|███       | 19869/65536 [3:42:53<8:32:23,  1.49it/s]
 30%|███       | 19870/65536 [3:42:54<8:37:56,  1.47it/s]
 30%|███       | 19871/65536 [3:42:55<8:26:12,  1.50it/s]
 30%|███       | 19872/65536 [3:42:55<8:31:12,  1.49it/s]
 30%|███       | 19873/65536 [3:42:56<8:35:51,  1.48it/s]
 30%|███       | 19874/65536 [3:42:57<8:42:07,  1.46it/s]
 30%|███       | 19875/65536 [3:42:57<8:28:24,  1.50it/s]
 30%|███       | 19876/65536 [3:42:58<8:21:53,  1.52it/s]
 30%|███       | 19877/65536 [3:42:59<8:25:30,  1.51it/s]
 30%|███       | 19878/65536 [3:42:59<8:50:13,  1.44it/s]
 30%|███       | 19879/65536 [3:43:00<8:39:35,  1.46it/s]
 30%|███       | 19880/65536 [3:43:01<8:37:52,  1.47it/s]
                                                         
{'loss': 0.8928, 'learning_rate': 7.289090241214644e-07, 'epoch': 1227.16}

 30%|███       | 19880/65536 [3:43:01<8:37:52,  1.47it/s]
 30%|███       | 19881/65536 [3:43:01<8:35:16,  1.48it/s]
 30%|███       | 19882/65536 [3:43:02<8:33:21,  1.48it/s]
 30%|███       | 19883/65536 [3:43:03<8:46:46,  1.44it/s]
 30%|███       | 19884/65536 [3:43:03<8:32:16,  1.49it/s]
 30%|███       | 19885/65536 [3:43:04<8:16:28,  1.53it/s]
 30%|███       | 19886/65536 [3:43:05<8:18:24,  1.53it/s]
 30%|███       | 19887/65536 [3:43:05<8:16:08,  1.53it/s]
 30%|███       | 19888/65536 [3:43:06<8:24:10,  1.51it/s]
 30%|███       | 19889/65536 [3:43:07<8:15:36,  1.54it/s]
 30%|███       | 19890/65536 [3:43:07<8:28:26,  1.50it/s]
 30%|███       | 19891/65536 [3:43:08<8:27:59,  1.50it/s]
 30%|███       | 19892/65536 [3:43:09<8:37:05,  1.47it/s]
 30%|███       | 19893/65536 [3:43:09<8:23:40,  1.51it/s]
 30%|███       | 19894/65536 [3:43:10<8:56:19,  1.42it/s]
 30%|███       | 19895/65536 [3:43:11<8:34:31,  1.48it/s]
 30%|███       | 19896/65536 [3:43:11<8:26:52,  1.50it/s]
 30%|███       | 19897/65536 [3:43:12<8:11:38,  1.55it/s]
 30%|███       | 19898/65536 [3:43:13<8:08:31,  1.56it/s]
 30%|███       | 19899/65536 [3:43:13<8:15:21,  1.54it/s]
 30%|███       | 19900/65536 [3:43:14<8:23:13,  1.51it/s]
                                                         
{'loss': 0.9111, 'learning_rate': 7.286335251622382e-07, 'epoch': 1228.4}

 30%|███       | 19900/65536 [3:43:14<8:23:13,  1.51it/s]
 30%|███       | 19901/65536 [3:43:15<8:12:02,  1.55it/s]
 30%|███       | 19902/65536 [3:43:15<8:26:48,  1.50it/s]
 30%|███       | 19903/65536 [3:43:16<8:29:36,  1.49it/s]
 30%|███       | 19904/65536 [3:43:17<8:23:50,  1.51it/s]
 30%|███       | 19905/65536 [3:43:17<8:25:17,  1.51it/s]
 30%|███       | 19906/65536 [3:43:18<8:33:19,  1.48it/s]
 30%|███       | 19907/65536 [3:43:19<8:33:26,  1.48it/s]
 30%|███       | 19908/65536 [3:43:19<8:33:44,  1.48it/s]
 30%|███       | 19909/65536 [3:43:20<8:31:30,  1.49it/s]
 30%|███       | 19910/65536 [3:43:21<8:51:26,  1.43it/s]
 30%|███       | 19911/65536 [3:43:21<8:33:02,  1.48it/s]
 30%|███       | 19912/65536 [3:43:22<8:34:07,  1.48it/s]
 30%|███       | 19913/65536 [3:43:23<8:26:10,  1.50it/s]
 30%|███       | 19914/65536 [3:43:23<8:12:58,  1.54it/s]
 30%|███       | 19915/65536 [3:43:24<8:07:56,  1.56it/s]
 30%|███       | 19916/65536 [3:43:25<8:16:15,  1.53it/s]
 30%|███       | 19917/65536 [3:43:25<8:41:08,  1.46it/s]
 30%|███       | 19918/65536 [3:43:26<8:33:50,  1.48it/s]
 30%|███       | 19919/65536 [3:43:27<8:41:25,  1.46it/s]
 30%|███       | 19920/65536 [3:43:27<8:34:37,  1.48it/s]
                                                         
{'loss': 0.9035, 'learning_rate': 7.283580262030121e-07, 'epoch': 1229.63}

 30%|███       | 19920/65536 [3:43:27<8:34:37,  1.48it/s]
 30%|███       | 19921/65536 [3:43:28<8:31:34,  1.49it/s]
 30%|███       | 19922/65536 [3:43:29<8:42:05,  1.46it/s]
 30%|███       | 19923/65536 [3:43:29<8:44:24,  1.45it/s]
 30%|███       | 19924/65536 [3:43:30<8:31:36,  1.49it/s]
 30%|███       | 19925/65536 [3:43:31<8:24:59,  1.51it/s]
 30%|███       | 19926/65536 [3:43:31<8:19:55,  1.52it/s]
 30%|███       | 19927/65536 [3:43:32<8:57:28,  1.41it/s]
 30%|███       | 19928/65536 [3:43:33<8:53:06,  1.43it/s]
 30%|███       | 19929/65536 [3:43:34<8:51:26,  1.43it/s]
 30%|███       | 19930/65536 [3:43:34<8:32:23,  1.48it/s]
 30%|███       | 19931/65536 [3:43:35<8:35:21,  1.47it/s]
 30%|███       | 19932/65536 [3:43:36<8:32:56,  1.48it/s]
 30%|███       | 19933/65536 [3:43:36<8:30:42,  1.49it/s]
 30%|███       | 19934/65536 [3:43:37<8:36:35,  1.47it/s]
 30%|███       | 19935/65536 [3:43:38<8:38:01,  1.47it/s]
 30%|███       | 19936/65536 [3:43:38<8:39:30,  1.46it/s]
 30%|███       | 19937/65536 [3:43:39<8:27:44,  1.50it/s]
 30%|███       | 19938/65536 [3:43:40<8:29:30,  1.49it/s]
 30%|███       | 19939/65536 [3:43:40<8:13:52,  1.54it/s]
 30%|███       | 19940/65536 [3:43:41<8:07:13,  1.56it/s]
                                                         
{'loss': 0.8892, 'learning_rate': 7.28082527243786e-07, 'epoch': 1230.86}

 30%|███       | 19940/65536 [3:43:41<8:07:13,  1.56it/s]
 30%|███       | 19941/65536 [3:43:42<8:13:35,  1.54it/s]
 30%|███       | 19942/65536 [3:43:42<8:09:36,  1.55it/s]
 30%|███       | 19943/65536 [3:43:43<8:29:44,  1.49it/s]
 30%|███       | 19944/65536 [3:43:44<8:28:52,  1.49it/s]
 30%|███       | 19945/65536 [3:43:44<8:28:32,  1.49it/s]
 30%|███       | 19946/65536 [3:43:45<8:33:41,  1.48it/s]
 30%|███       | 19947/65536 [3:43:46<8:26:58,  1.50it/s]
 30%|███       | 19948/65536 [3:43:46<8:34:27,  1.48it/s]
 30%|███       | 19949/65536 [3:43:47<8:51:00,  1.43it/s]
 30%|███       | 19950/65536 [3:43:48<8:50:02,  1.43it/s]
 30%|███       | 19951/65536 [3:43:48<8:32:41,  1.48it/s]
 30%|███       | 19952/65536 [3:43:49<8:33:59,  1.48it/s]
 30%|███       | 19953/65536 [3:43:50<8:31:15,  1.49it/s]
 30%|███       | 19954/65536 [3:43:50<8:22:00,  1.51it/s]
 30%|███       | 19955/65536 [3:43:51<8:23:51,  1.51it/s]
 30%|███       | 19956/65536 [3:43:52<8:18:01,  1.53it/s]
 30%|███       | 19957/65536 [3:43:52<8:33:37,  1.48it/s]
 30%|███       | 19958/65536 [3:43:53<8:21:09,  1.52it/s]
 30%|███       | 19959/65536 [3:43:54<8:42:40,  1.45it/s]
 30%|███       | 19960/65536 [3:43:54<8:38:47,  1.46it/s]
                                                         
{'loss': 0.9051, 'learning_rate': 7.278070282845599e-07, 'epoch': 1232.1}

 30%|███       | 19960/65536 [3:43:54<8:38:47,  1.46it/s]
 30%|███       | 19961/65536 [3:43:55<8:32:21,  1.48it/s]
 30%|███       | 19962/65536 [3:43:56<8:36:19,  1.47it/s]
 30%|███       | 19963/65536 [3:43:56<8:44:58,  1.45it/s]
 30%|███       | 19964/65536 [3:43:57<8:45:00,  1.45it/s]
 30%|███       | 19965/65536 [3:43:58<8:46:31,  1.44it/s]
 30%|███       | 19966/65536 [3:43:58<8:31:32,  1.48it/s]
 30%|███       | 19967/65536 [3:43:59<8:32:23,  1.48it/s]
 30%|███       | 19968/65536 [3:44:00<8:26:10,  1.50it/s]
 30%|███       | 19969/65536 [3:44:00<8:39:29,  1.46it/s]
 30%|███       | 19970/65536 [3:44:01<8:37:22,  1.47it/s]
 30%|███       | 19971/65536 [3:44:02<8:43:14,  1.45it/s]
 30%|███       | 19972/65536 [3:44:03<8:33:03,  1.48it/s]
 30%|███       | 19973/65536 [3:44:03<8:25:00,  1.50it/s]
 30%|███       | 19974/65536 [3:44:04<8:26:09,  1.50it/s]
 30%|███       | 19975/65536 [3:44:05<8:41:42,  1.46it/s]
 30%|███       | 19976/65536 [3:44:05<8:33:52,  1.48it/s]
 30%|███       | 19977/65536 [3:44:06<8:37:18,  1.47it/s]
 30%|███       | 19978/65536 [3:44:07<8:48:05,  1.44it/s]
 30%|███       | 19979/65536 [3:44:07<8:59:40,  1.41it/s]
 30%|███       | 19980/65536 [3:44:08<8:35:11,  1.47it/s]
                                                         
{'loss': 0.8782, 'learning_rate': 7.275315293253336e-07, 'epoch': 1233.33}

 30%|███       | 19980/65536 [3:44:08<8:35:11,  1.47it/s]
 30%|███       | 19981/65536 [3:44:09<8:36:17,  1.47it/s]
 30%|███       | 19982/65536 [3:44:09<8:22:24,  1.51it/s]
 30%|███       | 19983/65536 [3:44:10<8:15:06,  1.53it/s]
 30%|███       | 19984/65536 [3:44:11<8:16:01,  1.53it/s]
 30%|███       | 19985/65536 [3:44:11<8:19:35,  1.52it/s]
 30%|███       | 19986/65536 [3:44:12<8:19:38,  1.52it/s]
 30%|███       | 19987/65536 [3:44:13<8:12:48,  1.54it/s]
 30%|███       | 19988/65536 [3:44:13<8:25:26,  1.50it/s]
 31%|███       | 19989/65536 [3:44:14<8:30:14,  1.49it/s]
 31%|███       | 19990/65536 [3:44:15<8:27:22,  1.50it/s]
 31%|███       | 19991/65536 [3:44:15<8:42:09,  1.45it/s]
 31%|███       | 19992/65536 [3:44:16<9:01:30,  1.40it/s]
 31%|███       | 19993/65536 [3:44:17<8:51:36,  1.43it/s]
 31%|███       | 19994/65536 [3:44:17<8:41:24,  1.46it/s]
 31%|███       | 19995/65536 [3:44:18<8:33:48,  1.48it/s]
 31%|███       | 19996/65536 [3:44:19<8:31:00,  1.49it/s]
 31%|███       | 19997/65536 [3:44:19<8:33:19,  1.48it/s]
 31%|███       | 19998/65536 [3:44:20<8:23:37,  1.51it/s]
 31%|███       | 19999/65536 [3:44:21<8:20:18,  1.52it/s]
 31%|███       | 20000/65536 [3:44:21<8:26:13,  1.50it/s]
                                                         
{'loss': 0.9069, 'learning_rate': 7.272560303661075e-07, 'epoch': 1234.57}

 31%|███       | 20000/65536 [3:44:21<8:26:13,  1.50it/s]Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}

 31%|███       | 20001/65536 [3:44:42<82:42:18,  6.54s/it]
 31%|███       | 20002/65536 [3:44:42<60:18:27,  4.77s/it]
 31%|███       | 20003/65536 [3:44:43<44:42:53,  3.54s/it]
 31%|███       | 20004/65536 [3:44:44<34:03:16,  2.69s/it]
 31%|███       | 20005/65536 [3:44:44<26:19:42,  2.08s/it]
 31%|███       | 20006/65536 [3:44:45<20:55:21,  1.65s/it]
 31%|███       | 20007/65536 [3:44:46<17:36:55,  1.39s/it]/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

 31%|███       | 20008/65536 [3:44:47<15:27:24,  1.22s/it]
 31%|███       | 20009/65536 [3:44:47<13:32:34,  1.07s/it]
 31%|███       | 20010/65536 [3:44:48<12:05:47,  1.05it/s]
 31%|███       | 20011/65536 [3:44:49<11:15:58,  1.12it/s]
 31%|███       | 20012/65536 [3:44:49<10:33:38,  1.20it/s]
 31%|███       | 20013/65536 [3:44:50<10:02:51,  1.26it/s]
 31%|███       | 20014/65536 [3:44:51<9:38:50,  1.31it/s] 
 31%|███       | 20015/65536 [3:44:52<9:26:36,  1.34it/s]
 31%|███       | 20016/65536 [3:44:52<9:16:24,  1.36it/s]
 31%|███       | 20017/65536 [3:44:53<9:06:59,  1.39it/s]
 31%|███       | 20018/65536 [3:44:54<8:47:48,  1.44it/s]
 31%|███       | 20019/65536 [3:44:54<8:39:36,  1.46it/s]
 31%|███       | 20020/65536 [3:44:55<8:38:55,  1.46it/s]
                                                         
{'loss': 0.9163, 'learning_rate': 7.269805314068814e-07, 'epoch': 1235.8}

 31%|███       | 20020/65536 [3:44:55<8:38:55,  1.46it/s]
 31%|███       | 20021/65536 [3:44:56<8:32:43,  1.48it/s]
 31%|███       | 20022/65536 [3:44:56<8:28:16,  1.49it/s]
 31%|███       | 20023/65536 [3:44:57<8:20:26,  1.52it/s]
 31%|███       | 20024/65536 [3:44:58<8:39:47,  1.46it/s]
 31%|███       | 20025/65536 [3:44:58<8:36:13,  1.47it/s]
 31%|███       | 20026/65536 [3:44:59<8:28:41,  1.49it/s]
 31%|███       | 20027/65536 [3:45:00<8:34:13,  1.48it/s]
 31%|███       | 20028/65536 [3:45:00<8:43:02,  1.45it/s]
 31%|███       | 20029/65536 [3:45:01<8:37:57,  1.46it/s]
 31%|███       | 20030/65536 [3:45:02<8:48:24,  1.44it/s]
 31%|███       | 20031/65536 [3:45:02<8:44:35,  1.45it/s]
 31%|███       | 20032/65536 [3:45:03<8:58:22,  1.41it/s]
 31%|███       | 20033/65536 [3:45:04<8:46:18,  1.44it/s]
 31%|███       | 20034/65536 [3:45:04<8:41:37,  1.45it/s]
 31%|███       | 20035/65536 [3:45:05<9:02:28,  1.40it/s]
 31%|███       | 20036/65536 [3:45:06<8:56:24,  1.41it/s]
 31%|███       | 20037/65536 [3:45:07<8:54:23,  1.42it/s]
 31%|███       | 20038/65536 [3:45:07<8:38:55,  1.46it/s]
 31%|███       | 20039/65536 [3:45:08<8:37:47,  1.46it/s]
 31%|███       | 20040/65536 [3:45:09<9:09:57,  1.38it/s]
                                                         
{'loss': 0.9171, 'learning_rate': 7.267050324476552e-07, 'epoch': 1237.04}

 31%|███       | 20040/65536 [3:45:09<9:09:57,  1.38it/s]
 31%|███       | 20041/65536 [3:45:09<9:05:10,  1.39it/s]
 31%|███       | 20042/65536 [3:45:10<8:57:58,  1.41it/s]
 31%|███       | 20043/65536 [3:45:11<8:54:58,  1.42it/s]
 31%|███       | 20044/65536 [3:45:12<9:06:09,  1.39it/s]
 31%|███       | 20045/65536 [3:45:12<8:49:05,  1.43it/s]
 31%|███       | 20046/65536 [3:45:13<8:41:58,  1.45it/s]
 31%|███       | 20047/65536 [3:45:14<8:35:34,  1.47it/s]
 31%|███       | 20048/65536 [3:45:14<8:47:46,  1.44it/s]
 31%|███       | 20049/65536 [3:45:15<8:46:43,  1.44it/s]
 31%|███       | 20050/65536 [3:45:16<8:55:04,  1.42it/s]
 31%|███       | 20051/65536 [3:45:16<8:50:26,  1.43it/s]