diff --git "a/sf_log.txt" "b/sf_log.txt" new file mode 100644--- /dev/null +++ "b/sf_log.txt" @@ -0,0 +1,1321 @@ +[2022-07-07 07:45:42,641][09926] Weights and Biases integration enabled. Project: sample_factory, user: None, group: None, unique_id: 17_mujoco_all_envs_see_4444_env_mujoco_halfcheetah_20220707_074542_640954 +[2022-07-07 07:45:43,579][09926] Initializing WandB... +[2022-07-07 07:45:44,712][09926] Environment var CUDA_VISIBLE_DEVICES is 0 +[2022-07-07 07:45:46,739][09926] Rollout worker 0 uses device cpu +[2022-07-07 07:45:46,740][09926] Rollout worker 1 uses device cpu +[2022-07-07 07:45:46,740][09926] Rollout worker 2 uses device cpu +[2022-07-07 07:45:46,741][09926] Rollout worker 3 uses device cpu +[2022-07-07 07:45:46,741][09926] Rollout worker 4 uses device cpu +[2022-07-07 07:45:46,741][09926] Rollout worker 5 uses device cpu +[2022-07-07 07:45:46,742][09926] Rollout worker 6 uses device cpu +[2022-07-07 07:45:46,742][09926] Rollout worker 7 uses device cpu +[2022-07-07 07:45:46,742][09926] In synchronous mode, we only accumulate one batch. Setting num_batches_to_accumulate to 1 +[2022-07-07 07:45:46,783][09926] Using GPUs [0] for process 0 (actually maps to GPUs [0]) +[2022-07-07 07:45:46,791][09926] InferenceWorker_p0-w0: min num requests: 2 +[2022-07-07 07:45:46,856][09926] Starting all processes... +[2022-07-07 07:45:46,856][09926] Starting process learner_proc0 +[2022-07-07 07:45:46,906][09926] Starting process inference_proc0-0 +[2022-07-07 07:45:46,956][09926] Starting process rollout_proc0 +[2022-07-07 07:45:47,006][09926] Starting process rollout_proc1 +[2022-07-07 07:45:47,056][09926] Starting process rollout_proc2 +[2022-07-07 07:45:47,106][09926] Starting process rollout_proc3 +[2022-07-07 07:45:47,156][09926] Starting process rollout_proc4 +[2022-07-07 07:45:47,206][09926] Starting process rollout_proc5 +[2022-07-07 07:45:47,256][09926] Starting process rollout_proc6 +[2022-07-07 07:45:47,306][09926] Starting process rollout_proc7 +[2022-07-07 07:45:58,543][09926] Inference worker 0-0 is ready! +[2022-07-07 07:45:58,543][09926] All inference workers are ready! Signal rollout workers to start! +[2022-07-07 07:46:14,712][09926] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 4096. Throughput: 0: nan. Samples: 8192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:46:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 20480. Throughput: 0: 6587.2. Samples: 41128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:46:19,712][09926] Avg episode reward: [(0, '-127.159')] +[2022-07-07 07:46:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 36864. Throughput: 0: 5348.0. Samples: 61672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:46:24,712][09926] Avg episode reward: [(0, '-270.262')] +[2022-07-07 07:46:29,714][09926] Fps is (10 sec: 2866.4, 60 sec: 3003.2, 300 sec: 3003.2). Total num frames: 49152. Throughput: 0: 5995.2. Samples: 98136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:46:29,715][09926] Avg episode reward: [(0, '-341.062')] +[2022-07-07 07:46:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3072.0, 300 sec: 3072.0). Total num frames: 65536. Throughput: 0: 6525.6. Samples: 138704. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 07:46:34,712][09926] Avg episode reward: [(0, '-376.974')] +[2022-07-07 07:46:39,712][09926] Fps is (10 sec: 3687.4, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 86016. Throughput: 0: 6063.4. Samples: 159776. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 07:46:39,712][09926] Avg episode reward: [(0, '-379.278')] +[2022-07-07 07:46:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3140.3). Total num frames: 98304. Throughput: 0: 6323.2. Samples: 197888. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 07:46:44,712][09926] Avg episode reward: [(0, '-398.004')] +[2022-07-07 07:46:49,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3159.8, 300 sec: 3159.8). Total num frames: 114688. Throughput: 0: 6531.7. Samples: 236800. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 07:46:49,712][09926] Avg episode reward: [(0, '-419.883')] +[2022-07-07 07:46:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3174.4, 300 sec: 3174.4). Total num frames: 131072. Throughput: 0: 6145.8. Samples: 254024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:46:54,712][09926] Avg episode reward: [(0, '-423.209')] +[2022-07-07 07:46:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3185.8, 300 sec: 3185.8). Total num frames: 147456. Throughput: 0: 6371.6. Samples: 294912. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 07:46:59,712][09926] Avg episode reward: [(0, '-414.904')] +[2022-07-07 07:47:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3194.9, 300 sec: 3194.9). Total num frames: 163840. Throughput: 0: 6542.6. Samples: 335544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:47:04,712][09926] Avg episode reward: [(0, '-357.034')] +[2022-07-07 07:47:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3202.3, 300 sec: 3202.3). Total num frames: 180224. Throughput: 0: 6473.6. Samples: 352984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:47:09,712][09926] Avg episode reward: [(0, '-294.691')] +[2022-07-07 07:47:14,715][09926] Fps is (10 sec: 3275.7, 60 sec: 3208.4, 300 sec: 3208.4). Total num frames: 196608. Throughput: 0: 6445.8. Samples: 388200. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 07:47:14,715][09926] Avg episode reward: [(0, '-252.005')] +[2022-07-07 07:47:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3213.8). Total num frames: 212992. Throughput: 0: 6392.9. Samples: 426384. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 07:47:19,712][09926] Avg episode reward: [(0, '-248.863')] +[2022-07-07 07:47:24,712][09926] Fps is (10 sec: 3277.9, 60 sec: 3208.5, 300 sec: 3218.3). Total num frames: 229376. Throughput: 0: 6437.3. Samples: 449456. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 07:47:24,712][09926] Avg episode reward: [(0, '-141.782')] +[2022-07-07 07:47:29,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.7, 300 sec: 3167.6). Total num frames: 241664. Throughput: 0: 6342.4. Samples: 483296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:47:29,712][09926] Avg episode reward: [(0, '-41.590')] +[2022-07-07 07:47:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3174.4). Total num frames: 258048. Throughput: 0: 6271.5. Samples: 519016. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 07:47:34,712][09926] Avg episode reward: [(0, '8.861')] +[2022-07-07 07:47:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3180.4). Total num frames: 274432. Throughput: 0: 6368.7. Samples: 540616. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 07:47:39,712][09926] Avg episode reward: [(0, '13.480')] +[2022-07-07 07:47:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3185.8). Total num frames: 290816. Throughput: 0: 6321.4. Samples: 579376. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 07:47:44,712][09926] Avg episode reward: [(0, '149.242')] +[2022-07-07 07:47:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3190.6). Total num frames: 307200. Throughput: 0: 6253.2. Samples: 616936. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 07:47:49,712][09926] Avg episode reward: [(0, '271.321')] +[2022-07-07 07:47:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3194.9). Total num frames: 323584. Throughput: 0: 6285.9. Samples: 635848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:47:54,712][09926] Avg episode reward: [(0, '328.816')] +[2022-07-07 07:47:59,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3159.8). Total num frames: 335872. Throughput: 0: 6329.2. Samples: 672992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:47:59,712][09926] Avg episode reward: [(0, '334.679')] +[2022-07-07 07:48:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3165.1). Total num frames: 352256. Throughput: 0: 6347.2. Samples: 712008. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 07:48:04,712][09926] Avg episode reward: [(0, '486.524')] +[2022-07-07 07:48:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3169.9). Total num frames: 368640. Throughput: 0: 6214.0. Samples: 729088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:48:09,712][09926] Avg episode reward: [(0, '615.272')] +[2022-07-07 07:48:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.4, 300 sec: 3174.4). Total num frames: 385024. Throughput: 0: 6374.4. Samples: 770144. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 07:48:14,712][09926] Avg episode reward: [(0, '670.666')] +[2022-07-07 07:48:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3178.5). Total num frames: 401408. Throughput: 0: 6385.1. Samples: 806344. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 07:48:19,712][09926] Avg episode reward: [(0, '674.751')] +[2022-07-07 07:48:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3182.3). Total num frames: 417792. Throughput: 0: 6372.3. Samples: 827368. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 07:48:24,712][09926] Avg episode reward: [(0, '794.584')] +[2022-07-07 07:48:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3185.8). Total num frames: 434176. Throughput: 0: 6377.4. Samples: 866360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:48:29,712][09926] Avg episode reward: [(0, '866.700')] +[2022-07-07 07:48:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3189.0). Total num frames: 450560. Throughput: 0: 6317.3. Samples: 901216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:48:34,712][09926] Avg episode reward: [(0, '891.522')] +[2022-07-07 07:48:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3192.1). Total num frames: 466944. Throughput: 0: 6338.1. Samples: 921064. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 07:48:39,712][09926] Avg episode reward: [(0, '894.191')] +[2022-07-07 07:48:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3167.6). Total num frames: 479232. Throughput: 0: 6346.8. Samples: 958600. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 07:48:44,714][09926] Avg episode reward: [(0, '942.307')] +[2022-07-07 07:48:49,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3171.1). Total num frames: 495616. Throughput: 0: 6344.2. Samples: 997496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:48:49,714][09926] Avg episode reward: [(0, '972.617')] +[2022-07-07 07:48:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3174.4). Total num frames: 512000. Throughput: 0: 6357.2. Samples: 1015160. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 07:48:54,712][09926] Avg episode reward: [(0, '986.080')] +[2022-07-07 07:48:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3177.5). Total num frames: 528384. Throughput: 0: 6262.0. Samples: 1051936. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 07:48:59,712][09926] Avg episode reward: [(0, '986.080')] +[2022-07-07 07:49:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3156.3). Total num frames: 540672. Throughput: 0: 6251.4. Samples: 1087656. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 07:49:04,712][09926] Avg episode reward: [(0, '1012.481')] +[2022-07-07 07:49:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3159.8). Total num frames: 557056. Throughput: 0: 6186.0. Samples: 1105736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:49:09,712][09926] Avg episode reward: [(0, '1035.365')] +[2022-07-07 07:49:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3163.0). Total num frames: 573440. Throughput: 0: 6180.3. Samples: 1144472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:49:14,712][09926] Avg episode reward: [(0, '1045.016')] +[2022-07-07 07:49:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3166.1). Total num frames: 589824. Throughput: 0: 6242.8. Samples: 1182144. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 07:49:19,712][09926] Avg episode reward: [(0, '1045.016')] +[2022-07-07 07:49:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3169.0). Total num frames: 606208. Throughput: 0: 6267.0. Samples: 1203080. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 07:49:24,712][09926] Avg episode reward: [(0, '1053.155')] +[2022-07-07 07:49:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3171.8). Total num frames: 622592. Throughput: 0: 6256.0. Samples: 1240120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:49:29,712][09926] Avg episode reward: [(0, '1089.228')] +[2022-07-07 07:49:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3174.4). Total num frames: 638976. Throughput: 0: 6232.9. Samples: 1277976. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 07:49:34,712][09926] Avg episode reward: [(0, '1112.224')] +[2022-07-07 07:49:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3176.9). Total num frames: 655360. Throughput: 0: 6315.9. Samples: 1299376. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 07:49:39,712][09926] Avg episode reward: [(0, '1112.224')] +[2022-07-07 07:49:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3159.8). Total num frames: 667648. Throughput: 0: 6305.2. Samples: 1335672. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 07:49:44,712][09926] Avg episode reward: [(0, '1141.626')] +[2022-07-07 07:49:49,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3162.5). Total num frames: 684032. Throughput: 0: 6380.8. Samples: 1374792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:49:49,712][09926] Avg episode reward: [(0, '1185.958')] +[2022-07-07 07:49:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3165.1). Total num frames: 700416. Throughput: 0: 6384.4. Samples: 1393032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:49:54,712][09926] Avg episode reward: [(0, '1192.505')] +[2022-07-07 07:49:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3167.6). Total num frames: 716800. Throughput: 0: 6375.3. Samples: 1431360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:49:59,712][09926] Avg episode reward: [(0, '1192.505')] +[2022-07-07 07:50:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3169.9). Total num frames: 733184. Throughput: 0: 6365.3. Samples: 1468584. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 07:50:04,712][09926] Avg episode reward: [(0, '1206.900')] +[2022-07-07 07:50:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3172.2). Total num frames: 749568. Throughput: 0: 6368.2. Samples: 1489648. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 07:50:09,712][09926] Avg episode reward: [(0, '1223.751')] +[2022-07-07 07:50:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3174.4). Total num frames: 765952. Throughput: 0: 6394.1. Samples: 1527856. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 07:50:14,712][09926] Avg episode reward: [(0, '1233.115')] +[2022-07-07 07:50:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3159.8). Total num frames: 778240. Throughput: 0: 6369.6. Samples: 1564608. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 07:50:19,712][09926] Avg episode reward: [(0, '1233.115')] +[2022-07-07 07:50:24,716][09926] Fps is (10 sec: 2866.0, 60 sec: 3140.0, 300 sec: 3162.1). Total num frames: 794624. Throughput: 0: 6328.5. Samples: 1584184. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 07:50:24,716][09926] Avg episode reward: [(0, '1242.114')] +[2022-07-07 07:50:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3208.5, 300 sec: 3180.4). Total num frames: 815104. Throughput: 0: 6437.7. Samples: 1625368. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 07:50:29,712][09926] Avg episode reward: [(0, '1261.049')] +[2022-07-07 07:50:34,712][09926] Fps is (10 sec: 3688.0, 60 sec: 3208.5, 300 sec: 3182.3). Total num frames: 831488. Throughput: 0: 6404.1. Samples: 1662976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:50:34,712][09926] Avg episode reward: [(0, '1258.980')] +[2022-07-07 07:50:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3168.6). Total num frames: 843776. Throughput: 0: 6419.0. Samples: 1681888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:50:39,712][09926] Avg episode reward: [(0, '1258.980')] +[2022-07-07 07:50:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3170.6). Total num frames: 860160. Throughput: 0: 6421.0. Samples: 1720304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:50:44,712][09926] Avg episode reward: [(0, '1248.485')] +[2022-07-07 07:50:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3172.5). Total num frames: 876544. Throughput: 0: 6416.0. Samples: 1757304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:50:49,712][09926] Avg episode reward: [(0, '1226.883')] +[2022-07-07 07:50:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3174.4). Total num frames: 892928. Throughput: 0: 6388.8. Samples: 1777144. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 07:50:54,712][09926] Avg episode reward: [(0, '1228.290')] +[2022-07-07 07:50:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3176.2). Total num frames: 909312. Throughput: 0: 6405.7. Samples: 1816112. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 07:50:59,712][09926] Avg episode reward: [(0, '1228.290')] +[2022-07-07 07:51:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3177.9). Total num frames: 925696. Throughput: 0: 6379.4. Samples: 1851680. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 07:51:04,712][09926] Avg episode reward: [(0, '1221.969')] +[2022-07-07 07:51:09,715][09926] Fps is (10 sec: 3275.7, 60 sec: 3208.4, 300 sec: 3179.6). Total num frames: 942080. Throughput: 0: 6442.6. Samples: 1874096. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 07:51:09,716][09926] Avg episode reward: [(0, '1181.091')] +[2022-07-07 07:51:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 958464. Throughput: 0: 6395.0. Samples: 1913144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:51:14,712][09926] Avg episode reward: [(0, '1159.573')] +[2022-07-07 07:51:19,712][09926] Fps is (10 sec: 2868.1, 60 sec: 3208.5, 300 sec: 3165.7). Total num frames: 970752. Throughput: 0: 6370.8. Samples: 1949664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:51:19,712][09926] Avg episode reward: [(0, '1159.573')] +[2022-07-07 07:51:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.8, 300 sec: 3179.6). Total num frames: 987136. Throughput: 0: 6318.6. Samples: 1966224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:51:24,712][09926] Avg episode reward: [(0, '1167.085')] +[2022-07-07 07:51:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3179.6). Total num frames: 1003520. Throughput: 0: 6369.6. Samples: 2006936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:51:29,713][09926] Avg episode reward: [(0, '1145.262')] +[2022-07-07 07:51:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1019904. Throughput: 0: 6318.8. Samples: 2041648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:51:34,712][09926] Avg episode reward: [(0, '1190.733')] +[2022-07-07 07:51:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1036288. Throughput: 0: 6355.0. Samples: 2063120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:51:39,712][09926] Avg episode reward: [(0, '1190.733')] +[2022-07-07 07:51:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1052672. Throughput: 0: 6319.6. Samples: 2100496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:51:44,712][09926] Avg episode reward: [(0, '1207.811')] +[2022-07-07 07:51:49,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1064960. Throughput: 0: 6365.1. Samples: 2138112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:51:49,712][09926] Avg episode reward: [(0, '1243.228')] +[2022-07-07 07:51:54,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1081344. Throughput: 0: 6270.5. Samples: 2156248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:51:54,712][09926] Avg episode reward: [(0, '1274.231')] +[2022-07-07 07:51:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1097728. Throughput: 0: 6268.3. Samples: 2195216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:51:59,712][09926] Avg episode reward: [(0, '1274.231')] +[2022-07-07 07:52:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1114112. Throughput: 0: 6234.5. Samples: 2230216. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 07:52:04,712][09926] Avg episode reward: [(0, '1282.859')] +[2022-07-07 07:52:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.4, 300 sec: 3165.8). Total num frames: 1130496. Throughput: 0: 6338.5. Samples: 2251456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:52:09,712][09926] Avg episode reward: [(0, '1309.095')] +[2022-07-07 07:52:14,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3072.0, 300 sec: 3151.8). Total num frames: 1142784. Throughput: 0: 6191.8. Samples: 2285568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:52:14,712][09926] Avg episode reward: [(0, '1319.554')] +[2022-07-07 07:52:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3151.8). Total num frames: 1159168. Throughput: 0: 6298.5. Samples: 2325080. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 07:52:19,712][09926] Avg episode reward: [(0, '1339.892')] +[2022-07-07 07:52:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1175552. Throughput: 0: 6217.6. Samples: 2342912. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 07:52:24,712][09926] Avg episode reward: [(0, '1328.359')] +[2022-07-07 07:52:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1191936. Throughput: 0: 6258.1. Samples: 2382112. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 07:52:29,712][09926] Avg episode reward: [(0, '1312.318')] +[2022-07-07 07:52:34,715][09926] Fps is (10 sec: 3275.7, 60 sec: 3140.1, 300 sec: 3165.7). Total num frames: 1208320. Throughput: 0: 6291.5. Samples: 2421248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:52:34,715][09926] Avg episode reward: [(0, '1325.930')] +[2022-07-07 07:52:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1224704. Throughput: 0: 6332.6. Samples: 2441216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:52:39,714][09926] Avg episode reward: [(0, '1304.338')] +[2022-07-07 07:52:44,712][09926] Fps is (10 sec: 3277.8, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1241088. Throughput: 0: 6326.8. Samples: 2479920. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 07:52:44,712][09926] Avg episode reward: [(0, '1304.485')] +[2022-07-07 07:52:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3165.7). Total num frames: 1257472. Throughput: 0: 6468.3. Samples: 2521288. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 07:52:49,712][09926] Avg episode reward: [(0, '1284.700')] +[2022-07-07 07:52:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1273856. Throughput: 0: 6401.4. Samples: 2539520. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 07:52:54,712][09926] Avg episode reward: [(0, '1259.888')] +[2022-07-07 07:52:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1290240. Throughput: 0: 6538.8. Samples: 2579816. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 07:52:59,712][09926] Avg episode reward: [(0, '1259.888')] +[2022-07-07 07:53:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1306624. Throughput: 0: 6446.2. Samples: 2615160. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 07:53:04,712][09926] Avg episode reward: [(0, '1256.839')] +[2022-07-07 07:53:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1323008. Throughput: 0: 6504.5. Samples: 2635616. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 07:53:09,712][09926] Avg episode reward: [(0, '1288.256')] +[2022-07-07 07:53:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3179.6). Total num frames: 1339392. Throughput: 0: 6509.7. Samples: 2675048. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 07:53:14,712][09926] Avg episode reward: [(0, '1277.011')] +[2022-07-07 07:53:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3179.6). Total num frames: 1355776. Throughput: 0: 6476.2. Samples: 2712656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:53:19,712][09926] Avg episode reward: [(0, '1277.011')] +[2022-07-07 07:53:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3179.6). Total num frames: 1372160. Throughput: 0: 6491.0. Samples: 2733312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:53:24,712][09926] Avg episode reward: [(0, '1316.851')] +[2022-07-07 07:53:29,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3165.7). Total num frames: 1384448. Throughput: 0: 6421.3. Samples: 2768880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:53:29,712][09926] Avg episode reward: [(0, '1365.248')] +[2022-07-07 07:53:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.7, 300 sec: 3165.7). Total num frames: 1400832. Throughput: 0: 6411.7. Samples: 2809816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:53:34,712][09926] Avg episode reward: [(0, '1364.404')] +[2022-07-07 07:53:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1417216. Throughput: 0: 6371.6. Samples: 2826240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:53:39,712][09926] Avg episode reward: [(0, '1364.404')] +[2022-07-07 07:53:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1433600. Throughput: 0: 6386.3. Samples: 2867200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:53:44,712][09926] Avg episode reward: [(0, '1366.581')] +[2022-07-07 07:53:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1449984. Throughput: 0: 6440.4. Samples: 2904976. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 07:53:49,712][09926] Avg episode reward: [(0, '1384.536')] +[2022-07-07 07:53:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1466368. Throughput: 0: 6387.7. Samples: 2923064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:53:54,712][09926] Avg episode reward: [(0, '1399.773')] +[2022-07-07 07:53:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1482752. Throughput: 0: 6440.9. Samples: 2964888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:53:59,712][09926] Avg episode reward: [(0, '1399.773')] +[2022-07-07 07:54:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3179.6). Total num frames: 1495040. Throughput: 0: 6342.2. Samples: 2998056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:54:04,712][09926] Avg episode reward: [(0, '1403.267')] +[2022-07-07 07:54:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1515520. Throughput: 0: 6298.7. Samples: 3016752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:54:09,712][09926] Avg episode reward: [(0, '1407.229')] +[2022-07-07 07:54:14,712][09926] Fps is (10 sec: 3686.3, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1531904. Throughput: 0: 6376.7. Samples: 3055832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:54:14,712][09926] Avg episode reward: [(0, '1409.399')] +[2022-07-07 07:54:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3179.6). Total num frames: 1544192. Throughput: 0: 6372.4. Samples: 3096576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:54:19,712][09926] Avg episode reward: [(0, '1409.399')] +[2022-07-07 07:54:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3179.6). Total num frames: 1560576. Throughput: 0: 6376.5. Samples: 3113184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:54:24,712][09926] Avg episode reward: [(0, '1406.963')] +[2022-07-07 07:54:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1576960. Throughput: 0: 6365.3. Samples: 3153640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:54:29,712][09926] Avg episode reward: [(0, '1400.681')] +[2022-07-07 07:54:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1593344. Throughput: 0: 6334.6. Samples: 3190032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:54:34,712][09926] Avg episode reward: [(0, '1407.442')] +[2022-07-07 07:54:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1609728. Throughput: 0: 6325.5. Samples: 3207712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:54:39,712][09926] Avg episode reward: [(0, '1409.298')] +[2022-07-07 07:54:44,713][09926] Fps is (10 sec: 3276.4, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1626112. Throughput: 0: 6286.4. Samples: 3247784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:54:44,713][09926] Avg episode reward: [(0, '1421.487')] +[2022-07-07 07:54:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1642496. Throughput: 0: 6458.8. Samples: 3288704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:54:49,717][09926] Avg episode reward: [(0, '1482.391')] +[2022-07-07 07:54:54,712][09926] Fps is (10 sec: 3277.2, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1658880. Throughput: 0: 6507.0. Samples: 3309568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:54:54,712][09926] Avg episode reward: [(0, '1553.495')] +[2022-07-07 07:54:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1675264. Throughput: 0: 6523.7. Samples: 3349400. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 07:54:59,712][09926] Avg episode reward: [(0, '1553.495')] +[2022-07-07 07:55:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1687552. Throughput: 0: 6366.0. Samples: 3383048. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 07:55:04,712][09926] Avg episode reward: [(0, '1614.307')] +[2022-07-07 07:55:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3179.6). Total num frames: 1703936. Throughput: 0: 6366.6. Samples: 3399680. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 07:55:09,712][09926] Avg episode reward: [(0, '1733.226')] +[2022-07-07 07:55:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3193.5). Total num frames: 1720320. Throughput: 0: 6377.8. Samples: 3440640. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 07:55:14,712][09926] Avg episode reward: [(0, '1826.627')] +[2022-07-07 07:55:19,714][09926] Fps is (10 sec: 3276.0, 60 sec: 3208.4, 300 sec: 3193.5). Total num frames: 1736704. Throughput: 0: 6461.9. Samples: 3480832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:55:19,715][09926] Avg episode reward: [(0, '1826.627')] +[2022-07-07 07:55:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1753088. Throughput: 0: 6450.5. Samples: 3497984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:55:24,712][09926] Avg episode reward: [(0, '1865.951')] +[2022-07-07 07:55:29,712][09926] Fps is (10 sec: 3277.4, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1769472. Throughput: 0: 6490.4. Samples: 3539848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:55:29,713][09926] Avg episode reward: [(0, '1893.893')] +[2022-07-07 07:55:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1785856. Throughput: 0: 6456.0. Samples: 3579224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:55:34,712][09926] Avg episode reward: [(0, '1921.158')] +[2022-07-07 07:55:39,712][09926] Fps is (10 sec: 3277.0, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1802240. Throughput: 0: 6394.3. Samples: 3597312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:55:39,712][09926] Avg episode reward: [(0, '1921.158')] +[2022-07-07 07:55:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.6, 300 sec: 3193.5). Total num frames: 1818624. Throughput: 0: 6411.6. Samples: 3637920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:55:44,712][09926] Avg episode reward: [(0, '1917.912')] +[2022-07-07 07:55:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1835008. Throughput: 0: 6533.0. Samples: 3677032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 07:55:49,712][09926] Avg episode reward: [(0, '1896.086')] +[2022-07-07 07:55:54,712][09926] Fps is (10 sec: 3276.6, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1851392. Throughput: 0: 6549.1. Samples: 3694392. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 07:55:54,713][09926] Avg episode reward: [(0, '1918.603')] +[2022-07-07 07:55:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1867776. Throughput: 0: 6477.5. Samples: 3732128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:55:59,712][09926] Avg episode reward: [(0, '1918.603')] +[2022-07-07 07:56:04,712][09926] Fps is (10 sec: 3277.0, 60 sec: 3276.8, 300 sec: 3193.5). Total num frames: 1884160. Throughput: 0: 6416.9. Samples: 3769576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:56:04,712][09926] Avg episode reward: [(0, '1979.654')] +[2022-07-07 07:56:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3193.5). Total num frames: 1900544. Throughput: 0: 6555.6. Samples: 3792984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:56:09,712][09926] Avg episode reward: [(0, '2052.129')] +[2022-07-07 07:56:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3207.4). Total num frames: 1916928. Throughput: 0: 6422.7. Samples: 3828864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:56:14,712][09926] Avg episode reward: [(0, '2109.561')] +[2022-07-07 07:56:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.9, 300 sec: 3207.4). Total num frames: 1933312. Throughput: 0: 6453.0. Samples: 3869608. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 07:56:19,712][09926] Avg episode reward: [(0, '2109.561')] +[2022-07-07 07:56:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3207.4). Total num frames: 1949696. Throughput: 0: 6493.9. Samples: 3889536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 07:56:24,712][09926] Avg episode reward: [(0, '2189.108')] +[2022-07-07 07:56:29,712][09926] Fps is (10 sec: 2867.0, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1961984. Throughput: 0: 6393.5. Samples: 3925632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:56:29,713][09926] Avg episode reward: [(0, '2169.786')] +[2022-07-07 07:56:34,714][09926] Fps is (10 sec: 3276.2, 60 sec: 3276.7, 300 sec: 3207.4). Total num frames: 1982464. Throughput: 0: 6397.4. Samples: 3964928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:56:34,714][09926] Avg episode reward: [(0, '2185.426')] +[2022-07-07 07:56:39,712][09926] Fps is (10 sec: 3277.1, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1994752. Throughput: 0: 6421.6. Samples: 3983360. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 07:56:39,712][09926] Avg episode reward: [(0, '2185.426')] +[2022-07-07 07:56:44,712][09926] Fps is (10 sec: 2867.7, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 2011136. Throughput: 0: 6428.4. Samples: 4021408. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 07:56:44,715][09926] Avg episode reward: [(0, '2166.232')] +[2022-07-07 07:56:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 2027520. Throughput: 0: 6457.6. Samples: 4060168. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 07:56:49,712][09926] Avg episode reward: [(0, '2152.587')] +[2022-07-07 07:56:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.6, 300 sec: 3207.4). Total num frames: 2043904. Throughput: 0: 6368.0. Samples: 4079544. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 07:56:54,712][09926] Avg episode reward: [(0, '2222.259')] +[2022-07-07 07:56:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 2060288. Throughput: 0: 6399.6. Samples: 4116848. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 07:56:59,712][09926] Avg episode reward: [(0, '2222.259')] +[2022-07-07 07:57:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3193.5). Total num frames: 2072576. Throughput: 0: 6261.2. Samples: 4151360. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 07:57:04,712][09926] Avg episode reward: [(0, '2273.575')] +[2022-07-07 07:57:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 2088960. Throughput: 0: 6239.3. Samples: 4170304. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 07:57:09,712][09926] Avg episode reward: [(0, '2384.982')] +[2022-07-07 07:57:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 2105344. Throughput: 0: 6329.7. Samples: 4210464. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 07:57:14,712][09926] Avg episode reward: [(0, '2527.387')] +[2022-07-07 07:57:19,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 2125824. Throughput: 0: 6372.2. Samples: 4251664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:57:19,712][09926] Avg episode reward: [(0, '2527.387')] +[2022-07-07 07:57:24,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 2142208. Throughput: 0: 6405.9. Samples: 4271624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:57:24,712][09926] Avg episode reward: [(0, '2542.666')] +[2022-07-07 07:57:29,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.6, 300 sec: 3207.4). Total num frames: 2154496. Throughput: 0: 6398.4. Samples: 4309336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:57:29,712][09926] Avg episode reward: [(0, '2571.030')] +[2022-07-07 07:57:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.6, 300 sec: 3221.3). Total num frames: 2174976. Throughput: 0: 6443.2. Samples: 4350112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:57:34,712][09926] Avg episode reward: [(0, '2629.861')] +[2022-07-07 07:57:39,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 2191360. Throughput: 0: 6530.3. Samples: 4373408. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 07:57:39,712][09926] Avg episode reward: [(0, '2629.861')] +[2022-07-07 07:57:44,712][09926] Fps is (10 sec: 3276.7, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 2207744. Throughput: 0: 6557.0. Samples: 4411912. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 07:57:44,712][09926] Avg episode reward: [(0, '2674.727')] +[2022-07-07 07:57:49,714][09926] Fps is (10 sec: 3276.0, 60 sec: 3276.7, 300 sec: 3221.2). Total num frames: 2224128. Throughput: 0: 6615.1. Samples: 4449056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:57:49,715][09926] Avg episode reward: [(0, '2768.788')] +[2022-07-07 07:57:54,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 2236416. Throughput: 0: 6570.7. Samples: 4465984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:57:54,712][09926] Avg episode reward: [(0, '2777.952')] +[2022-07-07 07:57:59,712][09926] Fps is (10 sec: 2867.9, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 2252800. Throughput: 0: 6557.2. Samples: 4505536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:57:59,712][09926] Avg episode reward: [(0, '2777.952')] +[2022-07-07 07:58:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3207.4). Total num frames: 2269184. Throughput: 0: 6473.1. Samples: 4542952. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 07:58:04,712][09926] Avg episode reward: [(0, '2884.286')] +[2022-07-07 07:58:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3207.4). Total num frames: 2285568. Throughput: 0: 6462.1. Samples: 4562416. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 07:58:09,712][09926] Avg episode reward: [(0, '2917.984')] +[2022-07-07 07:58:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3207.4). Total num frames: 2301952. Throughput: 0: 6475.9. Samples: 4600752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:58:14,712][09926] Avg episode reward: [(0, '2940.701')] +[2022-07-07 07:58:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 2318336. Throughput: 0: 6453.9. Samples: 4640536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:58:19,712][09926] Avg episode reward: [(0, '2940.701')] +[2022-07-07 07:58:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 2334720. Throughput: 0: 6389.3. Samples: 4660928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:58:24,712][09926] Avg episode reward: [(0, '2905.895')] +[2022-07-07 07:58:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 2351104. Throughput: 0: 6413.5. Samples: 4700520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:58:29,712][09926] Avg episode reward: [(0, '2985.320')] +[2022-07-07 07:58:34,712][09926] Fps is (10 sec: 3276.7, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 2367488. Throughput: 0: 6433.7. Samples: 4738560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:58:34,713][09926] Avg episode reward: [(0, '3036.966')] +[2022-07-07 07:58:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 2383872. Throughput: 0: 6568.4. Samples: 4761560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:58:39,712][09926] Avg episode reward: [(0, '3025.838')] +[2022-07-07 07:58:44,712][09926] Fps is (10 sec: 3686.5, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 2404352. Throughput: 0: 6652.3. Samples: 4804888. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 07:58:44,712][09926] Avg episode reward: [(0, '3052.658')] +[2022-07-07 07:58:49,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.9, 300 sec: 3235.1). Total num frames: 2420736. Throughput: 0: 6680.9. Samples: 4843592. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 07:58:49,712][09926] Avg episode reward: [(0, '3111.968')] +[2022-07-07 07:58:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 2437120. Throughput: 0: 6696.5. Samples: 4863760. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 07:58:54,712][09926] Avg episode reward: [(0, '3071.508')] +[2022-07-07 07:58:59,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 2449408. Throughput: 0: 6623.3. Samples: 4898800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:58:59,712][09926] Avg episode reward: [(0, '3053.973')] +[2022-07-07 07:59:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 2465792. Throughput: 0: 6602.1. Samples: 4937632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:59:04,712][09926] Avg episode reward: [(0, '3037.092')] +[2022-07-07 07:59:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 2482176. Throughput: 0: 6542.8. Samples: 4955352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:59:09,712][09926] Avg episode reward: [(0, '2951.886')] +[2022-07-07 07:59:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 2498560. Throughput: 0: 6507.9. Samples: 4993376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:59:14,712][09926] Avg episode reward: [(0, '2821.094')] +[2022-07-07 07:59:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 2514944. Throughput: 0: 6557.0. Samples: 5033624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:59:19,712][09926] Avg episode reward: [(0, '2804.327')] +[2022-07-07 07:59:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 2531328. Throughput: 0: 6511.8. Samples: 5054592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:59:24,712][09926] Avg episode reward: [(0, '2797.090')] +[2022-07-07 07:59:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 2547712. Throughput: 0: 6452.8. Samples: 5095264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:59:29,712][09926] Avg episode reward: [(0, '2807.660')] +[2022-07-07 07:59:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 2564096. Throughput: 0: 6500.1. Samples: 5136096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:59:34,712][09926] Avg episode reward: [(0, '2805.146')] +[2022-07-07 07:59:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.2). Total num frames: 2580480. Throughput: 0: 6422.4. Samples: 5152768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:59:39,712][09926] Avg episode reward: [(0, '2793.289')] +[2022-07-07 07:59:44,712][09926] Fps is (10 sec: 3686.2, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 2600960. Throughput: 0: 6555.8. Samples: 5193816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:59:44,713][09926] Avg episode reward: [(0, '2798.242')] +[2022-07-07 07:59:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2613248. Throughput: 0: 6594.3. Samples: 5234376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:59:49,712][09926] Avg episode reward: [(0, '2837.579')] +[2022-07-07 07:59:54,712][09926] Fps is (10 sec: 2867.4, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2629632. Throughput: 0: 6676.6. Samples: 5255800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:59:54,712][09926] Avg episode reward: [(0, '2856.917')] +[2022-07-07 07:59:59,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3262.9). Total num frames: 2650112. Throughput: 0: 6636.8. Samples: 5292032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 07:59:59,712][09926] Avg episode reward: [(0, '2856.083')] +[2022-07-07 08:00:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 2662400. Throughput: 0: 6522.3. Samples: 5327128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:00:04,712][09926] Avg episode reward: [(0, '2912.815')] +[2022-07-07 08:00:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 2678784. Throughput: 0: 6549.0. Samples: 5349296. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:00:09,712][09926] Avg episode reward: [(0, '3009.434')] +[2022-07-07 08:00:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.1). Total num frames: 2695168. Throughput: 0: 6476.4. Samples: 5386704. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:00:14,712][09926] Avg episode reward: [(0, '3028.752')] +[2022-07-07 08:00:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 2711552. Throughput: 0: 6452.3. Samples: 5426448. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:00:19,712][09926] Avg episode reward: [(0, '3019.864')] +[2022-07-07 08:00:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 2727936. Throughput: 0: 6492.8. Samples: 5444944. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:00:24,712][09926] Avg episode reward: [(0, '3012.728')] +[2022-07-07 08:00:29,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2740224. Throughput: 0: 6388.3. Samples: 5481288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:00:29,712][09926] Avg episode reward: [(0, '3073.894')] +[2022-07-07 08:00:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2756608. Throughput: 0: 6313.2. Samples: 5518472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:00:34,712][09926] Avg episode reward: [(0, '3010.053')] +[2022-07-07 08:00:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2772992. Throughput: 0: 6265.1. Samples: 5537728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:00:39,712][09926] Avg episode reward: [(0, '3040.293')] +[2022-07-07 08:00:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3235.1). Total num frames: 2789376. Throughput: 0: 6280.7. Samples: 5574664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:00:44,712][09926] Avg episode reward: [(0, '3206.639')] +[2022-07-07 08:00:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.2). Total num frames: 2805760. Throughput: 0: 6398.2. Samples: 5615048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:00:49,712][09926] Avg episode reward: [(0, '3169.442')] +[2022-07-07 08:00:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2822144. Throughput: 0: 6366.9. Samples: 5635808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:00:54,712][09926] Avg episode reward: [(0, '3162.519')] +[2022-07-07 08:00:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3235.1). Total num frames: 2838528. Throughput: 0: 6440.9. Samples: 5676544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:00:59,712][09926] Avg episode reward: [(0, '3160.732')] +[2022-07-07 08:01:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2854912. Throughput: 0: 6412.4. Samples: 5715008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:01:04,712][09926] Avg episode reward: [(0, '3082.625')] +[2022-07-07 08:01:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2871296. Throughput: 0: 6413.3. Samples: 5733544. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:01:09,712][09926] Avg episode reward: [(0, '2935.539')] +[2022-07-07 08:01:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2887680. Throughput: 0: 6463.3. Samples: 5772136. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:01:14,712][09926] Avg episode reward: [(0, '2958.615')] +[2022-07-07 08:01:19,715][09926] Fps is (10 sec: 3275.8, 60 sec: 3208.4, 300 sec: 3235.1). Total num frames: 2904064. Throughput: 0: 6436.4. Samples: 5808128. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:01:19,715][09926] Avg episode reward: [(0, '2925.511')] +[2022-07-07 08:01:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3235.2). Total num frames: 2916352. Throughput: 0: 6403.2. Samples: 5825872. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:01:24,712][09926] Avg episode reward: [(0, '3061.791')] +[2022-07-07 08:01:29,712][09926] Fps is (10 sec: 2868.1, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 2932736. Throughput: 0: 6461.3. Samples: 5865424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:01:29,712][09926] Avg episode reward: [(0, '3185.954')] +[2022-07-07 08:01:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2949120. Throughput: 0: 6452.5. Samples: 5905408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:01:34,712][09926] Avg episode reward: [(0, '3283.296')] +[2022-07-07 08:01:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2965504. Throughput: 0: 6380.8. Samples: 5922944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:01:39,712][09926] Avg episode reward: [(0, '3355.551')] +[2022-07-07 08:01:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2981888. Throughput: 0: 6384.0. Samples: 5963824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:01:44,712][09926] Avg episode reward: [(0, '3428.324')] +[2022-07-07 08:01:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2998272. Throughput: 0: 6334.2. Samples: 6000048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:01:49,712][09926] Avg episode reward: [(0, '3410.071')] +[2022-07-07 08:01:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3014656. Throughput: 0: 6385.1. Samples: 6020872. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:01:54,712][09926] Avg episode reward: [(0, '3448.130')] +[2022-07-07 08:01:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3031040. Throughput: 0: 6391.5. Samples: 6059752. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:01:59,712][09926] Avg episode reward: [(0, '3434.415')] +[2022-07-07 08:02:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3047424. Throughput: 0: 6388.2. Samples: 6095576. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:02:04,712][09926] Avg episode reward: [(0, '3444.490')] +[2022-07-07 08:02:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3063808. Throughput: 0: 6502.0. Samples: 6118464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:02:09,712][09926] Avg episode reward: [(0, '3426.665')] +[2022-07-07 08:02:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3080192. Throughput: 0: 6501.0. Samples: 6157968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:02:14,712][09926] Avg episode reward: [(0, '3454.908')] +[2022-07-07 08:02:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.7, 300 sec: 3235.1). Total num frames: 3096576. Throughput: 0: 6556.4. Samples: 6200448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:02:19,712][09926] Avg episode reward: [(0, '3421.213')] +[2022-07-07 08:02:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3112960. Throughput: 0: 6541.7. Samples: 6217320. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:02:24,712][09926] Avg episode reward: [(0, '3388.544')] +[2022-07-07 08:02:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3129344. Throughput: 0: 6520.0. Samples: 6257224. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:02:29,712][09926] Avg episode reward: [(0, '3481.270')] +[2022-07-07 08:02:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3145728. Throughput: 0: 6571.2. Samples: 6295752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:02:34,712][09926] Avg episode reward: [(0, '3488.326')] +[2022-07-07 08:02:39,713][09926] Fps is (10 sec: 3276.3, 60 sec: 3276.7, 300 sec: 3235.1). Total num frames: 3162112. Throughput: 0: 6544.5. Samples: 6315384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:02:39,714][09926] Avg episode reward: [(0, '3420.230')] +[2022-07-07 08:02:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.2). Total num frames: 3178496. Throughput: 0: 6523.2. Samples: 6353296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:02:44,712][09926] Avg episode reward: [(0, '3391.266')] +[2022-07-07 08:02:49,719][09926] Fps is (10 sec: 3275.0, 60 sec: 3276.4, 300 sec: 3249.0). Total num frames: 3194880. Throughput: 0: 6541.9. Samples: 6390008. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:02:49,719][09926] Avg episode reward: [(0, '3324.977')] +[2022-07-07 08:02:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3211264. Throughput: 0: 6479.6. Samples: 6410048. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:02:54,712][09926] Avg episode reward: [(0, '3341.757')] +[2022-07-07 08:02:59,712][09926] Fps is (10 sec: 2869.3, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3223552. Throughput: 0: 6423.1. Samples: 6447008. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:02:59,712][09926] Avg episode reward: [(0, '3315.896')] +[2022-07-07 08:03:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3239936. Throughput: 0: 6304.2. Samples: 6484136. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:03:04,712][09926] Avg episode reward: [(0, '3187.343')] +[2022-07-07 08:03:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3256320. Throughput: 0: 6380.1. Samples: 6504424. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:03:09,712][09926] Avg episode reward: [(0, '3058.505')] +[2022-07-07 08:03:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3272704. Throughput: 0: 6402.8. Samples: 6545352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:03:14,712][09926] Avg episode reward: [(0, '3101.345')] +[2022-07-07 08:03:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3289088. Throughput: 0: 6415.5. Samples: 6584448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:03:19,712][09926] Avg episode reward: [(0, '3143.766')] +[2022-07-07 08:03:24,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3309568. Throughput: 0: 6463.0. Samples: 6606208. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:03:24,712][09926] Avg episode reward: [(0, '3229.067')] +[2022-07-07 08:03:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3325952. Throughput: 0: 6549.0. Samples: 6648000. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:03:29,712][09926] Avg episode reward: [(0, '3360.153')] +[2022-07-07 08:03:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3342336. Throughput: 0: 6604.4. Samples: 6687160. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:03:34,712][09926] Avg episode reward: [(0, '3360.153')] +[2022-07-07 08:03:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.9, 300 sec: 3235.1). Total num frames: 3358720. Throughput: 0: 6597.2. Samples: 6706920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:03:39,712][09926] Avg episode reward: [(0, '3464.986')] +[2022-07-07 08:03:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3375104. Throughput: 0: 6654.0. Samples: 6746440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:03:44,712][09926] Avg episode reward: [(0, '3453.302')] +[2022-07-07 08:03:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3277.2, 300 sec: 3235.1). Total num frames: 3391488. Throughput: 0: 6640.9. Samples: 6782976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:03:49,712][09926] Avg episode reward: [(0, '3508.677')] +[2022-07-07 08:03:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3407872. Throughput: 0: 6731.0. Samples: 6807320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:03:54,715][09926] Avg episode reward: [(0, '3508.677')] +[2022-07-07 08:03:59,713][09926] Fps is (10 sec: 3276.2, 60 sec: 3345.0, 300 sec: 3249.0). Total num frames: 3424256. Throughput: 0: 6609.3. Samples: 6842784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:03:59,714][09926] Avg episode reward: [(0, '3379.095')] +[2022-07-07 08:04:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 3440640. Throughput: 0: 6596.3. Samples: 6881280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:04:04,712][09926] Avg episode reward: [(0, '3357.317')] +[2022-07-07 08:04:09,712][09926] Fps is (10 sec: 2867.7, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3452928. Throughput: 0: 6488.2. Samples: 6898176. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:04:09,712][09926] Avg episode reward: [(0, '3317.019')] +[2022-07-07 08:04:14,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3469312. Throughput: 0: 6462.1. Samples: 6938792. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:04:14,712][09926] Avg episode reward: [(0, '3317.019')] +[2022-07-07 08:04:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3485696. Throughput: 0: 6487.5. Samples: 6979096. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:04:19,712][09926] Avg episode reward: [(0, '3387.132')] +[2022-07-07 08:04:24,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3506176. Throughput: 0: 6490.8. Samples: 6999008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:04:24,712][09926] Avg episode reward: [(0, '3335.014')] +[2022-07-07 08:04:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3518464. Throughput: 0: 6453.3. Samples: 7036840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:04:29,712][09926] Avg episode reward: [(0, '3383.555')] +[2022-07-07 08:04:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3534848. Throughput: 0: 6552.9. Samples: 7077856. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:04:34,712][09926] Avg episode reward: [(0, '3379.497')] +[2022-07-07 08:04:39,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3235.2). Total num frames: 3555328. Throughput: 0: 6390.8. Samples: 7094904. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:04:39,712][09926] Avg episode reward: [(0, '3133.689')] +[2022-07-07 08:04:44,713][09926] Fps is (10 sec: 3685.9, 60 sec: 3276.7, 300 sec: 3249.0). Total num frames: 3571712. Throughput: 0: 6535.7. Samples: 7136888. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:04:44,714][09926] Avg episode reward: [(0, '2997.437')] +[2022-07-07 08:04:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3588096. Throughput: 0: 6554.0. Samples: 7176208. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:04:49,712][09926] Avg episode reward: [(0, '2929.782')] +[2022-07-07 08:04:54,712][09926] Fps is (10 sec: 3277.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3604480. Throughput: 0: 6643.0. Samples: 7197112. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:04:54,712][09926] Avg episode reward: [(0, '2940.727')] +[2022-07-07 08:04:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.9, 300 sec: 3249.0). Total num frames: 3620864. Throughput: 0: 6618.1. Samples: 7236608. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:04:59,712][09926] Avg episode reward: [(0, '2772.626')] +[2022-07-07 08:05:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3633152. Throughput: 0: 6564.1. Samples: 7274480. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:05:04,712][09926] Avg episode reward: [(0, '2727.437')] +[2022-07-07 08:05:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3649536. Throughput: 0: 6486.0. Samples: 7290880. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:05:09,712][09926] Avg episode reward: [(0, '2651.717')] +[2022-07-07 08:05:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3665920. Throughput: 0: 6555.4. Samples: 7331832. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:05:14,712][09926] Avg episode reward: [(0, '2658.327')] +[2022-07-07 08:05:19,713][09926] Fps is (10 sec: 3276.2, 60 sec: 3276.7, 300 sec: 3235.1). Total num frames: 3682304. Throughput: 0: 6539.8. Samples: 7372160. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:05:19,715][09926] Avg episode reward: [(0, '2619.302')] +[2022-07-07 08:05:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3698688. Throughput: 0: 6541.7. Samples: 7389280. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:05:24,712][09926] Avg episode reward: [(0, '2588.950')] +[2022-07-07 08:05:29,712][09926] Fps is (10 sec: 3277.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3715072. Throughput: 0: 6467.2. Samples: 7427904. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:05:29,714][09926] Avg episode reward: [(0, '2665.252')] +[2022-07-07 08:05:34,714][09926] Fps is (10 sec: 3275.9, 60 sec: 3276.7, 300 sec: 3249.0). Total num frames: 3731456. Throughput: 0: 6460.6. Samples: 7466952. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:05:34,717][09926] Avg episode reward: [(0, '2677.917')] +[2022-07-07 08:05:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3747840. Throughput: 0: 6448.9. Samples: 7487312. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:05:39,712][09926] Avg episode reward: [(0, '2756.583')] +[2022-07-07 08:05:44,712][09926] Fps is (10 sec: 3277.6, 60 sec: 3208.6, 300 sec: 3249.0). Total num frames: 3764224. Throughput: 0: 6404.3. Samples: 7524800. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:05:44,712][09926] Avg episode reward: [(0, '2885.510')] +[2022-07-07 08:05:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3780608. Throughput: 0: 6401.2. Samples: 7562536. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:05:49,712][09926] Avg episode reward: [(0, '3046.476')] +[2022-07-07 08:05:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3796992. Throughput: 0: 6532.1. Samples: 7584824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:05:54,712][09926] Avg episode reward: [(0, '3092.953')] +[2022-07-07 08:05:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3813376. Throughput: 0: 6550.4. Samples: 7626600. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:05:59,712][09926] Avg episode reward: [(0, '3155.357')] +[2022-07-07 08:06:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3829760. Throughput: 0: 6394.0. Samples: 7659880. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:06:04,712][09926] Avg episode reward: [(0, '3278.021')] +[2022-07-07 08:06:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3842048. Throughput: 0: 6456.0. Samples: 7679800. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:06:09,712][09926] Avg episode reward: [(0, '3361.209')] +[2022-07-07 08:06:14,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.2). Total num frames: 3858432. Throughput: 0: 6421.3. Samples: 7716864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:06:14,712][09926] Avg episode reward: [(0, '3360.855')] +[2022-07-07 08:06:19,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.9, 300 sec: 3262.9). Total num frames: 3878912. Throughput: 0: 6477.2. Samples: 7758408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:06:19,712][09926] Avg episode reward: [(0, '3411.856')] +[2022-07-07 08:06:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3891200. Throughput: 0: 6469.3. Samples: 7778432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:06:24,712][09926] Avg episode reward: [(0, '3553.605')] +[2022-07-07 08:06:29,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3907584. Throughput: 0: 6444.1. Samples: 7814784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:06:29,712][09926] Avg episode reward: [(0, '3665.413')] +[2022-07-07 08:06:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.7, 300 sec: 3249.0). Total num frames: 3923968. Throughput: 0: 6515.4. Samples: 7855728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:06:34,712][09926] Avg episode reward: [(0, '3696.698')] +[2022-07-07 08:06:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3940352. Throughput: 0: 6470.2. Samples: 7875984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:06:39,712][09926] Avg episode reward: [(0, '3818.343')] +[2022-07-07 08:06:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3956736. Throughput: 0: 6374.0. Samples: 7913432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:06:44,712][09926] Avg episode reward: [(0, '3789.959')] +[2022-07-07 08:06:49,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 3977216. Throughput: 0: 6545.6. Samples: 7954432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:06:49,712][09926] Avg episode reward: [(0, '3798.467')] +[2022-07-07 08:06:54,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 3993600. Throughput: 0: 6603.0. Samples: 7976936. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:06:54,712][09926] Avg episode reward: [(0, '3849.691')] +[2022-07-07 08:06:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 4009984. Throughput: 0: 6665.8. Samples: 8016824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:06:59,712][09926] Avg episode reward: [(0, '3902.609')] +[2022-07-07 08:07:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 4022272. Throughput: 0: 6515.2. Samples: 8051592. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:07:04,712][09926] Avg episode reward: [(0, '4037.559')] +[2022-07-07 08:07:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 4038656. Throughput: 0: 6497.4. Samples: 8070816. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:07:09,712][09926] Avg episode reward: [(0, '4076.505')] +[2022-07-07 08:07:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 4055040. Throughput: 0: 6557.2. Samples: 8109856. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:07:14,712][09926] Avg episode reward: [(0, '4072.742')] +[2022-07-07 08:07:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 4071424. Throughput: 0: 6483.9. Samples: 8147504. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:07:19,715][09926] Avg episode reward: [(0, '4115.044')] +[2022-07-07 08:07:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 4087808. Throughput: 0: 6463.1. Samples: 8166824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:07:24,712][09926] Avg episode reward: [(0, '4198.754')] +[2022-07-07 08:07:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 4104192. Throughput: 0: 6450.7. Samples: 8203712. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:07:29,712][09926] Avg episode reward: [(0, '4109.580')] +[2022-07-07 08:07:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 4120576. Throughput: 0: 6371.6. Samples: 8241152. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:07:34,712][09926] Avg episode reward: [(0, '4044.156')] +[2022-07-07 08:07:39,724][09926] Fps is (10 sec: 3272.9, 60 sec: 3276.2, 300 sec: 3248.9). Total num frames: 4136960. Throughput: 0: 6324.2. Samples: 8261600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:07:39,724][09926] Avg episode reward: [(0, '3994.249')] +[2022-07-07 08:07:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.1). Total num frames: 4153344. Throughput: 0: 6290.8. Samples: 8299912. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:07:44,712][09926] Avg episode reward: [(0, '4005.152')] +[2022-07-07 08:07:49,713][09926] Fps is (10 sec: 3280.3, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 4169728. Throughput: 0: 6431.7. Samples: 8341024. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:07:49,713][09926] Avg episode reward: [(0, '3993.523')] +[2022-07-07 08:07:54,713][09926] Fps is (10 sec: 3276.2, 60 sec: 3208.4, 300 sec: 3262.9). Total num frames: 4186112. Throughput: 0: 6460.0. Samples: 8361528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:07:54,714][09926] Avg episode reward: [(0, '4011.995')] +[2022-07-07 08:07:59,712][09926] Fps is (10 sec: 2867.5, 60 sec: 3140.3, 300 sec: 3249.0). Total num frames: 4198400. Throughput: 0: 6360.7. Samples: 8396088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:07:59,712][09926] Avg episode reward: [(0, '3809.234')] +[2022-07-07 08:08:04,712][09926] Fps is (10 sec: 2867.7, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 4214784. Throughput: 0: 6423.5. Samples: 8436560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:08:04,712][09926] Avg episode reward: [(0, '3841.221')] +[2022-07-07 08:08:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 4231168. Throughput: 0: 6387.0. Samples: 8454240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:08:09,712][09926] Avg episode reward: [(0, '3839.237')] +[2022-07-07 08:08:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 4247552. Throughput: 0: 6452.1. Samples: 8494056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:08:14,712][09926] Avg episode reward: [(0, '3781.191')] +[2022-07-07 08:08:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4263936. Throughput: 0: 6463.5. Samples: 8532008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:08:19,712][09926] Avg episode reward: [(0, '3753.913')] +[2022-07-07 08:08:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4280320. Throughput: 0: 6455.4. Samples: 8552016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:08:24,712][09926] Avg episode reward: [(0, '3635.079')] +[2022-07-07 08:08:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4296704. Throughput: 0: 6443.4. Samples: 8589864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:08:29,712][09926] Avg episode reward: [(0, '3702.552')] +[2022-07-07 08:08:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4313088. Throughput: 0: 6339.7. Samples: 8626304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:08:34,712][09926] Avg episode reward: [(0, '3685.377')] +[2022-07-07 08:08:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.9, 300 sec: 3221.3). Total num frames: 4325376. Throughput: 0: 6281.0. Samples: 8644160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:08:39,712][09926] Avg episode reward: [(0, '3659.527')] +[2022-07-07 08:08:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 4341760. Throughput: 0: 6384.2. Samples: 8683376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:08:44,712][09926] Avg episode reward: [(0, '3635.638')] +[2022-07-07 08:08:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 4358144. Throughput: 0: 6396.6. Samples: 8724408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:08:49,712][09926] Avg episode reward: [(0, '3619.276')] +[2022-07-07 08:08:54,712][09926] Fps is (10 sec: 3686.2, 60 sec: 3208.6, 300 sec: 3235.2). Total num frames: 4378624. Throughput: 0: 6453.1. Samples: 8744632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:08:54,713][09926] Avg episode reward: [(0, '3626.780')] +[2022-07-07 08:08:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4390912. Throughput: 0: 6420.8. Samples: 8782992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:08:59,712][09926] Avg episode reward: [(0, '3599.012')] +[2022-07-07 08:09:04,712][09926] Fps is (10 sec: 2867.4, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4407296. Throughput: 0: 6402.1. Samples: 8820104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:09:04,712][09926] Avg episode reward: [(0, '3592.507')] +[2022-07-07 08:09:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4423680. Throughput: 0: 6381.5. Samples: 8839184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:09:09,712][09926] Avg episode reward: [(0, '3611.379')] +[2022-07-07 08:09:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4440064. Throughput: 0: 6450.3. Samples: 8880128. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:09:14,712][09926] Avg episode reward: [(0, '3701.991')] +[2022-07-07 08:09:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4456448. Throughput: 0: 6506.8. Samples: 8919112. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:09:19,712][09926] Avg episode reward: [(0, '3746.121')] +[2022-07-07 08:09:24,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 4476928. Throughput: 0: 6572.4. Samples: 8939920. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:09:24,712][09926] Avg episode reward: [(0, '3995.305')] +[2022-07-07 08:09:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 4493312. Throughput: 0: 6556.8. Samples: 8978432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:09:29,712][09926] Avg episode reward: [(0, '3995.305')] +[2022-07-07 08:09:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4505600. Throughput: 0: 6553.9. Samples: 9019336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:09:34,712][09926] Avg episode reward: [(0, '4084.525')] +[2022-07-07 08:09:39,712][09926] Fps is (10 sec: 2867.0, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 4521984. Throughput: 0: 6522.6. Samples: 9038152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:09:39,713][09926] Avg episode reward: [(0, '4270.550')] +[2022-07-07 08:09:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 4538368. Throughput: 0: 6527.3. Samples: 9076720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:09:44,712][09926] Avg episode reward: [(0, '4296.666')] +[2022-07-07 08:09:49,712][09926] Fps is (10 sec: 3277.0, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 4554752. Throughput: 0: 6589.9. Samples: 9116648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:09:49,712][09926] Avg episode reward: [(0, '4296.666')] +[2022-07-07 08:09:54,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 4575232. Throughput: 0: 6555.6. Samples: 9134184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:09:54,712][09926] Avg episode reward: [(0, '4316.270')] +[2022-07-07 08:09:59,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 4591616. Throughput: 0: 6556.5. Samples: 9175168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:09:59,712][09926] Avg episode reward: [(0, '4250.031')] +[2022-07-07 08:10:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 4603904. Throughput: 0: 6499.2. Samples: 9211576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:10:04,712][09926] Avg episode reward: [(0, '4324.836')] +[2022-07-07 08:10:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 4620288. Throughput: 0: 6439.3. Samples: 9229688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:10:09,712][09926] Avg episode reward: [(0, '4324.836')] +[2022-07-07 08:10:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.2). Total num frames: 4636672. Throughput: 0: 6465.4. Samples: 9269376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:10:14,712][09926] Avg episode reward: [(0, '4294.059')] +[2022-07-07 08:10:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 4653056. Throughput: 0: 6409.4. Samples: 9307760. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:10:19,712][09926] Avg episode reward: [(0, '4396.046')] +[2022-07-07 08:10:24,714][09926] Fps is (10 sec: 3275.9, 60 sec: 3208.4, 300 sec: 3235.1). Total num frames: 4669440. Throughput: 0: 6441.5. Samples: 9328032. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:10:24,715][09926] Avg episode reward: [(0, '4328.177')] +[2022-07-07 08:10:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.2). Total num frames: 4685824. Throughput: 0: 6410.5. Samples: 9365192. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:10:29,712][09926] Avg episode reward: [(0, '4328.177')] +[2022-07-07 08:10:34,712][09926] Fps is (10 sec: 2868.0, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4698112. Throughput: 0: 6378.7. Samples: 9403688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:10:34,715][09926] Avg episode reward: [(0, '4260.898')] +[2022-07-07 08:10:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.6, 300 sec: 3221.3). Total num frames: 4714496. Throughput: 0: 6364.4. Samples: 9420584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:10:39,712][09926] Avg episode reward: [(0, '4086.247')] +[2022-07-07 08:10:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4730880. Throughput: 0: 6319.1. Samples: 9459528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:10:44,712][09926] Avg episode reward: [(0, '4005.048')] +[2022-07-07 08:10:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4747264. Throughput: 0: 6366.2. Samples: 9498056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:10:49,712][09926] Avg episode reward: [(0, '4056.226')] +[2022-07-07 08:10:54,713][09926] Fps is (10 sec: 3276.2, 60 sec: 3140.2, 300 sec: 3221.2). Total num frames: 4763648. Throughput: 0: 6421.8. Samples: 9518680. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:10:54,714][09926] Avg episode reward: [(0, '4024.050')] +[2022-07-07 08:10:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 4780032. Throughput: 0: 6358.8. Samples: 9555520. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:10:59,712][09926] Avg episode reward: [(0, '4041.981')] +[2022-07-07 08:11:04,712][09926] Fps is (10 sec: 3277.4, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4796416. Throughput: 0: 6335.3. Samples: 9592848. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:11:04,712][09926] Avg episode reward: [(0, '4214.688')] +[2022-07-07 08:11:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 4808704. Throughput: 0: 6289.5. Samples: 9611040. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:11:09,712][09926] Avg episode reward: [(0, '4214.688')] +[2022-07-07 08:11:14,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 4825088. Throughput: 0: 6368.4. Samples: 9651768. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:11:14,712][09926] Avg episode reward: [(0, '4211.070')] +[2022-07-07 08:11:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 4841472. Throughput: 0: 6387.0. Samples: 9691104. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:11:19,712][09926] Avg episode reward: [(0, '4419.044')] +[2022-07-07 08:11:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.4, 300 sec: 3221.3). Total num frames: 4857856. Throughput: 0: 6452.8. Samples: 9710960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:11:24,712][09926] Avg episode reward: [(0, '4531.451')] +[2022-07-07 08:11:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 4874240. Throughput: 0: 6424.0. Samples: 9748608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:11:29,712][09926] Avg episode reward: [(0, '4531.451')] +[2022-07-07 08:11:34,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 4894720. Throughput: 0: 6493.7. Samples: 9790272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:11:34,712][09926] Avg episode reward: [(0, '4513.376')] +[2022-07-07 08:11:39,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 4911104. Throughput: 0: 6508.0. Samples: 9811528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:11:39,712][09926] Avg episode reward: [(0, '4647.389')] +[2022-07-07 08:11:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 4927488. Throughput: 0: 6647.3. Samples: 9854648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:11:44,712][09926] Avg episode reward: [(0, '4728.263')] +[2022-07-07 08:11:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 4943872. Throughput: 0: 6583.6. Samples: 9889112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:11:49,712][09926] Avg episode reward: [(0, '4728.263')] +[2022-07-07 08:11:54,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.6, 300 sec: 3207.4). Total num frames: 4956160. Throughput: 0: 6608.7. Samples: 9908432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:11:54,712][09926] Avg episode reward: [(0, '4563.064')] +[2022-07-07 08:11:59,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4972544. Throughput: 0: 6547.4. Samples: 9946400. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:11:59,712][09926] Avg episode reward: [(0, '4636.918')] +[2022-07-07 08:12:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4988928. Throughput: 0: 6494.2. Samples: 9983344. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:12:04,712][09926] Avg episode reward: [(0, '4550.645')] +[2022-07-07 08:12:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 5005312. Throughput: 0: 6507.6. Samples: 10003800. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:12:09,712][09926] Avg episode reward: [(0, '4550.645')] +[2022-07-07 08:12:14,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 5025792. Throughput: 0: 6550.7. Samples: 10043392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:12:14,712][09926] Avg episode reward: [(0, '4525.030')] +[2022-07-07 08:12:19,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 5042176. Throughput: 0: 6545.4. Samples: 10084816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:12:19,712][09926] Avg episode reward: [(0, '4446.263')] +[2022-07-07 08:12:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 5058560. Throughput: 0: 6564.4. Samples: 10106928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:12:24,712][09926] Avg episode reward: [(0, '4480.940')] +[2022-07-07 08:12:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 5074944. Throughput: 0: 6441.4. Samples: 10144512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:12:29,712][09926] Avg episode reward: [(0, '4515.700')] +[2022-07-07 08:12:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.3). Total num frames: 5091328. Throughput: 0: 6567.6. Samples: 10184656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:12:34,712][09926] Avg episode reward: [(0, '4575.983')] +[2022-07-07 08:12:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 5107712. Throughput: 0: 6582.7. Samples: 10204656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:12:39,712][09926] Avg episode reward: [(0, '4685.050')] +[2022-07-07 08:12:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.2). Total num frames: 5124096. Throughput: 0: 6605.7. Samples: 10243656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:12:44,712][09926] Avg episode reward: [(0, '4661.412')] +[2022-07-07 08:12:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.2). Total num frames: 5140480. Throughput: 0: 6693.5. Samples: 10284552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:12:49,712][09926] Avg episode reward: [(0, '4655.472')] +[2022-07-07 08:12:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 5156864. Throughput: 0: 6664.7. Samples: 10303712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:12:54,712][09926] Avg episode reward: [(0, '4541.417')] +[2022-07-07 08:12:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 5173248. Throughput: 0: 6667.6. Samples: 10343432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:12:59,712][09926] Avg episode reward: [(0, '4350.814')] +[2022-07-07 08:13:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 5189632. Throughput: 0: 6598.6. Samples: 10381752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:13:04,712][09926] Avg episode reward: [(0, '4368.936')] +[2022-07-07 08:13:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 5206016. Throughput: 0: 6553.2. Samples: 10401824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:13:09,712][09926] Avg episode reward: [(0, '4325.053')] +[2022-07-07 08:13:14,713][09926] Fps is (10 sec: 3276.3, 60 sec: 3276.7, 300 sec: 3249.0). Total num frames: 5222400. Throughput: 0: 6560.1. Samples: 10439728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:13:14,714][09926] Avg episode reward: [(0, '4216.850')] +[2022-07-07 08:13:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 5238784. Throughput: 0: 6600.9. Samples: 10481696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:13:19,712][09926] Avg episode reward: [(0, '4379.386')] +[2022-07-07 08:13:24,712][09926] Fps is (10 sec: 3277.3, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 5255168. Throughput: 0: 6577.8. Samples: 10500656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:13:24,712][09926] Avg episode reward: [(0, '4350.081')] +[2022-07-07 08:13:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 5271552. Throughput: 0: 6582.0. Samples: 10539848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:13:29,712][09926] Avg episode reward: [(0, '4355.058')] +[2022-07-07 08:13:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 5287936. Throughput: 0: 6486.2. Samples: 10576432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:13:34,712][09926] Avg episode reward: [(0, '4503.853')] +[2022-07-07 08:13:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 5304320. Throughput: 0: 6549.9. Samples: 10598456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:13:39,712][09926] Avg episode reward: [(0, '4538.290')] +[2022-07-07 08:13:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 5320704. Throughput: 0: 6552.4. Samples: 10638288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:13:44,712][09926] Avg episode reward: [(0, '4594.152')] +[2022-07-07 08:13:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 5337088. Throughput: 0: 6593.6. Samples: 10678464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:13:49,712][09926] Avg episode reward: [(0, '4600.127')] +[2022-07-07 08:13:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 5353472. Throughput: 0: 6597.3. Samples: 10698704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:13:54,712][09926] Avg episode reward: [(0, '4520.980')] +[2022-07-07 08:13:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 5369856. Throughput: 0: 6664.6. Samples: 10739624. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:13:59,712][09926] Avg episode reward: [(0, '4585.778')] +[2022-07-07 08:14:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 5382144. Throughput: 0: 6461.5. Samples: 10772464. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:14:04,715][09926] Avg episode reward: [(0, '4585.778')] +[2022-07-07 08:14:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 5398528. Throughput: 0: 6435.9. Samples: 10790272. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:14:09,712][09926] Avg episode reward: [(0, '4469.712')] +[2022-07-07 08:14:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.6, 300 sec: 3249.0). Total num frames: 5414912. Throughput: 0: 6522.0. Samples: 10833336. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:14:14,712][09926] Avg episode reward: [(0, '4457.107')] +[2022-07-07 08:14:19,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 5435392. Throughput: 0: 6703.1. Samples: 10878072. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:14:19,712][09926] Avg episode reward: [(0, '4275.853')] +[2022-07-07 08:14:24,712][09926] Fps is (10 sec: 4096.0, 60 sec: 3345.1, 300 sec: 3262.9). Total num frames: 5455872. Throughput: 0: 6779.9. Samples: 10903552. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:14:24,712][09926] Avg episode reward: [(0, '4262.772')] +[2022-07-07 08:14:29,712][09926] Fps is (10 sec: 4096.0, 60 sec: 3413.3, 300 sec: 3290.7). Total num frames: 5476352. Throughput: 0: 6941.2. Samples: 10950640. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:14:29,712][09926] Avg episode reward: [(0, '4402.264')] +[2022-07-07 08:14:34,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3413.3, 300 sec: 3290.7). Total num frames: 5492736. Throughput: 0: 7003.7. Samples: 10993632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:14:34,712][09926] Avg episode reward: [(0, '4362.426')] +[2022-07-07 08:14:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 5505024. Throughput: 0: 6918.8. Samples: 11010048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:14:39,712][09926] Avg episode reward: [(0, '4399.322')] +[2022-07-07 08:14:44,712][09926] Fps is (10 sec: 3276.7, 60 sec: 3413.3, 300 sec: 3290.7). Total num frames: 5525504. Throughput: 0: 6740.8. Samples: 11042960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:14:44,712][09926] Avg episode reward: [(0, '4399.672')] +[2022-07-07 08:14:49,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3413.3, 300 sec: 3276.8). Total num frames: 5541888. Throughput: 0: 6939.4. Samples: 11084736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:14:49,712][09926] Avg episode reward: [(0, '4464.543')] +[2022-07-07 08:14:54,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3345.1, 300 sec: 3262.9). Total num frames: 5554176. Throughput: 0: 6947.7. Samples: 11102920. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:14:54,712][09926] Avg episode reward: [(0, '4491.925')] +[2022-07-07 08:14:59,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 5570560. Throughput: 0: 6839.6. Samples: 11141120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:14:59,712][09926] Avg episode reward: [(0, '4404.198')] +[2022-07-07 08:15:04,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3481.6, 300 sec: 3290.7). Total num frames: 5591040. Throughput: 0: 6756.6. Samples: 11182120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:15:04,712][09926] Avg episode reward: [(0, '4410.222')] +[2022-07-07 08:15:09,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3481.6, 300 sec: 3290.7). Total num frames: 5607424. Throughput: 0: 6736.7. Samples: 11206704. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:15:09,712][09926] Avg episode reward: [(0, '4682.402')] +[2022-07-07 08:15:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3481.6, 300 sec: 3290.7). Total num frames: 5623808. Throughput: 0: 6596.4. Samples: 11247480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:15:14,712][09926] Avg episode reward: [(0, '4772.848')] +[2022-07-07 08:15:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3413.3, 300 sec: 3290.7). Total num frames: 5640192. Throughput: 0: 6539.7. Samples: 11287920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:15:19,712][09926] Avg episode reward: [(0, '4767.889')] +[2022-07-07 08:15:24,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3413.3, 300 sec: 3304.6). Total num frames: 5660672. Throughput: 0: 6632.0. Samples: 11308488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:15:24,712][09926] Avg episode reward: [(0, '4820.096')] +[2022-07-07 08:15:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3304.6). Total num frames: 5672960. Throughput: 0: 6796.3. Samples: 11348792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:15:29,712][09926] Avg episode reward: [(0, '4938.170')] +[2022-07-07 08:15:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3304.6). Total num frames: 5689344. Throughput: 0: 6712.9. Samples: 11386816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:15:34,712][09926] Avg episode reward: [(0, '4870.900')] +[2022-07-07 08:15:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3304.6). Total num frames: 5705728. Throughput: 0: 6725.7. Samples: 11405576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:15:39,712][09926] Avg episode reward: [(0, '4870.900')] +[2022-07-07 08:15:44,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3318.5). Total num frames: 5726208. Throughput: 0: 6755.6. Samples: 11445120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:15:44,714][09926] Avg episode reward: [(0, '4837.010')] +[2022-07-07 08:15:49,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3318.5). Total num frames: 5742592. Throughput: 0: 6747.9. Samples: 11485776. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:15:49,712][09926] Avg episode reward: [(0, '4779.043')] +[2022-07-07 08:15:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3413.3, 300 sec: 3318.5). Total num frames: 5758976. Throughput: 0: 6680.0. Samples: 11507304. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:15:54,712][09926] Avg episode reward: [(0, '4681.414')] +[2022-07-07 08:15:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3413.3, 300 sec: 3318.5). Total num frames: 5775360. Throughput: 0: 6623.8. Samples: 11545552. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:15:59,712][09926] Avg episode reward: [(0, '4681.414')] +[2022-07-07 08:16:04,712][09926] Fps is (10 sec: 3276.9, 60 sec: 3345.1, 300 sec: 3332.3). Total num frames: 5791744. Throughput: 0: 6568.2. Samples: 11583488. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:16:04,712][09926] Avg episode reward: [(0, '4609.665')] +[2022-07-07 08:16:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3318.5). Total num frames: 5804032. Throughput: 0: 6553.2. Samples: 11603384. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:16:09,712][09926] Avg episode reward: [(0, '4663.717')] +[2022-07-07 08:16:14,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3318.5). Total num frames: 5820416. Throughput: 0: 6483.7. Samples: 11640560. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:16:14,712][09926] Avg episode reward: [(0, '4799.127')] +[2022-07-07 08:16:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3318.5). Total num frames: 5836800. Throughput: 0: 6550.6. Samples: 11681592. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:16:19,712][09926] Avg episode reward: [(0, '4799.127')] +[2022-07-07 08:16:24,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 5857280. Throughput: 0: 6664.7. Samples: 11705488. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:16:24,712][09926] Avg episode reward: [(0, '4892.102')] +[2022-07-07 08:16:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3318.5). Total num frames: 5873664. Throughput: 0: 6718.2. Samples: 11747440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:16:29,712][09926] Avg episode reward: [(0, '4918.404')] +[2022-07-07 08:16:34,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3413.3, 300 sec: 3332.3). Total num frames: 5894144. Throughput: 0: 6722.5. Samples: 11788288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:16:34,712][09926] Avg episode reward: [(0, '5020.928')] +[2022-07-07 08:16:39,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3413.3, 300 sec: 3332.3). Total num frames: 5910528. Throughput: 0: 6722.7. Samples: 11809824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:16:39,712][09926] Avg episode reward: [(0, '4982.167')] +[2022-07-07 08:16:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3332.3). Total num frames: 5926912. Throughput: 0: 6767.1. Samples: 11850072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:16:44,712][09926] Avg episode reward: [(0, '5153.414')] +[2022-07-07 08:16:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3346.2). Total num frames: 5943296. Throughput: 0: 6746.3. Samples: 11887072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:16:49,712][09926] Avg episode reward: [(0, '5240.180')] +[2022-07-07 08:16:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3346.2). Total num frames: 5959680. Throughput: 0: 6737.8. Samples: 11906584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:16:54,712][09926] Avg episode reward: [(0, '5245.406')] +[2022-07-07 08:16:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3346.2). Total num frames: 5976064. Throughput: 0: 6858.5. Samples: 11949192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:16:59,712][09926] Avg episode reward: [(0, '5278.699')] +[2022-07-07 08:17:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3346.2). Total num frames: 5992448. Throughput: 0: 6833.8. Samples: 11989112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:17:04,712][09926] Avg episode reward: [(0, '5384.660')] +[2022-07-07 08:17:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3413.3, 300 sec: 3332.3). Total num frames: 6008832. Throughput: 0: 6755.2. Samples: 12009472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:17:09,712][09926] Avg episode reward: [(0, '5402.009')] +[2022-07-07 08:17:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3413.3, 300 sec: 3332.3). Total num frames: 6025216. Throughput: 0: 6649.8. Samples: 12046680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:17:14,715][09926] Avg episode reward: [(0, '5406.629')] +[2022-07-07 08:17:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3413.3, 300 sec: 3332.3). Total num frames: 6041600. Throughput: 0: 6581.5. Samples: 12084456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:17:19,712][09926] Avg episode reward: [(0, '5375.478')] +[2022-07-07 08:17:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3332.3). Total num frames: 6057984. Throughput: 0: 6560.9. Samples: 12105064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:17:24,712][09926] Avg episode reward: [(0, '5350.613')] +[2022-07-07 08:17:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3332.3). Total num frames: 6074368. Throughput: 0: 6533.3. Samples: 12144072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:17:29,712][09926] Avg episode reward: [(0, '5274.295')] +[2022-07-07 08:17:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6090752. Throughput: 0: 6542.9. Samples: 12181504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:17:34,712][09926] Avg episode reward: [(0, '5321.073')] +[2022-07-07 08:17:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6107136. Throughput: 0: 6648.9. Samples: 12205784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:17:39,712][09926] Avg episode reward: [(0, '5246.399')] +[2022-07-07 08:17:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6123520. Throughput: 0: 6574.2. Samples: 12245032. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:17:44,712][09926] Avg episode reward: [(0, '5137.116')] +[2022-07-07 08:17:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6139904. Throughput: 0: 6459.9. Samples: 12279808. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:17:49,712][09926] Avg episode reward: [(0, '4934.078')] +[2022-07-07 08:17:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6156288. Throughput: 0: 6490.8. Samples: 12301560. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:17:54,712][09926] Avg episode reward: [(0, '4934.078')] +[2022-07-07 08:17:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6172672. Throughput: 0: 6559.5. Samples: 12341856. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:17:59,712][09926] Avg episode reward: [(0, '4972.252')] +[2022-07-07 08:18:04,717][09926] Fps is (10 sec: 3275.2, 60 sec: 3276.5, 300 sec: 3332.3). Total num frames: 6189056. Throughput: 0: 6601.4. Samples: 12381552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:18:04,717][09926] Avg episode reward: [(0, '4985.714')] +[2022-07-07 08:18:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.4). Total num frames: 6205440. Throughput: 0: 6572.8. Samples: 12400840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:18:09,712][09926] Avg episode reward: [(0, '4922.434')] +[2022-07-07 08:18:14,712][09926] Fps is (10 sec: 3278.4, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6221824. Throughput: 0: 6523.9. Samples: 12437648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:18:14,712][09926] Avg episode reward: [(0, '4922.434')] +[2022-07-07 08:18:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3318.5). Total num frames: 6234112. Throughput: 0: 6553.1. Samples: 12476392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:18:19,712][09926] Avg episode reward: [(0, '4990.713')] +[2022-07-07 08:18:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3318.5). Total num frames: 6250496. Throughput: 0: 6447.3. Samples: 12495912. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:18:24,712][09926] Avg episode reward: [(0, '5112.321')] +[2022-07-07 08:18:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6270976. Throughput: 0: 6495.7. Samples: 12537336. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:18:29,712][09926] Avg episode reward: [(0, '4947.511')] +[2022-07-07 08:18:34,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6287360. Throughput: 0: 6616.0. Samples: 12577528. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:18:34,712][09926] Avg episode reward: [(0, '4947.511')] +[2022-07-07 08:18:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6303744. Throughput: 0: 6613.9. Samples: 12599184. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:18:39,712][09926] Avg episode reward: [(0, '5079.767')] +[2022-07-07 08:18:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6320128. Throughput: 0: 6625.6. Samples: 12640008. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:18:44,712][09926] Avg episode reward: [(0, '5178.897')] +[2022-07-07 08:18:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6336512. Throughput: 0: 6544.9. Samples: 12676040. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:18:49,712][09926] Avg episode reward: [(0, '5176.244')] +[2022-07-07 08:18:54,714][09926] Fps is (10 sec: 3276.1, 60 sec: 3276.7, 300 sec: 3332.3). Total num frames: 6352896. Throughput: 0: 6516.3. Samples: 12694088. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:18:54,714][09926] Avg episode reward: [(0, '5176.244')] +[2022-07-07 08:18:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3346.2). Total num frames: 6369280. Throughput: 0: 6571.9. Samples: 12733384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:18:59,712][09926] Avg episode reward: [(0, '5390.871')] +[2022-07-07 08:19:04,712][09926] Fps is (10 sec: 3277.5, 60 sec: 3277.1, 300 sec: 3346.2). Total num frames: 6385664. Throughput: 0: 6566.9. Samples: 12771904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:19:04,712][09926] Avg episode reward: [(0, '5474.272')] +[2022-07-07 08:19:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3346.2). Total num frames: 6402048. Throughput: 0: 6599.5. Samples: 12792888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:19:09,712][09926] Avg episode reward: [(0, '5428.833')] +[2022-07-07 08:19:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6418432. Throughput: 0: 6525.0. Samples: 12830960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:19:14,714][09926] Avg episode reward: [(0, '5429.033')] +[2022-07-07 08:19:19,715][09926] Fps is (10 sec: 2866.3, 60 sec: 3276.6, 300 sec: 3304.5). Total num frames: 6430720. Throughput: 0: 6487.5. Samples: 12869488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:19:19,715][09926] Avg episode reward: [(0, '5421.081')] +[2022-07-07 08:19:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3304.6). Total num frames: 6451200. Throughput: 0: 6437.5. Samples: 12888872. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:19:24,712][09926] Avg episode reward: [(0, '5194.798')] +[2022-07-07 08:19:29,712][09926] Fps is (10 sec: 3687.6, 60 sec: 3276.8, 300 sec: 3304.6). Total num frames: 6467584. Throughput: 0: 6450.0. Samples: 12930256. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:19:29,712][09926] Avg episode reward: [(0, '5139.795')] +[2022-07-07 08:19:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3304.6). Total num frames: 6479872. Throughput: 0: 6483.0. Samples: 12967776. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:19:34,712][09926] Avg episode reward: [(0, '5138.720')] +[2022-07-07 08:19:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6496256. Throughput: 0: 6448.8. Samples: 12984272. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:19:39,712][09926] Avg episode reward: [(0, '5093.593')] +[2022-07-07 08:19:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6512640. Throughput: 0: 6482.8. Samples: 13025112. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:19:44,712][09926] Avg episode reward: [(0, '5183.822')] +[2022-07-07 08:19:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3304.6). Total num frames: 6529024. Throughput: 0: 6456.9. Samples: 13062464. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:19:49,712][09926] Avg episode reward: [(0, '5254.607')] +[2022-07-07 08:19:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.7, 300 sec: 3304.6). Total num frames: 6545408. Throughput: 0: 6424.9. Samples: 13082008. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:19:54,712][09926] Avg episode reward: [(0, '5254.922')] +[2022-07-07 08:19:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6561792. Throughput: 0: 6402.1. Samples: 13119056. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:19:59,712][09926] Avg episode reward: [(0, '5410.360')] +[2022-07-07 08:20:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6578176. Throughput: 0: 6375.6. Samples: 13156368. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:20:04,712][09926] Avg episode reward: [(0, '5489.617')] +[2022-07-07 08:20:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6594560. Throughput: 0: 6427.4. Samples: 13178104. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:20:09,712][09926] Avg episode reward: [(0, '5542.617')] +[2022-07-07 08:20:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6610944. Throughput: 0: 6438.4. Samples: 13219984. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:20:14,712][09926] Avg episode reward: [(0, '5542.427')] +[2022-07-07 08:20:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3277.0, 300 sec: 3276.8). Total num frames: 6627328. Throughput: 0: 6549.5. Samples: 13262504. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:20:19,712][09926] Avg episode reward: [(0, '5539.875')] +[2022-07-07 08:20:24,712][09926] Fps is (10 sec: 3276.6, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6643712. Throughput: 0: 6554.6. Samples: 13279232. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:20:24,713][09926] Avg episode reward: [(0, '5541.668')] +[2022-07-07 08:20:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6660096. Throughput: 0: 6523.2. Samples: 13318656. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:20:29,712][09926] Avg episode reward: [(0, '5543.332')] +[2022-07-07 08:20:34,712][09926] Fps is (10 sec: 3277.0, 60 sec: 3276.8, 300 sec: 3290.7). Total num frames: 6676480. Throughput: 0: 6470.2. Samples: 13353624. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:20:34,712][09926] Avg episode reward: [(0, '5543.544')] +[2022-07-07 08:20:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 6692864. Throughput: 0: 6532.8. Samples: 13375984. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:20:39,712][09926] Avg episode reward: [(0, '5545.918')] +[2022-07-07 08:20:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 6709248. Throughput: 0: 6546.3. Samples: 13413640. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) +[2022-07-07 08:20:44,712][09926] Avg episode reward: [(0, '5503.828')] +[2022-07-07 08:20:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 6725632. Throughput: 0: 6632.4. Samples: 13454824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:20:49,712][09926] Avg episode reward: [(0, '5475.180')] +[2022-07-07 08:20:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 6742016. Throughput: 0: 6597.9. Samples: 13475008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:20:54,712][09926] Avg episode reward: [(0, '5477.279')] +[2022-07-07 08:20:59,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3262.9). Total num frames: 6754304. Throughput: 0: 6463.3. Samples: 13510832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:20:59,712][09926] Avg episode reward: [(0, '5448.098')] +[2022-07-07 08:21:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3276.8). Total num frames: 6770688. Throughput: 0: 6378.8. Samples: 13549552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:21:04,712][09926] Avg episode reward: [(0, '5573.733')] +[2022-07-07 08:21:09,712][09926] Fps is (10 sec: 3686.5, 60 sec: 3276.8, 300 sec: 3290.7). Total num frames: 6791168. Throughput: 0: 6490.1. Samples: 13571280. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:21:09,712][09926] Avg episode reward: [(0, '5511.897')] +[2022-07-07 08:21:14,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3290.7). Total num frames: 6807552. Throughput: 0: 6522.5. Samples: 13612168. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:21:14,712][09926] Avg episode reward: [(0, '5499.097')] +[2022-07-07 08:21:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 6823936. Throughput: 0: 6635.6. Samples: 13652224. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:21:19,712][09926] Avg episode reward: [(0, '5565.567')] +[2022-07-07 08:21:24,713][09926] Fps is (10 sec: 3276.4, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 6840320. Throughput: 0: 6587.9. Samples: 13672448. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:21:24,714][09926] Avg episode reward: [(0, '5594.050')] +[2022-07-07 08:21:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 6860800. Throughput: 0: 6635.9. Samples: 13712256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:21:29,714][09926] Avg episode reward: [(0, '5568.279')] +[2022-07-07 08:21:34,712][09926] Fps is (10 sec: 3686.9, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 6877184. Throughput: 0: 6686.0. Samples: 13755696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:21:34,714][09926] Avg episode reward: [(0, '5518.223')] +[2022-07-07 08:21:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 6893568. Throughput: 0: 6744.0. Samples: 13778488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:21:39,712][09926] Avg episode reward: [(0, '5549.734')] +[2022-07-07 08:21:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 6909952. Throughput: 0: 6862.2. Samples: 13819632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:21:44,714][09926] Avg episode reward: [(0, '5482.649')] +[2022-07-07 08:21:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 6926336. Throughput: 0: 6786.1. Samples: 13854928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:21:49,712][09926] Avg episode reward: [(0, '5482.649')] +[2022-07-07 08:21:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 6942720. Throughput: 0: 6797.1. Samples: 13877152. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:21:54,712][09926] Avg episode reward: [(0, '5484.157')] +[2022-07-07 08:21:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3413.3, 300 sec: 3276.8). Total num frames: 6959104. Throughput: 0: 6737.2. Samples: 13915344. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:21:59,712][09926] Avg episode reward: [(0, '5515.102')] +[2022-07-07 08:22:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3345.1, 300 sec: 3262.9). Total num frames: 6971392. Throughput: 0: 6603.6. Samples: 13949384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:22:04,712][09926] Avg episode reward: [(0, '5490.652')] +[2022-07-07 08:22:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 6987776. Throughput: 0: 6553.3. Samples: 13967336. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:22:09,712][09926] Avg episode reward: [(0, '5490.652')] +[2022-07-07 08:22:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 7004160. Throughput: 0: 6469.3. Samples: 14003376. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:22:14,712][09926] Avg episode reward: [(0, '5473.009')] +[2022-07-07 08:22:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 7020544. Throughput: 0: 6389.5. Samples: 14043224. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:22:19,712][09926] Avg episode reward: [(0, '5336.644')] +[2022-07-07 08:22:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.6, 300 sec: 3249.0). Total num frames: 7032832. Throughput: 0: 6321.8. Samples: 14062968. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:22:24,712][09926] Avg episode reward: [(0, '5144.918')] +[2022-07-07 08:22:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3262.9). Total num frames: 7053312. Throughput: 0: 6275.7. Samples: 14102040. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:22:29,712][09926] Avg episode reward: [(0, '5144.918')] +[2022-07-07 08:22:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3249.0). Total num frames: 7065600. Throughput: 0: 6299.0. Samples: 14138384. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:22:34,712][09926] Avg episode reward: [(0, '5145.353')] +[2022-07-07 08:22:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3249.0). Total num frames: 7081984. Throughput: 0: 6189.3. Samples: 14155672. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:22:39,712][09926] Avg episode reward: [(0, '5145.023')] +[2022-07-07 08:22:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3249.0). Total num frames: 7098368. Throughput: 0: 6120.2. Samples: 14190752. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:22:44,712][09926] Avg episode reward: [(0, '5092.698')] +[2022-07-07 08:22:49,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3072.0, 300 sec: 3235.1). Total num frames: 7110656. Throughput: 0: 6223.8. Samples: 14229456. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:22:49,712][09926] Avg episode reward: [(0, '5133.702')] +[2022-07-07 08:22:54,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3072.0, 300 sec: 3235.1). Total num frames: 7127040. Throughput: 0: 6280.2. Samples: 14249944. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:22:54,712][09926] Avg episode reward: [(0, '5182.806')] +[2022-07-07 08:22:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3072.0, 300 sec: 3235.2). Total num frames: 7143424. Throughput: 0: 6304.7. Samples: 14287088. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:22:59,712][09926] Avg episode reward: [(0, '5250.231')] +[2022-07-07 08:23:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3235.1). Total num frames: 7159808. Throughput: 0: 6249.1. Samples: 14324432. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:23:04,712][09926] Avg episode reward: [(0, '5313.267')] +[2022-07-07 08:23:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3235.1). Total num frames: 7176192. Throughput: 0: 6239.1. Samples: 14343728. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:23:09,712][09926] Avg episode reward: [(0, '5284.820')] +[2022-07-07 08:23:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3249.0). Total num frames: 7192576. Throughput: 0: 6284.6. Samples: 14384848. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:23:14,712][09926] Avg episode reward: [(0, '5254.021')] +[2022-07-07 08:23:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3249.0). Total num frames: 7208960. Throughput: 0: 6274.3. Samples: 14420728. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:23:19,715][09926] Avg episode reward: [(0, '5322.423')] +[2022-07-07 08:23:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 7225344. Throughput: 0: 6322.3. Samples: 14440176. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:23:24,712][09926] Avg episode reward: [(0, '5303.798')] +[2022-07-07 08:23:29,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3072.0, 300 sec: 3221.3). Total num frames: 7237632. Throughput: 0: 6344.5. Samples: 14476256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:23:29,712][09926] Avg episode reward: [(0, '5273.702')] +[2022-07-07 08:23:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 7254016. Throughput: 0: 6371.9. Samples: 14516192. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:23:34,712][09926] Avg episode reward: [(0, '5210.949')] +[2022-07-07 08:23:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 7270400. Throughput: 0: 6313.1. Samples: 14534032. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:23:39,712][09926] Avg episode reward: [(0, '5193.604')] +[2022-07-07 08:23:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 7286784. Throughput: 0: 6358.2. Samples: 14573208. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:23:44,712][09926] Avg episode reward: [(0, '5097.680')] +[2022-07-07 08:23:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7303168. Throughput: 0: 6320.4. Samples: 14608848. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:23:49,712][09926] Avg episode reward: [(0, '5118.979')] +[2022-07-07 08:23:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7319552. Throughput: 0: 6371.9. Samples: 14630464. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:23:54,712][09926] Avg episode reward: [(0, '5153.335')] +[2022-07-07 08:23:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7335936. Throughput: 0: 6331.6. Samples: 14669768. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:23:59,712][09926] Avg episode reward: [(0, '5380.703')] +[2022-07-07 08:24:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7352320. Throughput: 0: 6337.6. Samples: 14705920. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:24:04,712][09926] Avg episode reward: [(0, '5384.505')] +[2022-07-07 08:24:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7368704. Throughput: 0: 6396.8. Samples: 14728032. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:24:09,712][09926] Avg episode reward: [(0, '5386.182')] +[2022-07-07 08:24:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.2). Total num frames: 7385088. Throughput: 0: 6431.3. Samples: 14765664. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:24:14,712][09926] Avg episode reward: [(0, '5447.930')] +[2022-07-07 08:24:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 7397376. Throughput: 0: 6334.0. Samples: 14801224. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:24:19,712][09926] Avg episode reward: [(0, '5487.977')] +[2022-07-07 08:24:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 7413760. Throughput: 0: 6342.8. Samples: 14819456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:24:24,712][09926] Avg episode reward: [(0, '5479.134')] +[2022-07-07 08:24:29,715][09926] Fps is (10 sec: 3275.8, 60 sec: 3208.4, 300 sec: 3221.2). Total num frames: 7430144. Throughput: 0: 6380.4. Samples: 14860344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:24:29,715][09926] Avg episode reward: [(0, '5480.152')] +[2022-07-07 08:24:34,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 7450624. Throughput: 0: 6497.8. Samples: 14901248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:24:34,712][09926] Avg episode reward: [(0, '5516.816')] +[2022-07-07 08:24:39,712][09926] Fps is (10 sec: 3687.6, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 7467008. Throughput: 0: 6515.4. Samples: 14923656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:24:39,712][09926] Avg episode reward: [(0, '5642.032')] +[2022-07-07 08:24:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 7483392. Throughput: 0: 6451.7. Samples: 14960096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:24:44,712][09926] Avg episode reward: [(0, '5546.328')] +[2022-07-07 08:24:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 7499776. Throughput: 0: 6527.6. Samples: 14999664. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:24:49,712][09926] Avg episode reward: [(0, '5585.497')] +[2022-07-07 08:24:54,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7512064. Throughput: 0: 6400.9. Samples: 15016072. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:24:54,712][09926] Avg episode reward: [(0, '5487.867')] +[2022-07-07 08:24:59,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7528448. Throughput: 0: 6470.2. Samples: 15056824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:24:59,712][09926] Avg episode reward: [(0, '5466.086')] +[2022-07-07 08:25:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7544832. Throughput: 0: 6434.5. Samples: 15090776. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:25:04,712][09926] Avg episode reward: [(0, '5431.697')] +[2022-07-07 08:25:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7561216. Throughput: 0: 6489.1. Samples: 15111464. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:25:09,712][09926] Avg episode reward: [(0, '5336.177')] +[2022-07-07 08:25:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7577600. Throughput: 0: 6416.4. Samples: 15149064. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:25:14,712][09926] Avg episode reward: [(0, '5389.591')] +[2022-07-07 08:25:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 7589888. Throughput: 0: 6332.4. Samples: 15186208. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:25:19,713][09926] Avg episode reward: [(0, '5573.668')] +[2022-07-07 08:25:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 7606272. Throughput: 0: 6236.8. Samples: 15204312. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:25:24,712][09926] Avg episode reward: [(0, '5610.152')] +[2022-07-07 08:25:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.7, 300 sec: 3207.4). Total num frames: 7622656. Throughput: 0: 6327.7. Samples: 15244840. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) +[2022-07-07 08:25:29,712][09926] Avg episode reward: [(0, '5579.085')] +[2022-07-07 08:25:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 7639040. Throughput: 0: 6291.7. Samples: 15282792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:25:34,712][09926] Avg episode reward: [(0, '5625.018')] +[2022-07-07 08:25:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 7655424. Throughput: 0: 6368.5. Samples: 15302656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:25:39,712][09926] Avg episode reward: [(0, '5519.252')] +[2022-07-07 08:25:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 7671808. Throughput: 0: 6336.7. Samples: 15341976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:25:44,712][09926] Avg episode reward: [(0, '5528.194')] +[2022-07-07 08:25:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 7688192. Throughput: 0: 6519.6. Samples: 15384160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:25:49,712][09926] Avg episode reward: [(0, '5467.119')] +[2022-07-07 08:25:54,712][09926] Fps is (10 sec: 3276.7, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7704576. Throughput: 0: 6503.8. Samples: 15404136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:25:54,712][09926] Avg episode reward: [(0, '5480.270')] +[2022-07-07 08:25:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7720960. Throughput: 0: 6507.4. Samples: 15441896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:25:59,712][09926] Avg episode reward: [(0, '5548.300')] +[2022-07-07 08:26:04,712][09926] Fps is (10 sec: 3276.9, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 7737344. Throughput: 0: 6438.0. Samples: 15475920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:26:04,712][09926] Avg episode reward: [(0, '5608.922')] +[2022-07-07 08:26:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 7753728. Throughput: 0: 6554.5. Samples: 15499264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:26:09,712][09926] Avg episode reward: [(0, '5603.177')] +[2022-07-07 08:26:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 7770112. Throughput: 0: 6549.2. Samples: 15539552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:26:14,712][09926] Avg episode reward: [(0, '5685.042')] +[2022-07-07 08:26:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3207.4). Total num frames: 7786496. Throughput: 0: 6568.9. Samples: 15578392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:26:19,712][09926] Avg episode reward: [(0, '5780.894')] +[2022-07-07 08:26:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3193.5). Total num frames: 7802880. Throughput: 0: 6553.3. Samples: 15597552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:26:24,712][09926] Avg episode reward: [(0, '5792.325')] +[2022-07-07 08:26:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3193.5). Total num frames: 7819264. Throughput: 0: 6578.0. Samples: 15637984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:26:29,712][09926] Avg episode reward: [(0, '5792.325')] +[2022-07-07 08:26:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3193.5). Total num frames: 7835648. Throughput: 0: 6497.6. Samples: 15676552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:26:34,712][09926] Avg episode reward: [(0, '5739.823')] +[2022-07-07 08:26:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3193.5). Total num frames: 7852032. Throughput: 0: 6506.2. Samples: 15696912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:26:39,712][09926] Avg episode reward: [(0, '5704.547')] +[2022-07-07 08:26:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3193.5). Total num frames: 7868416. Throughput: 0: 6554.1. Samples: 15736832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:26:44,712][09926] Avg episode reward: [(0, '5752.712')] +[2022-07-07 08:26:49,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3207.4). Total num frames: 7888896. Throughput: 0: 6708.3. Samples: 15777792. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:26:49,712][09926] Avg episode reward: [(0, '5752.712')] +[2022-07-07 08:26:54,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3207.4). Total num frames: 7905280. Throughput: 0: 6677.5. Samples: 15799752. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:26:54,712][09926] Avg episode reward: [(0, '5755.926')] +[2022-07-07 08:26:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3221.3). Total num frames: 7921664. Throughput: 0: 6677.0. Samples: 15840016. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:26:59,712][09926] Avg episode reward: [(0, '5666.064')] +[2022-07-07 08:27:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3207.4). Total num frames: 7933952. Throughput: 0: 6610.5. Samples: 15875864. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:27:04,712][09926] Avg episode reward: [(0, '5667.846')] +[2022-07-07 08:27:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3221.3). Total num frames: 7954432. Throughput: 0: 6650.7. Samples: 15896832. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:27:09,719][09926] Avg episode reward: [(0, '5668.290')] +[2022-07-07 08:27:14,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3221.3). Total num frames: 7970816. Throughput: 0: 6661.9. Samples: 15937768. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:27:14,712][09926] Avg episode reward: [(0, '5696.744')] +[2022-07-07 08:27:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 7987200. Throughput: 0: 6656.2. Samples: 15976080. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:27:19,712][09926] Avg episode reward: [(0, '5534.176')] +[2022-07-07 08:27:24,714][09926] Fps is (10 sec: 3276.2, 60 sec: 3345.0, 300 sec: 3221.2). Total num frames: 8003584. Throughput: 0: 6665.5. Samples: 15996872. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:27:24,714][09926] Avg episode reward: [(0, '5583.482')] +[2022-07-07 08:27:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 8019968. Throughput: 0: 6667.2. Samples: 16036856. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:27:29,712][09926] Avg episode reward: [(0, '5577.031')] +[2022-07-07 08:27:34,712][09926] Fps is (10 sec: 3277.5, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 8036352. Throughput: 0: 6632.7. Samples: 16076264. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:27:34,712][09926] Avg episode reward: [(0, '5592.434')] +[2022-07-07 08:27:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 8052736. Throughput: 0: 6579.5. Samples: 16095832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:27:39,712][09926] Avg episode reward: [(0, '5577.089')] +[2022-07-07 08:27:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 8065024. Throughput: 0: 6496.0. Samples: 16132336. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:27:44,712][09926] Avg episode reward: [(0, '5558.183')] +[2022-07-07 08:27:49,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8081408. Throughput: 0: 6546.7. Samples: 16170464. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:27:49,712][09926] Avg episode reward: [(0, '5559.440')] +[2022-07-07 08:27:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8097792. Throughput: 0: 6453.2. Samples: 16187224. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:27:54,712][09926] Avg episode reward: [(0, '5705.335')] +[2022-07-07 08:27:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8114176. Throughput: 0: 6381.5. Samples: 16224936. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:27:59,712][09926] Avg episode reward: [(0, '5740.944')] +[2022-07-07 08:28:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 8126464. Throughput: 0: 6249.8. Samples: 16257320. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:28:04,712][09926] Avg episode reward: [(0, '5836.524')] +[2022-07-07 08:28:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8142848. Throughput: 0: 6230.0. Samples: 16277208. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:28:09,712][09926] Avg episode reward: [(0, '5833.988')] +[2022-07-07 08:28:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8159232. Throughput: 0: 6253.3. Samples: 16318256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) +[2022-07-07 08:28:14,712][09926] Avg episode reward: [(0, '5829.804')] +[2022-07-07 08:28:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8175616. Throughput: 0: 6216.0. Samples: 16355984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:28:19,712][09926] Avg episode reward: [(0, '5864.477')] +[2022-07-07 08:28:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.4, 300 sec: 3235.1). Total num frames: 8192000. Throughput: 0: 6213.3. Samples: 16375432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:28:24,712][09926] Avg episode reward: [(0, '5893.803')] +[2022-07-07 08:28:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3235.1). Total num frames: 8208384. Throughput: 0: 6269.0. Samples: 16414440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:28:29,712][09926] Avg episode reward: [(0, '5893.705')] +[2022-07-07 08:28:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3235.1). Total num frames: 8224768. Throughput: 0: 6273.1. Samples: 16452752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:28:34,712][09926] Avg episode reward: [(0, '5853.362')] +[2022-07-07 08:28:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3072.0, 300 sec: 3221.3). Total num frames: 8237056. Throughput: 0: 6315.4. Samples: 16471416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:28:39,712][09926] Avg episode reward: [(0, '5851.959')] +[2022-07-07 08:28:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8253440. Throughput: 0: 6322.3. Samples: 16509440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:28:44,712][09926] Avg episode reward: [(0, '5860.634')] +[2022-07-07 08:28:49,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8273920. Throughput: 0: 6459.6. Samples: 16548000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:28:49,712][09926] Avg episode reward: [(0, '5860.634')] +[2022-07-07 08:28:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8286208. Throughput: 0: 6450.0. Samples: 16567456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:28:54,712][09926] Avg episode reward: [(0, '5844.976')] +[2022-07-07 08:28:59,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8302592. Throughput: 0: 6372.8. Samples: 16605032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:28:59,712][09926] Avg episode reward: [(0, '5778.327')] +[2022-07-07 08:29:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 8318976. Throughput: 0: 6357.9. Samples: 16642088. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:29:04,712][09926] Avg episode reward: [(0, '5720.864')] +[2022-07-07 08:29:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 8335360. Throughput: 0: 6364.8. Samples: 16661848. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:29:09,712][09926] Avg episode reward: [(0, '5725.263')] +[2022-07-07 08:29:14,715][09926] Fps is (10 sec: 3275.7, 60 sec: 3208.4, 300 sec: 3235.1). Total num frames: 8351744. Throughput: 0: 6418.5. Samples: 16703296. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:29:14,715][09926] Avg episode reward: [(0, '5730.212')] +[2022-07-07 08:29:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8368128. Throughput: 0: 6376.5. Samples: 16739696. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:29:19,712][09926] Avg episode reward: [(0, '5693.876')] +[2022-07-07 08:29:24,712][09926] Fps is (10 sec: 3277.9, 60 sec: 3208.5, 300 sec: 3235.2). Total num frames: 8384512. Throughput: 0: 6431.3. Samples: 16760824. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:29:24,712][09926] Avg episode reward: [(0, '5647.552')] +[2022-07-07 08:29:29,717][09926] Fps is (10 sec: 3275.0, 60 sec: 3208.2, 300 sec: 3221.2). Total num frames: 8400896. Throughput: 0: 6452.6. Samples: 16799840. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:29:29,718][09926] Avg episode reward: [(0, '5647.552')] +[2022-07-07 08:29:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 8417280. Throughput: 0: 6452.1. Samples: 16838344. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:29:34,712][09926] Avg episode reward: [(0, '5669.736')] +[2022-07-07 08:29:39,714][09926] Fps is (10 sec: 3278.0, 60 sec: 3276.7, 300 sec: 3221.2). Total num frames: 8433664. Throughput: 0: 6474.4. Samples: 16858816. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:29:39,714][09926] Avg episode reward: [(0, '5658.146')] +[2022-07-07 08:29:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 8450048. Throughput: 0: 6519.3. Samples: 16898400. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:29:44,712][09926] Avg episode reward: [(0, '5675.084')] +[2022-07-07 08:29:49,712][09926] Fps is (10 sec: 3277.4, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8466432. Throughput: 0: 6594.1. Samples: 16938824. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:29:49,712][09926] Avg episode reward: [(0, '5675.375')] +[2022-07-07 08:29:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 8482816. Throughput: 0: 6568.4. Samples: 16957424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:29:54,712][09926] Avg episode reward: [(0, '5655.915')] +[2022-07-07 08:29:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 8499200. Throughput: 0: 6522.8. Samples: 16996800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:29:59,715][09926] Avg episode reward: [(0, '5575.669')] +[2022-07-07 08:30:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 8515584. Throughput: 0: 6478.9. Samples: 17031248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:30:04,712][09926] Avg episode reward: [(0, '5551.926')] +[2022-07-07 08:30:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 8531968. Throughput: 0: 6464.9. Samples: 17051744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:30:09,712][09926] Avg episode reward: [(0, '5550.923')] +[2022-07-07 08:30:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3277.0, 300 sec: 3249.0). Total num frames: 8548352. Throughput: 0: 6494.1. Samples: 17092040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:30:14,712][09926] Avg episode reward: [(0, '5532.759')] +[2022-07-07 08:30:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8560640. Throughput: 0: 6469.5. Samples: 17129472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:30:19,712][09926] Avg episode reward: [(0, '5615.170')] +[2022-07-07 08:30:24,713][09926] Fps is (10 sec: 3276.3, 60 sec: 3276.7, 300 sec: 3249.0). Total num frames: 8581120. Throughput: 0: 6539.4. Samples: 17153088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:30:24,714][09926] Avg episode reward: [(0, '5630.480')] +[2022-07-07 08:30:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3277.1, 300 sec: 3249.0). Total num frames: 8597504. Throughput: 0: 6513.4. Samples: 17191504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:30:29,712][09926] Avg episode reward: [(0, '5631.780')] +[2022-07-07 08:30:34,712][09926] Fps is (10 sec: 3277.3, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 8613888. Throughput: 0: 6442.8. Samples: 17228752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:30:34,712][09926] Avg episode reward: [(0, '5830.791')] +[2022-07-07 08:30:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.6, 300 sec: 3235.1). Total num frames: 8626176. Throughput: 0: 6482.7. Samples: 17249144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:30:39,715][09926] Avg episode reward: [(0, '5779.051')] +[2022-07-07 08:30:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8642560. Throughput: 0: 6444.8. Samples: 17286816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:30:44,712][09926] Avg episode reward: [(0, '5889.387')] +[2022-07-07 08:30:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8658944. Throughput: 0: 6544.9. Samples: 17325768. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:30:49,712][09926] Avg episode reward: [(0, '5892.444')] +[2022-07-07 08:30:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8675328. Throughput: 0: 6448.2. Samples: 17341912. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:30:54,712][09926] Avg episode reward: [(0, '5872.142')] +[2022-07-07 08:30:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8691712. Throughput: 0: 6338.0. Samples: 17377248. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:30:59,712][09926] Avg episode reward: [(0, '5886.956')] +[2022-07-07 08:31:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8708096. Throughput: 0: 6411.2. Samples: 17417976. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:31:04,712][09926] Avg episode reward: [(0, '5719.173')] +[2022-07-07 08:31:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8724480. Throughput: 0: 6376.2. Samples: 17440008. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) +[2022-07-07 08:31:09,712][09926] Avg episode reward: [(0, '5719.813')] +[2022-07-07 08:31:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8740864. Throughput: 0: 6378.1. Samples: 17478520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:31:14,712][09926] Avg episode reward: [(0, '5773.799')] +[2022-07-07 08:31:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 8757248. Throughput: 0: 6352.7. Samples: 17514624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:31:19,712][09926] Avg episode reward: [(0, '5611.008')] +[2022-07-07 08:31:24,712][09926] Fps is (10 sec: 3276.7, 60 sec: 3208.6, 300 sec: 3235.1). Total num frames: 8773632. Throughput: 0: 6336.7. Samples: 17534296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:31:24,713][09926] Avg episode reward: [(0, '5668.219')] +[2022-07-07 08:31:29,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8785920. Throughput: 0: 6327.5. Samples: 17571552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:31:29,712][09926] Avg episode reward: [(0, '5618.855')] +[2022-07-07 08:31:34,712][09926] Fps is (10 sec: 2867.3, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8802304. Throughput: 0: 6370.1. Samples: 17612424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:31:34,712][09926] Avg episode reward: [(0, '5658.962')] +[2022-07-07 08:31:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 8818688. Throughput: 0: 6458.1. Samples: 17632528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:31:39,712][09926] Avg episode reward: [(0, '5696.034')] +[2022-07-07 08:31:44,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 8839168. Throughput: 0: 6570.5. Samples: 17672920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:31:44,712][09926] Avg episode reward: [(0, '5715.286')] +[2022-07-07 08:31:49,715][09926] Fps is (10 sec: 3685.3, 60 sec: 3276.6, 300 sec: 3221.2). Total num frames: 8855552. Throughput: 0: 6586.8. Samples: 17714400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:31:49,715][09926] Avg episode reward: [(0, '5746.859')] +[2022-07-07 08:31:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 8871936. Throughput: 0: 6550.4. Samples: 17734776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:31:54,712][09926] Avg episode reward: [(0, '5746.828')] +[2022-07-07 08:31:59,712][09926] Fps is (10 sec: 3277.7, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 8888320. Throughput: 0: 6555.0. Samples: 17773496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:31:59,712][09926] Avg episode reward: [(0, '5790.703')] +[2022-07-07 08:32:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 8900608. Throughput: 0: 6550.0. Samples: 17809376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:32:04,712][09926] Avg episode reward: [(0, '5828.521')] +[2022-07-07 08:32:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 8921088. Throughput: 0: 6512.2. Samples: 17827344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:32:09,712][09926] Avg episode reward: [(0, '5858.527')] +[2022-07-07 08:32:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 8933376. Throughput: 0: 6591.8. Samples: 17868184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:32:14,712][09926] Avg episode reward: [(0, '5926.363')] +[2022-07-07 08:32:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 8953856. Throughput: 0: 6564.4. Samples: 17907824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:32:19,712][09926] Avg episode reward: [(0, '5910.041')] +[2022-07-07 08:32:24,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 8970240. Throughput: 0: 6592.0. Samples: 17929168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:32:24,712][09926] Avg episode reward: [(0, '5885.680')] +[2022-07-07 08:32:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3221.3). Total num frames: 8986624. Throughput: 0: 6634.7. Samples: 17971480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:32:29,712][09926] Avg episode reward: [(0, '5892.236')] +[2022-07-07 08:32:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3221.3). Total num frames: 9003008. Throughput: 0: 6535.2. Samples: 18008464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:32:34,712][09926] Avg episode reward: [(0, '5863.082')] +[2022-07-07 08:32:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 9019392. Throughput: 0: 6565.5. Samples: 18030224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:32:39,712][09926] Avg episode reward: [(0, '5725.642')] +[2022-07-07 08:32:44,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 9039872. Throughput: 0: 6620.6. Samples: 18071424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:32:44,712][09926] Avg episode reward: [(0, '5725.642')] +[2022-07-07 08:32:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3277.0, 300 sec: 3235.1). Total num frames: 9052160. Throughput: 0: 6716.6. Samples: 18111624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:32:49,712][09926] Avg episode reward: [(0, '5864.695')] +[2022-07-07 08:32:54,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 9068544. Throughput: 0: 6701.2. Samples: 18128896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:32:54,712][09926] Avg episode reward: [(0, '5738.466')] +[2022-07-07 08:32:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9084928. Throughput: 0: 6687.8. Samples: 18169136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:32:59,712][09926] Avg episode reward: [(0, '5697.003')] +[2022-07-07 08:33:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 9101312. Throughput: 0: 6647.8. Samples: 18206976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:33:04,713][09926] Avg episode reward: [(0, '5697.003')] +[2022-07-07 08:33:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9117696. Throughput: 0: 6600.4. Samples: 18226184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:33:09,712][09926] Avg episode reward: [(0, '5673.019')] +[2022-07-07 08:33:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 9134080. Throughput: 0: 6498.3. Samples: 18263904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:33:14,712][09926] Avg episode reward: [(0, '5701.241')] +[2022-07-07 08:33:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 9146368. Throughput: 0: 6498.8. Samples: 18300912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:33:19,712][09926] Avg episode reward: [(0, '5790.718')] +[2022-07-07 08:33:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9166848. Throughput: 0: 6533.9. Samples: 18324248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:33:24,712][09926] Avg episode reward: [(0, '5790.718')] +[2022-07-07 08:33:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9183232. Throughput: 0: 6493.9. Samples: 18363648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:33:29,712][09926] Avg episode reward: [(0, '5837.434')] +[2022-07-07 08:33:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9199616. Throughput: 0: 6470.9. Samples: 18402816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:33:34,712][09926] Avg episode reward: [(0, '5906.398')] +[2022-07-07 08:33:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9216000. Throughput: 0: 6506.7. Samples: 18421696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:33:39,712][09926] Avg episode reward: [(0, '5913.469')] +[2022-07-07 08:33:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9232384. Throughput: 0: 6536.5. Samples: 18463280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:33:44,712][09926] Avg episode reward: [(0, '5911.455')] +[2022-07-07 08:33:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9248768. Throughput: 0: 6618.5. Samples: 18504808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:33:49,712][09926] Avg episode reward: [(0, '6005.076')] +[2022-07-07 08:33:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9265152. Throughput: 0: 6622.9. Samples: 18524216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:33:54,712][09926] Avg episode reward: [(0, '6002.119')] +[2022-07-07 08:33:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9281536. Throughput: 0: 6661.2. Samples: 18563656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:33:59,712][09926] Avg episode reward: [(0, '6029.592')] +[2022-07-07 08:34:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9297920. Throughput: 0: 6585.3. Samples: 18597248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:34:04,712][09926] Avg episode reward: [(0, '6029.592')] +[2022-07-07 08:34:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3263.0). Total num frames: 9314304. Throughput: 0: 6551.3. Samples: 18619056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:34:09,712][09926] Avg episode reward: [(0, '6076.824')] +[2022-07-07 08:34:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9330688. Throughput: 0: 6470.6. Samples: 18654824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:34:14,712][09926] Avg episode reward: [(0, '5943.694')] +[2022-07-07 08:34:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9342976. Throughput: 0: 6471.1. Samples: 18694016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:34:19,712][09926] Avg episode reward: [(0, '5956.729')] +[2022-07-07 08:34:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.1). Total num frames: 9359360. Throughput: 0: 6421.3. Samples: 18710656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:34:24,712][09926] Avg episode reward: [(0, '5956.889')] +[2022-07-07 08:34:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9375744. Throughput: 0: 6399.8. Samples: 18751272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:34:29,714][09926] Avg episode reward: [(0, '5915.920')] +[2022-07-07 08:34:34,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9396224. Throughput: 0: 6392.0. Samples: 18792448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:34:34,715][09926] Avg episode reward: [(0, '5725.132')] +[2022-07-07 08:34:39,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9412608. Throughput: 0: 6398.6. Samples: 18812152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:34:39,712][09926] Avg episode reward: [(0, '5746.072')] +[2022-07-07 08:34:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9424896. Throughput: 0: 6361.1. Samples: 18849904. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:34:44,712][09926] Avg episode reward: [(0, '5748.285')] +[2022-07-07 08:34:49,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9441280. Throughput: 0: 6520.5. Samples: 18890672. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:34:49,712][09926] Avg episode reward: [(0, '5829.449')] +[2022-07-07 08:34:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9457664. Throughput: 0: 6401.8. Samples: 18907136. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:34:54,712][09926] Avg episode reward: [(0, '5847.761')] +[2022-07-07 08:34:59,713][09926] Fps is (10 sec: 3276.2, 60 sec: 3208.4, 300 sec: 3249.0). Total num frames: 9474048. Throughput: 0: 6516.9. Samples: 18948096. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:34:59,714][09926] Avg episode reward: [(0, '5787.644')] +[2022-07-07 08:35:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9490432. Throughput: 0: 6488.7. Samples: 18986008. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) +[2022-07-07 08:35:04,712][09926] Avg episode reward: [(0, '5787.949')] +[2022-07-07 08:35:09,712][09926] Fps is (10 sec: 3277.3, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9506816. Throughput: 0: 6550.8. Samples: 19005440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:35:09,712][09926] Avg episode reward: [(0, '5930.898')] +[2022-07-07 08:35:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3262.9). Total num frames: 9523200. Throughput: 0: 6547.0. Samples: 19045888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:35:14,712][09926] Avg episode reward: [(0, '5893.661')] +[2022-07-07 08:35:19,713][09926] Fps is (10 sec: 3276.4, 60 sec: 3276.7, 300 sec: 3249.0). Total num frames: 9539584. Throughput: 0: 6453.5. Samples: 19082864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:35:19,713][09926] Avg episode reward: [(0, '5926.553')] +[2022-07-07 08:35:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9555968. Throughput: 0: 6416.2. Samples: 19100880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:35:24,712][09926] Avg episode reward: [(0, '5923.880')] +[2022-07-07 08:35:29,712][09926] Fps is (10 sec: 3277.2, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9572352. Throughput: 0: 6494.8. Samples: 19142168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:35:29,712][09926] Avg episode reward: [(0, '5975.496')] +[2022-07-07 08:35:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3262.9). Total num frames: 9588736. Throughput: 0: 6397.1. Samples: 19178544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:35:34,712][09926] Avg episode reward: [(0, '5929.268')] +[2022-07-07 08:35:39,712][09926] Fps is (10 sec: 3276.9, 60 sec: 3208.5, 300 sec: 3262.9). Total num frames: 9605120. Throughput: 0: 6506.2. Samples: 19199912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:35:39,712][09926] Avg episode reward: [(0, '5930.736')] +[2022-07-07 08:35:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9621504. Throughput: 0: 6401.8. Samples: 19236168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:35:44,712][09926] Avg episode reward: [(0, '5957.472')] +[2022-07-07 08:35:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9637888. Throughput: 0: 6447.5. Samples: 19276144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:35:49,712][09926] Avg episode reward: [(0, '6007.605')] +[2022-07-07 08:35:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9654272. Throughput: 0: 6468.5. Samples: 19296520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:35:54,712][09926] Avg episode reward: [(0, '6003.675')] +[2022-07-07 08:35:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.9, 300 sec: 3262.9). Total num frames: 9670656. Throughput: 0: 6467.2. Samples: 19336912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:35:59,712][09926] Avg episode reward: [(0, '6014.228')] +[2022-07-07 08:36:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9687040. Throughput: 0: 6535.6. Samples: 19376960. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:36:04,712][09926] Avg episode reward: [(0, '5924.446')] +[2022-07-07 08:36:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9703424. Throughput: 0: 6603.7. Samples: 19398048. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:36:09,712][09926] Avg episode reward: [(0, '5990.068')] +[2022-07-07 08:36:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9719808. Throughput: 0: 6527.5. Samples: 19435904. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:36:14,712][09926] Avg episode reward: [(0, '6016.031')] +[2022-07-07 08:36:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.6, 300 sec: 3249.0). Total num frames: 9732096. Throughput: 0: 6529.6. Samples: 19472376. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:36:19,712][09926] Avg episode reward: [(0, '5991.390')] +[2022-07-07 08:36:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 9752576. Throughput: 0: 6472.3. Samples: 19491168. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) +[2022-07-07 08:36:24,712][09926] Avg episode reward: [(0, '5949.410')] +[2022-07-07 08:36:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 9768960. Throughput: 0: 6545.6. Samples: 19530720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:36:29,712][09926] Avg episode reward: [(0, '5971.792')] +[2022-07-07 08:36:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 9785344. Throughput: 0: 6573.9. Samples: 19571968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:36:34,718][09926] Avg episode reward: [(0, '6037.084')] +[2022-07-07 08:36:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9801728. Throughput: 0: 6531.2. Samples: 19590424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:36:39,712][09926] Avg episode reward: [(0, '6017.995')] +[2022-07-07 08:36:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9818112. Throughput: 0: 6549.9. Samples: 19631656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:36:44,712][09926] Avg episode reward: [(0, '5946.382')] +[2022-07-07 08:36:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9834496. Throughput: 0: 6552.5. Samples: 19671824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:36:49,712][09926] Avg episode reward: [(0, '5970.500')] +[2022-07-07 08:36:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9850880. Throughput: 0: 6545.8. Samples: 19692608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:36:54,712][09926] Avg episode reward: [(0, '5934.800')] +[2022-07-07 08:36:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 9867264. Throughput: 0: 6629.7. Samples: 19734240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:36:59,712][09926] Avg episode reward: [(0, '5934.800')] +[2022-07-07 08:37:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9879552. Throughput: 0: 6553.4. Samples: 19767280. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:37:04,712][09926] Avg episode reward: [(0, '5979.973')] +[2022-07-07 08:37:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 9900032. Throughput: 0: 6526.9. Samples: 19784880. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:37:09,712][09926] Avg episode reward: [(0, '5874.054')] +[2022-07-07 08:37:14,713][09926] Fps is (10 sec: 3685.8, 60 sec: 3276.7, 300 sec: 3262.9). Total num frames: 9916416. Throughput: 0: 6588.9. Samples: 19827232. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:37:14,714][09926] Avg episode reward: [(0, '5905.978')] +[2022-07-07 08:37:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3262.9). Total num frames: 9932800. Throughput: 0: 6525.2. Samples: 19865600. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:37:19,712][09926] Avg episode reward: [(0, '5905.978')] +[2022-07-07 08:37:24,712][09926] Fps is (10 sec: 3277.3, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9949184. Throughput: 0: 6620.3. Samples: 19888336. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) +[2022-07-07 08:37:24,712][09926] Avg episode reward: [(0, '5946.287')] +[2022-07-07 08:37:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9965568. Throughput: 0: 6633.1. Samples: 19930144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:37:29,712][09926] Avg episode reward: [(0, '5913.977')] +[2022-07-07 08:37:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9981952. Throughput: 0: 6529.9. Samples: 19965672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:37:34,712][09926] Avg episode reward: [(0, '6048.760')] +[2022-07-07 08:37:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9998336. Throughput: 0: 6541.0. Samples: 19986952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) +[2022-07-07 08:37:39,712][09926] Avg episode reward: [(0, '6048.760')] +[2022-07-07 08:37:40,765][09926] Component Batcher_0 stopped! +[2022-07-07 08:37:40,765][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w1', 'RolloutWorker_w2', 'RolloutWorker_w3', 'RolloutWorker_w4', 'RolloutWorker_w5', 'RolloutWorker_w6', 'RolloutWorker_w7'] to stop... +[2022-07-07 08:37:40,766][09926] Component RolloutWorker_w1 stopped! +[2022-07-07 08:37:40,766][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w2', 'RolloutWorker_w3', 'RolloutWorker_w4', 'RolloutWorker_w5', 'RolloutWorker_w6', 'RolloutWorker_w7'] to stop... +[2022-07-07 08:37:40,767][09926] Component RolloutWorker_w3 stopped! +[2022-07-07 08:37:40,767][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w2', 'RolloutWorker_w4', 'RolloutWorker_w5', 'RolloutWorker_w6', 'RolloutWorker_w7'] to stop... +[2022-07-07 08:37:40,767][09926] Component RolloutWorker_w6 stopped! +[2022-07-07 08:37:40,767][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w2', 'RolloutWorker_w4', 'RolloutWorker_w5', 'RolloutWorker_w7'] to stop... +[2022-07-07 08:37:40,768][09926] Component RolloutWorker_w7 stopped! +[2022-07-07 08:37:40,768][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w2', 'RolloutWorker_w4', 'RolloutWorker_w5'] to stop... +[2022-07-07 08:37:40,768][09926] Component RolloutWorker_w2 stopped! +[2022-07-07 08:37:40,768][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w4', 'RolloutWorker_w5'] to stop... +[2022-07-07 08:37:40,771][09926] Component RolloutWorker_w4 stopped! +[2022-07-07 08:37:40,771][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w5'] to stop... +[2022-07-07 08:37:40,773][09926] Component RolloutWorker_w5 stopped! +[2022-07-07 08:37:40,773][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0'] to stop... +[2022-07-07 08:37:40,774][09926] Component RolloutWorker_w0 stopped! +[2022-07-07 08:37:40,774][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0'] to stop... +[2022-07-07 08:37:40,785][09926] Component Learner_p0 stopped! +[2022-07-07 08:37:40,785][09926] Waiting for ['InferenceWorker_p0-w0'] to stop... +[2022-07-07 08:37:40,840][09926] Component InferenceWorker_p0-w0 stopped! +[2022-07-07 08:37:40,840][09926] Waiting for process learner_proc0 to stop... +[2022-07-07 08:37:41,309][09926] Waiting for process inference_proc0-0 to stop... +[2022-07-07 08:37:41,504][09926] Waiting for process rollout_proc0 to stop... +[2022-07-07 08:37:42,137][09926] Waiting for process rollout_proc1 to stop... +[2022-07-07 08:37:42,336][09926] Waiting for process rollout_proc2 to stop... +[2022-07-07 08:37:42,337][09926] Waiting for process rollout_proc3 to stop... +[2022-07-07 08:37:42,337][09926] Waiting for process rollout_proc4 to stop... +[2022-07-07 08:37:42,337][09926] Waiting for process rollout_proc5 to stop... +[2022-07-07 08:37:42,338][09926] Waiting for process rollout_proc6 to stop... +[2022-07-07 08:37:42,338][09926] Waiting for process rollout_proc7 to stop... +[2022-07-07 08:37:42,339][09926] Batcher 0 profile tree view: +batching: 5.6629, releasing_batches: 3.0198 +[2022-07-07 08:37:42,339][09926] InferenceWorker_p0-w0 profile tree view: +wait_policy: 0.0052 + wait_policy_total: 1370.0671 +update_model: 19.3319 + weight_update: 0.0008 +one_step: 0.0067 + handle_policy_step: 1592.2322 + deserialize: 44.3551, stack: 9.6641, obs_to_device: 208.1748, norm: 175.3950, forward: 741.5097, to_cpu: 125.9954, save_outputs: 71.2638, send_messages: 101.6876 +[2022-07-07 08:37:42,339][09926] Learner 0 profile tree view: +prepare_batch: 23.5796 +train: 170.3950 + prepare_train: 0.1885, epoch_init: 0.0618, minibatch_init: 1.6663, forward_head: 4.7848, bptt_initial: 0.2375, bptt: 0.2844, tail: 15.9802, losses: 33.6072, kl_divergence: 2.5301, after_optimizer: 1.3443 + update: 99.7968 + clip: 15.0648 +[2022-07-07 08:37:42,340][09926] RolloutWorker_w0 profile tree view: +wait_for_trajectories: 0.7546, prepare_next_step: 30.3510, env_step: 351.6721, overhead: 136.5336, complete_rollouts: 8.3264, enqueue_policy_requests: 143.6231 +save_policy_outputs: 114.2924 + split_output_tensors: 54.7227 +[2022-07-07 08:37:42,340][09926] RolloutWorker_w7 profile tree view: +wait_for_trajectories: 0.7355, prepare_next_step: 29.9659, env_step: 352.9863, overhead: 137.1090, complete_rollouts: 18.5435, enqueue_policy_requests: 137.2353 +save_policy_outputs: 115.8173 + split_output_tensors: 54.2440 +[2022-07-07 08:37:42,341][09926] Loop Runner_EvtLoop terminating... +[2022-07-07 08:37:42,341][09926] Runner profile tree view: +main_loop: 3115.4860 +[2022-07-07 08:37:42,342][09926] Collected {0: 10002432}, FPS: 3209.2